Yochana · 19 hours ago
Lead AWS Data Engineer
St Louis, MO
Full-time
Onsite
Lead/StaffYochana is seeking a Lead AWS Data Engineer to design and build scalable, cloud-native data platforms. The role involves mentoring engineers, creating robust ETL/ELT pipelines, and collaborating with cross-functional teams to deliver high-impact solutions.
Business Information SystemsInformation and Communications Technology (ICT)Information ServicesInformation TechnologySoftwareStaffing Agency
Hiring Manager
Raquib Bilal
Responsibilities
Design and build scalable, cloud-native data platforms using PySpark, Python, and modern data engineering practices
Mentor and guide other engineers, sharing knowledge, reviewing code, and fostering a culture of curiosity, growth, and continuous improvement
Create robust, maintainable ETL/ELT pipelines that integrate with diverse systems and serve business-critical use cases
Lead by example—write high-quality, testable code and participate in architecture and design discussions with a long-term view in mind
Decompose complex problems into modular, efficient, and scalable components that align with platform and product goals
Champion best practices in data engineering, including testing, version control, documentation, and performance tuning
Drive collaboration across teams, working closely with product managers, data scientists, and other engineers to deliver high-impact solutions
Support data governance and quality efforts, ensuring data lineage, cataloging, and access management are built into the platform
Continuously learn and apply new technologies, frameworks, and tools to improve team productivity and platform reliability
Own and optimize cloud infrastructure components related to data engineering workflows, storage, processing, and orchestration
Participate in architectural discussions, iteration planning, and feature sizing meetings
Adhere to Agile processes and participate actively in agile ceremonies
Stakeholder management skills
Qualification
Required
Design and build scalable, cloud-native data platforms using PySpark, Python, and modern data engineering practices
Mentor and guide other engineers, sharing knowledge, reviewing code, and fostering a culture of curiosity, growth, and continuous improvement
Create robust, maintainable ETL/ELT pipelines that integrate with diverse systems and serve business-critical use cases
Lead by example—write high-quality, testable code and participate in architecture and design discussions with a long-term view in mind
Decompose complex problems into modular, efficient, and scalable components that align with platform and product goals
Champion best practices in data engineering, including testing, version control, documentation, and performance tuning
Drive collaboration across teams, working closely with product managers, data scientists, and other engineers to deliver high-impact solutions
Support data governance and quality efforts, ensuring data lineage, cataloging, and access management are built into the platform
Continuously learn and apply new technologies, frameworks, and tools to improve team productivity and platform reliability
Own and optimize cloud infrastructure components related to data engineering workflows, storage, processing, and orchestration
Participate in architectural discussions, iteration planning, and feature sizing meetings
Adhere to Agile processes and participate actively in agile ceremonies
Stakeholder management skills
Solid understanding of EMR Serverless, Apache Airflow, DAGs, Iceberg S3, SQS, DLQ, Lambda, AWS Lake Formation, Glue, Athena, Data Pipelines, Databricks Unity catalog, DBX S3
Any experience in YAML Data Contracts
Experience with containerization and infrastructure automation (e.g., Docker, Terraform) will be a good addition
Experience integrating heterogeneous systems and building resilient data pipelines across cloud environments
Familiarity with orchestration tools (e.g., Airflow, dbt, Step Functions, etc.)
Exposure to data governance tools and practices (e.g., Lake Formation, Purview, or Atlan)
Preferred
AWS Certified Data Analytics, Azure Data Engineer), or demonstrable contributions to open source/data engineering communities will be a bonus
Exposure to machine learning data pipelines or MLOps is a plus
Company
Yochana
Yochana: Your Trusted Workforce Partner Across North America & Beyond For over 16 years, Yochana has been a leading talent acquisition firm, connecting businesses with top professionals across industries.
Founded in 2009
201-500 employees
H1B Sponsorship
Yochana has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (21)
2024 (11)
2023 (3)
Funding
Current Stage
Growth StageLeadership Team
Anusha Sharath
Global Talent Acquisition Lead / HR-BP
Recent News
Company data provided by crunchbase