Apply on Employer Site

AECOM · 7 hours ago

Lead Data Engineer

Dallas, TX

Full-time

Hybrid

Senior Level, Lead/Staff

$130K/yr - $180K/yr

8+ years exp

AECOM is a global infrastructure consulting firm dedicated to delivering a better world. They are hiring a Lead Data Engineer to modernize an enterprise data platform from legacy systems to a cloud-native AWS lakehouse, focusing on hands-on technical delivery and mentorship.

Civil EngineeringConstructionConsultingEnergyGovernmentInformation Technology

No H1B

Responsibilities

Design, build, and operate end-to-end, production-grade data pipelines in AWS

Re-engineer legacy ETL into a lakehouse architecture (Bronze/Silver/Gold) on S3

Work hands-on with open table formats in AWS (S3 Tables / Apache Iceberg) and understand their metadata, snapshots, schema evolution, and performance characteristics

Develop pipelines using Python, PySpark, and Spark on AWS Glue and/or EMR

Orchestrate workloads using Airflow or AWS Step Functions

Partner with data architects to translate business requirements into data products

Perform code reviews, mentor engineers, and contribute hands-on in production

Support agile development practices, including planning, demos, and reviews

Qualification

AWS data servicesPythonPySparkData pipeline orchestrationApache IcebergAirflowData pipeline designAgile development practicesCommunication skillsMentorship

Required

BA/BS in Computer Science, Engineering, or a related field plus at least 8 years of hands-on data engineering experience, or demonstrated equivalent experience and education

Strong, current hands-on experience with AWS data services, including S3 and Spark-based processing

Hands-on experience with an open table format (such as Apache Iceberg, Delta Lake, or Hudi), with a clear understanding of table metadata, schema evolution, partitioning, and performance tradeoffs

Proficiency in Python and PySpark for production data pipelines

Experience designing, building, and operating data pipelines end-to-end in AWS

Experience orchestrating data pipelines using Airflow or AWS Step Functions

Strong communication skills and ability to operate as a hands-on technical lead