Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

The Washington Post · 5 hours ago

Senior Data Engineer

The Washington Post is on a mission to deliver riveting storytelling for all of America, and they are seeking a skilled and experienced Senior Data Engineer for their Data and AI team. This role involves designing, building, and deploying data solutions that power AI technologies and supports advertising insights generation and campaign infrastructure.

Newspapers
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Lead data engineering efforts using Python, Spark, Flink and other data processing technologies, delivering scalable, secure, and reliable data pipelines, and contribute to the architecture and decision-making processes of large, complex projects
Collaborate on gathering and analyzing project requirements to define technical solutions, and work with cross-functional teams to integrate front-end and back-end solutions, ensuring seamless user experiences
Write clear, maintainable code, following best practices in version control, code reviews, and testing, and ensure that all software solutions are scalable, secure, and meet the needs of our users
Collaborate with cross-functional teams, including data scientists, product managers, and designers, to identify and prioritize project requirements, and communicate technical solutions to stakeholders
Mentor and coach junior engineers, offering technical guidance and reviewing code to ensure quality, and contribute to the growth and development of our engineering team
Collaborate with Product, Design, Newsroom and business stakeholders to manage and optimize project timelines, proactively identifying blockers and risks to ensure timely delivery
Stay current with industry trends, suggesting improvements to enhance performance, security, and scalability, and apply knowledge of data engineering to drive innovation and improvement in our products and services
Contribute to the development of technical documentation and design specifications for team members and share knowledge and expertise with the team to promote a culture of innovation and collaboration

Qualification

PythonETL developmentAWS Data LakehouseData modelingSQLApache AirflowCloud infrastructureDockerPerformance monitoringMentorshipProblem-solvingCommunication

Required

Bachelor's degree in Computer Science, Software Engineering, or a related field is acceptable
Equivalent professional experience will also be considered
3+ years of overall experience in ETL/ELT, Data modeling, and querying and analyzing large datasets using SQL
Extensive experience with ETL development using Python and PySpark
Experience with AWS Data Lakehouse technologies including Redshift, Athena, EMR, and Glue catalog
Strong understanding of Pub/Sub and event-driven architecture
Able to design and deploy DAGs using Apache Airflow
Experience with software development best practices, including coding standards, code reviews, testing, and CI/CD pipelines
Experience with performance monitoring and observability tools (e.g., Splunk, Datadog) for maintaining application health and performance
Proven ability to mentor junior engineers, influence team-wide practices, and communicate technical concepts to both technical and non-technical stakeholders
Excellent problem-solving skills, with the ability to troubleshoot and debug issues across the stack
Ability to handle complex projects with limited supervision and manage technical decision-making
Strong proficiency with cloud infrastructure, including experience with AWS services (e.g., EC2, S3, RDS, Lambda, Batch) for building and deploying scalable, reliable, cloud-based applications

Preferred

Master's degree in Computer Science, Software Engineering, or a related field is preferred
Experience with Apache Iceberg, Postgres, MySQL, DynamoDB, Tableau, and Superset also highly preferred
Strong skills with Docker and ECS are highly preferred
Experience working with Google Ad Manager data and Ad Tech vendors is a plus

Benefits

Competitive medical, dental and vision coverage
Company-paid pension and 401(k) match
Three weeks of vacation and up to three weeks of paid sick leave
Nine paid holidays and two personal days
20 weeks paid parental leave for any new parent
Robust mental health resources
Backup care and caregiver concierge services
Gender affirming services
Pet insurance
Free Post digital subscription
Leadership and career development programs

Company

The Washington Post

company-logo
The Washington Post is an award-winning news leader whose mission is to connect, inform, and enlighten local, national and global readers with trustworthy reporting, in-depth analysis and engaging opinions.

H1B Sponsorship

The Washington Post has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (18)
2024 (16)
2023 (15)
2022 (16)
2021 (22)
2020 (20)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Paul Van Deventer
Senior Research Analyst to the CEO
linkedin
leader-logo
Dan Stillman
Co-founder and Meteorologist, Capital Weather Gang
linkedin
Company data provided by crunchbase