Be an early applicantLess than 25 applicants

Company

Original Job Post

myGwork - LGBTQ+ Business Community · 2 days ago

Senior Data Engineer

Kansas, United States

Full-time

Onsite

Senior Level

$112K/yr - $185K/yr

3+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Internet

Insider Connection @myGwork - LGBTQ+ Business Community

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design, develop, and maintain scalable data pipelines with Snowflake, Apache Airflow, dbt (SQL), and Python with AWS services.

Support and contribute to the continuous improvement, tuning, applications, infrastructure developments, process controls, and upgrades of the data platform.

Provide guidance, hands-on development, and operational support for the deployment of database scripts and changes across multiple environments.

Collaborate with Moody's technical teams and business owners as needed during the design and implementation.

Manage individual time and tasks effectively.

Collaborate with cross-functional teams to understand data requirements and implement effective solutions.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data EngineeringSoftware DevelopmentTechnical LeadershipETL Data PipelinesAirflow DAG ManagementData Quality ChecksApache AirflowAgile MethodologyTesting SkillsDocumentation SkillsDatabase EngineeringPostgres SQLDynamoDBSnowflakeProblem-SolvingEffective CommunicationAWS Database TechnologiesData QualityData GovernanceObject-Oriented ProgrammingDesign PatternsArchitectural PatternsGitBitbucketGitHubJiraRallyAsanaJenkinsCypress

Required

Bachelor's degree or equivalent, Master's is a plus - or equivalent experience

3+ year of experience contributing to and providing technical leadership in a data engineering or software development team

Hands on experience in design and development of data integration/ETL data pipelines from various data sources and data formats

Knowledge of best practices for Airflow DAG management, scheduling, and monitoring.

Experience with implementing data quality checks, error handling, and retries in Airflow workflows.

Hands-on experience designing, developing, and maintaining data pipelines using Apache Airflow, including creating custom operators, sensors, and plugins.

Experience within all phases of software development working across Agile teams, product owners and external stakeholders

Experience driving technical ideas and communicating clearly to both technical and non-technical audiences at all levels of the organization

Strong development, testing, debugging skills at all levels (unit, system, integration, and performance testing) along with detail-oriented documentation skills

Effective communication and problem-solving skills.

Strong database engineering skills with emphasis Postgres SQL, DynamoDB, Snowflake

Preferred

Hands on experience implementing, managing, supporting, and developing with AWS database technologies, AWS RDS (Microsoft SQL Server, PostgreSQL) and AWS DynamoDB

Strong understanding of data quality best practices and data governance principles.

Strong understanding of object-oriented programming, design, and architectural patterns

Experience with development technologies: Git (Bitbucket or GitHub), Jira, Rally, Asana, Jenkins, Cypress, Postman

Experience with AWS cloud technologies: ECS/Fargate, ECR (EC2 Container Registry), Lambda, DynamoDB, Aurora PostgreSQL, API (Application Programming Interface) Gateway, VPC (Virtual Private Cloud), ALB, NLB, Neptune

Experience working with big data technologies: Apache Airflow, Apache Spark, Apache Kafka, AWS Kinesis, AWS Redshift

Experience with development languages: Java (Spring Boot), Scala, PySpark