200+ applicants

Company

Original Job Post

John Burns Research and Consulting · 2 days ago

Senior Data Engineer

United States

Full-time

Remote

Senior Level

5+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

AdviceConsulting

Growth Opportunities

Hiring Manager

Kathy Ayuyao

Insider Connection @John Burns Research and Consulting

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design, develop, and maintain efficient and reliable data pipelines within the Azure cloud environment.

Migrate data from an on-premises data warehouse to the Azure cloud environment.

Write clean and well-documented Python code using best practices.

Review database architecture, schemas, and table relationships to improve consistency and performance.

Communicate with stakeholders to understand data requirements and propose cost-effective solutions.

Effectively communicate with the team and document code for easy maintenance.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonSQL ServerAzureT-SQLPySparkDatabase FundamentalsAzure Cloud ServicesData EngineeringDocumentationProblem-SolvingEffective CommunicationTeamworkAzure Data EngineeringAzure Solutions ArchitectPowerShellSSISGitAzure DevOpsData Visualization ToolsPower BITableauData GovernanceSecurity Best Practices

Required

5+ years as a data engineer

Strong Python, SQL Server, and Azure knowledge

3+ years of consistent experience using SQL Server (T-SQL)

4-5+ years of Python (bonus point for strong PySpark experience)

Ability to write clean, well-documented Python code using best practices

Strong understanding of database fundamentals

Experience with at least three of the following Azure cloud services for the last 3+ years: Data Factory, Synapse, Databricks, Logic App, Batch/VMs, Functions, Purview

Ability to independently research and suggest the best cloud service/tool for a data problem

Comfortable with choosing the right tool based on data sizes and other considerations

Effective communication skills with stakeholders and team members

Care about writing thoughtful code with appropriate documentation