Programmers.io · 12 hours ago

Azure Data Engineer with Databricks (Full Time Only)

United States

Full-time

Remote

Mid Level

Maximize your interview chances

SEOSoftware

Growth Opportunities

Hiring Manager

Abhinesh Kumar

Insider Connection @Programmers.io

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Understand business requirements.

Understand source systems, source data and source data formats that are available on-prem / cloud.

Design and build data ingestion pipeline.

Design and build complex data processing pipelines.

Work with relevant stakeholders to assist with data-related technical issues and support their data needs.

Build programs for data quality checks.

Provide operational support.

Work with data architecture, data governance and data analytics. teams to ensure pipelines adhere to enterprise standards, usability, and performance.

Involve in System Testing, UAT, code deployment activities.

Coordinate with offshore team on regular basis

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Azure DatabricksPySparkPythonKafkaADFCICDAirflowSQLCloud DatabasesAgile methodologies