Outdefine · 2 days ago

Azure Data Engineer

United States

Full-time

Remote

Mid, Senior Level

5+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

BlockchainInternet

Hiring Manager

CHINENYE IJOMAH

Insider Connection @Outdefine

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design and implement data pipelines and workflows using Azure Databricks.

Develop and optimize Spark applications for data processing and analysis.

Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics.

Perform data ingestion, cleansing, and transformation tasks.

Monitor and troubleshoot performance issues in data pipelines.

Collaborate with data scientists and analysts to understand data requirements and deliver appropriate solutions.

Ensure data security and compliance with industry standards and best practices.

Document technical solutions and processes.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Azure DatabricksApache SparkAzure Cloud ServicesProgramming LanguagesPythonScalaSQLBig Data TechnologiesData WarehousingData ModelingETL ProcessesProblem-SolvingAnalyticalCommunicationTeamwork