This job has closed.

Talent Groups · 1 day ago

Azure Data Engineer (ADF)

Raleigh, NC

Contract

Onsite

Senior Level

Talent Groups is seeking an Azure Data Engineer (ADF) to join their team. The role involves designing and building data pipelines, optimizing SQL queries, and utilizing Azure technologies to manage and process large datasets efficiently.

IT Management

H1B Sponsor Likely

Hiring Manager

Jameel Baig

Responsibilities

Expert level skills writing and optimizing complex SQL

Experience with complex data modelling, ETL design, and using large databases in a business environment

Experience with building data pipelines and applications to stream and process datasets at low latencies

Fluent with Big Data technologies like Spark, Kafka and Hive

Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required

Designing and building of data pipelines using API ingestion and Streaming ingestion methods

Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential

Experience in developing NO SQL solutions using Azure Cosmos DB is essential

Working knowledge of Python is desirable

Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services

Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB

Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information

Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks

Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making

Qualification

Azure Data FactorySQLBig Data technologiesETL designAzure SynapseAzure SQLAzure Data LakeAzure Cosmos DBPythonDev-Ops processesData security measuresData pipelinesData processing

Required