This job has closed.

HirePeaks · 6 hours ago

Analytics automation

United States

Contract

Remote

Senior Level, Lead/Staff

12+ years exp

HirePeaks Consulting is seeking an experienced Analytics Automation professional. The role involves designing and developing data ingestion and transformation pipelines using Azure Databricks and related technologies to deliver end-to-end analytics solutions.

Information Technology & Services

No H1B

Responsibilities

Strong experience with Azure Databricks, including cluster management, notebook development, and Delta Lake

Proficiency in big data technologies such as Hadoop, Spark, and data processing using PySpark

Deep understanding of Azure Data Lake (ADLS Gen2), Azure Synapse Analytics, and Azure Data Factory

Expertise in Power BI, SSRS, SSAS, and Power SKU (PSKU to F SKU) migrations

Hands-on experience with ETL/ELT pipelines, data warehousing, and enterprise data lake architectures

Strong SQL skills with working knowledge of NoSQL databases

Experience with CI/CD pipelines, Git, and version control best practices

Knowledge of cloud security best practices in Azure environments

Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders

Strong analytical and problem-solving skills with a proactive mindset

Proven leadership skills, including mentoring and guiding data engineering teams

Advanced Power BI dashboarding and reporting

Experience with Microsoft Fabric for analytics and integration

Hands-on exposure to Spark Streaming for real-time data processing

Familiarity with Azure Resource Manager (ARM) templates and Infrastructure as Code (IaC)

12+ years of experience designing and developing data ingestion and transformation pipelines using Azure Databricks, Synapse notebooks, and Azure Data Factory

Strong hands-on expertise with Delta Tables, Delta Lake, and ADLS Gen2

Extensive experience using Auto Loader and Delta Live Tables for scalable and reliable data ingestion

Proficient in building and optimizing Databricks SQL query layers

Proven experience integrating Databricks, Azure Synapse, ADLS Gen2, and Power BI to deliver end-to-end analytics solutions

Hands-on experience developing, optimizing, and deploying Power BI reports

Familiarity with modern CI/CD practices for Databricks and cloud-native solutions

Qualification

Azure DatabricksBig data technologiesAzure Data LakePower BIETL/ELT pipelinesSQLCI/CD pipelinesCloud securityAnalytical skillsPower BI dashboardingMicrosoft FabricSpark StreamingAzure Resource ManagerCommunication skillsLeadership skills

Required