Saransh Inc ยท 1 month ago
Senior/Lead Data Engineer (Azure Databricks) - Fulltime Role
Saransh Inc is seeking a Senior/Lead Data Engineer with extensive experience in the Azure ecosystem. The role involves designing and delivering high-performing data solutions, driving data engineering initiatives, and ensuring the quality of data pipelines.
EmploymentInformation TechnologyStaffing Agency
Responsibilities
Looking for an experienced Senior/Lead Data Engineer with 8+ years of expertise in designing and delivering scalable, high-performing data solutions on the Azure ecosystem
The ideal candidate will have deep hands-on experience with Databricks, Spark, modern data lakehouse architectures, data modelling, and both batch and real-time data processing
You will be responsible for driving end-to-end data engineering initiatives, influencing architectural decisions, and ensuring robust, high-quality data pipelines
Qualification
Required
8+ years of hands-on data engineering experience in enterprise environments
Strong expertise in Azure services, especially Azure Databricks, Functions, and Azure Data Factory (preferred)
Advanced proficiency in Apache Spark with Python (PySpark)
Strong command over SQL, query optimization, and performance tuning
Deep understanding of ETL/ELT methodologies, data pipelines, and scheduling/orchestration
Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution)
Strong experience in data modelling (normalized, dimensional, lakehouse modelling)
Experience in both batch processing and real-time/streaming data (Kafka, Event Hub, or similar)
Solid understanding of data architecture principles, distributed systems, and cloud-native design patterns
Preferred
Experience with CI/CD tools such as Azure DevOps and Git
Familiarity with IaC tools (Terraform, ARM)
Exposure to data governance and cataloging tools (Azure Purview)
Experience supporting machine learning or BI workloads on Databricks
Company
Saransh Inc
We provide recruitment, consulting and IT services for our clients, which focus on maximizing their revenue generation, enhancing business productivity and improving cost management.