Apolis · 1 month ago
Senior/Lead Data Engineer | FullTime/ Permanent
Apolis is a company seeking a Senior/Lead Data Engineer to join their team. The role involves designing and implementing data solutions using Azure services and requires extensive experience in data engineering, particularly with ETL processes and data architecture.
ConsultingEnterprise ApplicationsEnterprise Resource Planning (ERP)Information TechnologyIT InfrastructureIT ManagementMobileSoftwareWeb Hosting
Responsibilities
· 8+ years of hands-on data engineering experience in enterprise environments
· Strong expertise in Azure services, especially Azure Databricks, Functions, and Azure Data Factory (preferred)
· Advanced proficiency in Apache Spark with Python (PySpark)
· Strong command over SQL, query optimization, and performance tuning
· Deep understanding of ETL/ELT methodologies, data pipelines, and scheduling/orchestration
· Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution)
· Strong experience in data modelling (normalized, dimensional, lakehouse modelling)
· Experience in both batch processing and real-time/streaming data (Kafka, Event Hub, or similar)
· Solid understanding of data architecture principles, distributed systems, and cloud-native design patterns
· Ability to design end-to-end solutions, evaluate trade-offs, and recommend best-fit architectures
· Strong analytical, problem-solving, and communication skills
· Ability to collaborate with cross-functional teams and lead technical discussions
Qualification
Required
8+ years of hands-on data engineering experience in enterprise environments
Strong expertise in Azure services, especially Azure Databricks, Functions, and Azure Data Factory
Advanced proficiency in Apache Spark with Python (PySpark)
Strong command over SQL, query optimization, and performance tuning
Deep understanding of ETL/ELT methodologies, data pipelines, and scheduling/orchestration
Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution)
Strong experience in data modelling (normalized, dimensional, lakehouse modelling)
Experience in both batch processing and real-time/streaming data (Kafka, Event Hub, or similar)
Solid understanding of data architecture principles, distributed systems, and cloud-native design patterns
Ability to design end-to-end solutions, evaluate trade-offs, and recommend best-fit architectures
Strong analytical, problem-solving, and communication skills
Ability to collaborate with cross-functional teams and lead technical discussions
Preferred
Experience with CI/CD tools such as Azure DevOps and Git
Familiarity with IaC tools (Terraform, ARM)
Exposure to data governance and cataloging tools (Azure Purview)
Experience supporting machine learning or BI workloads on Databricks
Company
Apolis
Apolis is a IT consultancy that offers provides ERP solutions, hosting, assessment, web and mobile, IT staffing and IT workforce solutions.
H1B Sponsorship
Apolis has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (15)
2022 (15)
2021 (12)
2020 (122)
Funding
Current Stage
Late StageCompany data provided by crunchbase