CloudIngest ยท 19 hours ago
Azure Data Engineer- ADF
CloudIngest is seeking an experienced Azure Data Engineer with strong hands-on expertise in Azure Databricks and Azure Data Factory. The role involves designing, developing, and maintaining scalable data pipelines while ensuring data quality and governance best practices are followed.
Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF)
Implement data transformation and processing solutions using Azure Databricks (PySpark/Scala)
Integrate data from multiple sources including structured and semi-structured data
Optimize data workflows for performance, reliability, and cost efficiency
Collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions
Ensure data quality, governance, and security best practices are followed
Monitor and troubleshoot data pipelines and production issues
Participate in code reviews and follow DevOps and CI/CD best practices
Qualification
Required
Proven experience as an Azure Data Engineer
Strong hands-on experience with Azure Databricks and Azure Data Factory
Mandatory Certifications:
Databricks Certification
Azure Data Factory Certification
Strong knowledge of SQL, PySpark, and data modeling concepts
Experience with Azure services such as Azure Data Lake Storage (ADLS), Azure Synapse, and Azure SQL
Understanding of data warehousing and ETL/ELT best practices
Excellent problem-solving and communication skills
Preferred
Experience with CI/CD pipelines using Azure DevOps
Knowledge of cloud security and data governance frameworks
Prior experience working in an onsite client-facing environment
Company
CloudIngest
CloudIngest offers software development, digital Transformations, business intelligence, and cloud services.
H1B Sponsorship
CloudIngest has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7)
2024 (9)
2023 (13)
2022 (6)
2021 (2)
2020 (6)
Funding
Current Stage
Early StageCompany data provided by crunchbase