Ampstek · 9 hours ago
Data Engineer
Responsibilities
Design, build, and maintain scalable data pipelines using Python, Spark, and SQL
Develop and optimize data workflows on Azure using Databricks for large-scale processing
Implement and manage data orchestration and scheduling with Apache Airflow
Ensure data quality, reliability, and performance across batch and real-time data pipelines
Collaborate with data scientists, analysts, and stakeholders to support analytics and reporting needs
Apply best practices in data modeling, security, monitoring, and cost optimization in cloud environments
Qualification
Required
Design, build, and maintain scalable data pipelines using Python, Spark, and SQL
Develop and optimize data workflows on Azure using Databricks for large-scale processing
Implement and manage data orchestration and scheduling with Apache Airflow
Ensure data quality, reliability, and performance across batch and real-time data pipelines
Collaborate with data scientists, analysts, and stakeholders to support analytics and reporting needs
Apply best practices in data modeling, security, monitoring, and cost optimization in cloud environments