Apolis · 16 hours ago
Data Qaulity Consultant
Apolis is a company focused on data solutions, and they are seeking a Data Quality Consultant. The role involves constructing data pipelines and ensuring data quality and governance in collaboration with various teams.
ConsultingEnterprise ApplicationsEnterprise Resource Planning (ERP)Information TechnologyIT InfrastructureIT ManagementMobileSoftwareWeb Hosting
Responsibilities
Develop and maintain resilient data pipelines across state, action, decision, and analytics domains using Python, SQL, Spark, and Databricks
Design both batch and streaming workflows to address near-real-time and scheduled data processing needs
Implement and manage orchestration frameworks (e.g., Airflow, Prefect) to support data quality, reliability, and scalability
Qualification
Required
Advanced (6-9 years experience) in SPARK
Extensive experience with cloud-based data platforms (such as AWS, Azure, or GCP)
Experience with data orchestration solutions (including Airflow or Prefect)
Best practices in data quality and observability
Familiarity with schema evolution, backward compatibility, and governance for shared data products
Experience working within regulated or healthcare environments