DTI (Diversified Technology Inc.) · 1 day ago
Data Quality Architect
DTI (Diversified Technology Inc.) is a successful African American owned IT Consulting/Staffing firm based in Chicago's Loop. They are seeking a Data Quality Architect to ensure the accuracy, consistency, and reliability of data across various systems and processes, while developing and implementing data quality standards, policies, and procedures.
Information Technology & Services
Responsibilities
Develop and maintain resilient data pipelines across state, action, decision, and analytics domains using Python, SQL, Spark, and Databricks
Design both batch and streaming workflows to address near-real-time and scheduled data processing needs
Implement and manage orchestration frameworks (e.g., Airflow, Prefect) to support data quality, reliability, and scalability
Qualification
Required
Must work on our W2
Advanced (6-9 years experience) in SPARK
Extensive experience with cloud-based data platforms (such as AWS, Azure, or GCP)
Experience with data orchestration solutions (including Airflow or Prefect)
Best practices in data quality and observability
Familiarity with schema evolution, backward compatibility, and governance for shared data products
Experience working within regulated or healthcare environments is considered an asset
Develop and maintain resilient data pipelines across state, action, decision, and analytics domains using Python, SQL, Spark, and Databricks
Design both batch and streaming workflows to address near-real-time and scheduled data processing needs
Implement and manage orchestration frameworks (e.g., Airflow, Prefect) to support data quality, reliability, and scalability