Ztek Consulting · 7 hours ago
Data Engineer
Ztek Consulting is seeking a Data Engineer to build and optimize data pipelines. The role involves designing scalable ETL processes and managing data lake architecture while ensuring data quality and compliance.
Responsibilities
Build, optimize, and maintain batch and real-time data ingestion pipelines
Lead design and implementation of scalable ETL processes across complex, distributed systems
Develop and manage data lake architecture for structured and unstructured data
Utilize Apache Airflow for workflow orchestration and scheduling
Integrate streaming data via Apache Kafka
Use AWS Glue, Python, and SQL to transform and prepare data for downstream consumption
Ensure data quality, lineage, governance, and compliance across all systems
Work closely with VA stakeholders and data scientists to support reporting and model development
Mentor mid-level and junior engineers, providing technical guidance and peer reviews
Document data pipelines, standards, and data product specifications
Qualification
Required
An active security clearance or the ability to obtain one if required
Strong proficiency in Python and SQL
Hands-on experience with Apache Airflow, Apache Kafka, and AWS Glue
Deep understanding of ETL frameworks, data lake design, and cloud-based architecture
Familiarity with real-time and batch data processing tools and methodologies
Experience with data governance, security compliance, and maintaining data quality standards
Employees in this role are responsible for safeguarding sensitive information and must adhere to all organizational security and privacy policies, ensuring the protection, proper handling, and confidentiality of data at all times
Company
Ztek Consulting
Ztek Consulting Inc is a minority- and woman-owned business enterprise that leverages a unique blend of human talent, machine learning algorithms, and artificial intelligence to provide customized talent management solutions for its clients.