GeorgiaTEK Systems Inc. · 4 hours ago
Data Platform Engineer
GeorgiaTEK Systems Inc. is seeking a Data Platform Engineer to design and implement data architecture using technologies like Databricks and Unity Catalog. The role involves developing and managing data pipelines, ensuring data security and compliance, and collaborating with cross-functional teams to deliver scalable solutions.
Responsibilities
Design and implement data architecture leveraging technologies such as Databricks, Unity Catalog, Privacera, and Collibra
Develop, optimize, and manage data pipelines for ETL processes using Databricks, with a focus on data integrity and quality
Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices
Ensure data security and compliance with regulations using Databricks and Privacera's features
Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices
Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups
Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions
Qualification
Required
12+ years of experience
Design and implement data architecture leveraging technologies such as Databricks, Unity Catalog, Privacera, and Collibra
Develop, optimize, and manage data pipelines for ETL processes using Databricks, with a focus on data integrity and quality
Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices
Ensure data security and compliance with regulations using Databricks and Privacera's features
Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices
Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups
Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions