Horizontal Talent ยท 17 hours ago
Sr Data Engineer
Horizontal Talent is seeking a highly skilled Senior Data Engineer to join their team and contribute to innovative data solutions. The role involves designing and implementing scalable data architectures, developing ETL/ELT pipelines, and ensuring data security and compliance.
Business DevelopmentConsultingStaffing Agency
Responsibilities
Design and implement scalable data architectures and models
Develop and maintain ETL/ELT pipelines using Azure Data Factory and Databricks
Optimize data storage and retrieval in Snowflake and relational databases
Ensure data security, governance, and compliance with enterprise standards
Collaborate with cross-functional teams for data integration and analytics
Perform data validation and regression testing for ETL processes
Analyze existing business processes and identify improvement opportunities
Document workflows and create standard operating procedures for data-related operations
Qualification
Required
Design and implement scalable data architectures and models
Develop and maintain ETL/ELT pipelines using Azure Data Factory and Databricks
Optimize data storage and retrieval in Snowflake and relational databases
Ensure data security, governance, and compliance with enterprise standards
Collaborate with cross-functional teams for data integration and analytics
Perform data validation and regression testing for ETL processes
Analyze existing business processes and identify improvement opportunities
Document workflows and create standard operating procedures for data-related operations
Advanced proficiency in SQL for complex queries and performance tuning
Hands-on experience with Snowflake, Databricks, and Azure Data Factory
Strong understanding of data governance and quality assurance practices
Excellent problem-solving skills and attention to detail
Preferred
Experience in the healthcare domain
Familiarity with cloud-native architectures and agile methodologies
Knowledge of Python and data visualization tools like Power BI or Tableau
Relevant certifications such as Microsoft DP-203 or Azure Databricks