Infinitive · 5 months ago
Senior Data Engineer (Databricks Pro Certified)
Infinitive is a data and AI consultancy that helps clients modernize and operationalize their data. They are seeking a highly skilled Data Engineer with extensive experience in Databricks to design, build, and maintain scalable data architectures while ensuring data integrity and optimizing data flow. The role involves collaborating with stakeholders, developing ETL processes, and leading data governance initiatives.
AdvertisingInformation TechnologyInternetMarketing
Responsibilities
Design, develop, and implement data architectures and solutions on Databricks in both AWS and Azure
Collaborate with stakeholders to understand business requirements and translate them into technical specifications
Develop and maintain ETL processes to ensure efficient data flow and integration across systems
Ensure data quality, integrity, and security in all data-related activities
Optimize data storage and retrieval strategies to improve performance and cost-efficiency
Lead the implementation of data governance policies and procedures
Provide technical guidance and mentorship to data engineering teams
Stay updated with the latest industry trends and best practices in data architecture, Databricks, cloud data warehouses, AWS and Azure
Qualification
Required
Bachelor's or Master's degree in Computer Science, Information Technology, or related field
Proven experience as a Data Architect, with a strong focus on Databricks
Proficiency in Databricks, including the ability to build and optimize Spark applications
Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others
Strong knowledge of Unity Catalog and its application in managing and securing data assets
Strong knowledge of data modeling, ETL processes, and data warehousing concepts
Proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark)
Familiarity with data governance and data security practices
Databricks Certified Professional
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills
Preferred
AWS Certified Solutions Architect or similar certification
Experience with other cloud platforms (e.g., Azure, GCP)
Knowledge of machine learning and data science concepts
Experience with data visualization tools (e.g., Tableau, Power BI)
Prior experience in a leadership or mentorship role