Senior Data Engineer (Databricks Pro Certified) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Infinitive · 5 months ago

Senior Data Engineer (Databricks Pro Certified)

Infinitive is a data and AI consultancy that helps clients modernize and operationalize their data. They are seeking a highly skilled Data Engineer with extensive experience in Databricks to design, build, and maintain scalable data architectures while ensuring data integrity and optimizing data flow. The role involves collaborating with stakeholders, developing ETL processes, and leading data governance initiatives.

AdvertisingInformation TechnologyInternetMarketing
badNo H1Bnote

Responsibilities

Design, develop, and implement data architectures and solutions on Databricks in both AWS and Azure
Collaborate with stakeholders to understand business requirements and translate them into technical specifications
Develop and maintain ETL processes to ensure efficient data flow and integration across systems
Ensure data quality, integrity, and security in all data-related activities
Optimize data storage and retrieval strategies to improve performance and cost-efficiency
Lead the implementation of data governance policies and procedures
Provide technical guidance and mentorship to data engineering teams
Stay updated with the latest industry trends and best practices in data architecture, Databricks, cloud data warehouses, AWS and Azure

Qualification

DatabricksAWS servicesData architectureSQLETL processesData governanceData modelingData securityMachine learning knowledgeData visualization toolsProblem-solvingCommunication skillsCollaboration skillsLeadership experience

Required

Bachelor's or Master's degree in Computer Science, Information Technology, or related field
Proven experience as a Data Architect, with a strong focus on Databricks
Proficiency in Databricks, including the ability to build and optimize Spark applications
Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others
Strong knowledge of Unity Catalog and its application in managing and securing data assets
Strong knowledge of data modeling, ETL processes, and data warehousing concepts
Proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark)
Familiarity with data governance and data security practices
Databricks Certified Professional
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills

Preferred

AWS Certified Solutions Architect or similar certification
Experience with other cloud platforms (e.g., Azure, GCP)
Knowledge of machine learning and data science concepts
Experience with data visualization tools (e.g., Tableau, Power BI)
Prior experience in a leadership or mentorship role

Company

Infinitive

twittertwittertwitter
company-logo
Infinitive helps companies master the digital world with capabilities in marketing, digital advertising, business transformation and more.

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Denis McFarlane
Founder & Executive Chairman
linkedin
Company data provided by crunchbase