hackajob · 4 hours ago
Lead Data Engineer
United States
Full-time
Remote
Lead/Staffhackajob is collaborating with Kainos to connect them with exceptional tech professionals for the role of Lead Data Engineer. The Lead Data Engineer will be responsible for designing and developing data processing and persistence software components, providing development leadership, and ensuring code quality and user needs are met.
Artificial Intelligence (AI)Generative AIHuman ResourcesRecruitingSoftware
Responsibilities
Taking responsibility for the development of whole components or subsystems within a team. Development incorporates design, code, test and defect resolution
Focusing on hands-on design and development, using open source and commercial platforms
Defining and enforcing development best practice and coaching team members to ensure consistency
Working with project architects, taking responsibility for non-functional needs of ETL/ELT data processing pipelines such as robustness and performance
Taking responsibility for standards and execution of unit and integration testing done within the team
Taking responsibility for software product due diligence and integration
Leading troubleshooting and tuning of activities
Working with Operations teams to ensure the application software is operationally ready
Working with Security Architects and accreditors to ensure compliance with relevant legal and security requirements
Advising customers and managers and other team members of the estimated effort and technical implications of user stories and user journeys
Contributing to technical proposals as part of the sales process
Managing, coaching and developing a small number of staff, with a focus on managing employee performance and assisting in their career development. You’ll also provide direction for your team as you solve problems together
Qualification
Required
Experience of leading a team of engineers in the implementation of data-intensive system components
Experience of applying standards for design (patterns), development, (style guides) and operational readiness (automation, deployment)
Proficient software development experience in one of Java, Scala, or Python
Software development experience with data-processing platforms from vendors including Informatica, Azure Databricks or any relevant ETL tools
Expert in SQL or SQL extensions for analytical use case
Expert understanding of distributed data stores and data processing frameworks
Ability to simply and clearly communicate technical design both written and verbally
Proficient in designing analytical and operational data models
A keen interest in AI technologies
Preferred
Comfortable with Data Warehouse methods and techniques
Actively shares their thoughts and views on data practices
AWS/Azure/GCP Certified in Data Services
Expertise in continuous improvement and sharing input on data best practice
Participation in development and/or technology communities
Practical experience with AI technologies, tools, processes and delivery
Company
hackajob
The AI-native tech hiring platform trusted by enterprises, scale-ups, and 1M+ tech professionals worldwide.
Founded in 2014
51-200 employees
Funding
Current Stage
Growth StageTotal Funding
$33MKey Investors
Volition CapitalDowning VenturesTechstars
2023-05-03Series B· $25M
2018-10-25Series A· $6.7M
2017-03-31Seed· $0.58M
Leadership Team
Mark Chaffey
CEO
Phil Kell
VP - Marketplace
Recent News
2025-10-23
2025-09-26
2025-09-12
Company data provided by crunchbase