HTC Global Services · 7 hours ago
Data Engineer Lead
Auburn Hills, MI
Full-time
Onsite
Senior Level, Lead/Staff
7+ years expHTC Global Services is seeking a Senior Data Engineer & Technical Lead to deliver major data engineering initiatives within the Data & Advanced Analytics space. This role involves building, deploying, and maintaining robust data pipelines, as well as designing CI/CD processes for data engineering projects.
Information TechnologyInsuranceSoftware
Responsibilities
Design, develop, and optimize scalable data pipelines using Python and PySpark for batch and streaming workloads
Build, schedule, and monitor complex workflows using Airflow, ensuring reliability and maintainability
Architect and implement CI/CD pipelines for data engineering projects using GitHub, Docker, and cloud-native solutions
Apply test-driven development (TDD) practices and automate unit/integration tests for data pipelines
Implement secure coding best practices and design patterns throughout the development lifecycle
Work closely with Data Architects, QA teams, and business stakeholders to translate requirements into technical solutions
Create and maintain technical documentation, including process/data flow diagrams and system design artifacts
Lead and mentor junior engineers, providing guidance on coding, testing, and deployment best practices
Analyze and resolve technical issues across the data stack, including pipeline failures and performance bottlenecks
Cross-train team members outside the project team (e.g., operations support) for full knowledge coverage
Qualification
Required
Minimum of 7+ years overall IT experience
Minimum 5+ years of practical experience building production-grade data pipelines using Python and PySpark
Proven track record of designing, deploying, and managing Airflow DAGs in enterprise environments
Ability to build and maintain CI/CD pipelines for data engineering workflows, including automated testing and deployment
Experience with containerization (Docker) and cloud platforms (GCP) for data engineering workloads
Ability to write object-oriented Python code, manage dependencies, and follow industry best practices
Proficiency with Git for source code management and collaboration (commits, branching, merging, GitHub/GitLab workflows)
Strong command-line skills in Unix-like environments
Solid understanding of SQL for data ingestion and analysis
Comfortable with code reviews, pair programming and using remote collaboration tools effectively
Writes code with an eye for maintainability and testability; excited to build production-grade software
Bachelor's or graduate degree in Computer Science, Data Analytics or related field, or equivalent work experience
Benefits
Group Health (Medical, Dental, and Vision)
Paid Time Off
Paid Holidays
401(k) matching
Group Life and Disability insurance
Professional Development opportunities
Wellness programs
A variety of other perks
Company
HTC Global Services
HTC Global Services Inc., is a global provider of Information Technology and Business Process Services and Solutions.
10001+ employees
H1B Sponsorship
HTC Global Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (361)
2024 (367)
2023 (440)
2022 (314)
2021 (227)
2020 (438)
Funding
Current Stage
Late StageTotal Funding
$1.2MKey Investors
Michigan Economic Development Corporation
2024-12-10Grant· $1.2M
Leadership Team
Gunasekaran Nadar
CHIEF FINANCIAL OFFICER
Girish Arora
Vice President, Financial Services and Insurance
Recent News
Company data provided by crunchbase