TechClub Inc · 3 hours ago
Lead Data Engineer
Texas, United States
Contract
Onsite
Senior Level, Lead/Staff
12+ years expTechClub Inc is seeking a Lead Data Engineer to act as a Product Technical Lead and subject matter expert for the data domain. The role involves collaborating with various teams to implement data strategies, design data engineering pipelines, and drive data quality and process improvements.
AnalyticsArtificial Intelligence (AI)Cloud ComputingCyber SecurityInformation TechnologySoftware
Hiring Manager
Sai Geetha M
Responsibilities
Act as Product Technical Lead
Act as subject matter expert for data domain within the IT organization and work with business to author self-service data products
Collaborate with leaders, business analysts, project managers, IT architects, technical leads, and other developers, along with internal customers and cross functional teams to implement data strategy
Design and build data engineering pipeline frameworks while ensuring these are reusable, scalable, efficient, maintainable, gracefully recover from failures, reprocessing the data should be easy
Drive data quality, best practices, coding standards, Test Driven Development, identifying single source of truth for data across systems and Quality Analytics (Mean Time to Recover, Mean Time between Failures, Patterns causing failures)
Utilize data pipelines to provide actionable insights into data quality and product performance
Identify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability
Contribute to the continuous improvement of data engineering across the enterprise by researching industry best practices and determining best usage of specific cloud services and tools
Work with data squads to ensure data products are designed with privacy and compliance baked in (Privacy by design)
Work with product teams to help prioritize team objectives and initiatives/team features
Conduct road shows on the data products across the organization
Qualification
Required
12+ Yrs Must
Apache Spark (10+ yrs of exp)
Scala (10+ yrs of exp)
Azure Databricks (10+ yrs of exp)
Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training
Preferred
SQL (5+ yrs of exp)
CICD (5+ yrs of exp)
Company
TechClub Inc
TechClub renders avant-garde IT solutions to corporations.
201-500 employees
H1B Sponsorship
TechClub Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (25)
2024 (13)
2023 (18)
2022 (7)
2021 (4)
2020 (1)
Funding
Current Stage
Growth StageCompany data provided by crunchbase