Tech Lead - Data Infrastructure / Platform jobs in United States
cer-icon
Apply on Employer Site
company-logo

Harnham ยท 1 day ago

Tech Lead - Data Infrastructure / Platform

positionAustin, Texas Metropolitan Area
timeFull-time
remoteOnsite
seniorityLead/Staff
money$175K/yr - $200K/yr

Harnham is seeking a Technical Lead to own and evolve a large-scale data processing and compute platform used by Simulation and ML teams. This role involves defining the technical vision, making architectural decisions, and mentoring an infrastructure team while ensuring the platform meets real-world performance and usability needs.

AnalyticsConsultingInformation TechnologyMarketing
check
H1B Sponsor Likelynote

Responsibilities

Own the compute platform: Lead the design and operation of the data processing infrastructure supporting simulation and ML workloads across autonomous systems
Scale for massive data: Architect solutions for petabyte-scale datasets and high-throughput, low-latency processing of sensor data (camera, lidar, radar)
Build and evolve systems: Prototype, develop, and refine distributed compute solutions, validating them in real production workflows
Lead technically and organizationally: Set direction, guide architecture, and help grow an infrastructure team while remaining hands-on
Partner across teams: Work closely with simulation, perception, prediction, and planning teams to understand requirements and align platform capabilities
Evaluate and integrate tools: Assess and integrate open-source and internal technologies (e.g., Spark, Ray, Beam, Airflow, Argo, Kubernetes)
Enable adoption: Produce clear documentation, examples, and best practices to drive platform usage and developer productivity

Qualification

PythonDistributed systemsLarge-scale data processingData platformsC++Apache SparkKubernetesSystem designMentoring engineersTechnical leadership

Required

Strong proficiency in Python; solid C++ experience is highly desirable
Hands-on experience with distributed systems and large-scale data processing
Familiarity with frameworks and orchestration tools such as Apache Spark, Ray, Apache Beam, Airflow, Argo Workflows, and Kubernetes
Experience designing and operating data platforms that support ML pipelines and large compute workloads
Proven technical leadership in architecture, system design, and mentoring engineers
Ability to operate at both the system-wide 'big picture' level and deep in implementation details

Preferred

Background in ML/AI systems or experience building ML pipelines at scale
Experience working with autonomous vehicle or robotics sensor data
Experience optimizing cost, performance, and reliability in large distributed computing environments

Company

Harnham

twittertwittertwitter
Glassdoor3.6
company-logo
Harnham has actively chosen to focus on Data and Analytics.
dateFounded in 2006
location
New York, New York, USA
people-size201-500 employees
web-link
https://www.harnham.com/us

H1B Sponsorship

Harnham has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (1)

Funding

Current Stage
Growth Stage
Total Funding
unknown
Key Investors
BGF Ventures
2022-05-01Seed

Leadership Team

leader-logo
David Farmer
Chief Executive Officer
linkedin
S
Stephen Lawrence
CFO
linkedin

Recent News

Harnham
Harnham secures investment from BGF | Harnham US Recruitment post
2025-02-05
BeBeez
Notizie da: Nordic Capital, Bridgepoint Development Capital, PAI Partners, BlackRock, IP Group, MMC, Octopus, Pelican Capital, BGF e altri
2022-05-09
Company data provided by crunchbase