Lead Engineer, Data Processing (Databricks) jobs in United States
cer-icon
Apply on Employer Site
company-logo

CargoSprint ยท 6 days ago

Lead Engineer, Data Processing (Databricks)

positionUnited States
timeFull-time
remoteRemote
seniorityLead/Staff
date8+ years exp

CargoSprint is a company focused on transforming the cargo industry through innovative digital solutions. The Lead Engineer for Data Processing will oversee the Data Processing team, managing pipelines and processing jobs while ensuring modernization and reliability of data systems.

Freight ServiceSoftware
check
H1B Sponsor Likelynote

Responsibilities

Lead the Data Processing team: technical direction, delivery cadence, coaching, and hiring support (as needed)
Own core processing systems end-to-end: design, implementation, quality, observability, and on-call readiness
Drive modernization of legacy processing: simplify flows, reduce failure modes, improve performance and cost
Build and operate pipelines (batch and/or streaming) with strong data quality, lineage, and backfill strategies
Establish SLAs/SLOs for key pipelines and improve monitoring, alerting, and incident response
Partner with application engineering, finance, and analytics to prioritize work and deliver dependable outputs
Raise the engineering bar via standards, PR reviews, runbooks, and pragmatic architecture decisions

Qualification

DatabricksSparkData processing systemsSQLOperational disciplineCross-team alignmentFinTech experienceLogistics experienceSpanish proficiency

Required

8+ years building production systems; 2+ years leading engineers or acting as a team tech lead
Strong experience with data processing systems (ETL/ELT, streaming, batch processing, orchestration)
Hands-on experience with Databricks and Spark (PySpark/Scala) and strong SQL
Experience modernizing legacy systems safely and incrementally
Operational discipline: monitoring, alerting, incident response, and root cause analysis for pipelines
Ability to drive cross-team alignment and translate requirements into reliable delivery

Preferred

Lakehouse patterns (Delta Lake, Iceberg, or Hudi) and data catalog/governance tools
.Net or Java expertise Event-driven architectures (Kafka/Kinesis/PubSub) and streaming pipelines
FinTech, payments, billing, invoicing, or other high-volume transactional domains
Experience enabling self-serve analytics for business users
Logistics, cargo, or supply chain experience
Spanish language proficiency

Benefits

Health and Wellness: Medical, dental, and vision plans for you and your family
Future-Ready: 401(k) with company match
Work Life Balance: Generous flexible PTO program and paid holidays
Grow With Us: Professional development opportunities

Company

CargoSprint

twittertwittertwitter
company-logo
CargoSprint focused in enhancing human experience in the cargo industry, through digital solutions.
dateFounded in 2012
location
Peachtree City, Georgia, USA
people-size201-500 employees
web-link
https://cargosprint.com/

H1B Sponsorship

CargoSprint has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (1)
2023 (1)

Funding

Current Stage
Growth Stage
Total Funding
unknown
2024-11-12Acquired

Leadership Team

leader-logo
Caro Krissman
Chief Executive Officer
linkedin

Recent News

Mexico Business
Partnerships, Intermodal Growth, Cross-Border Connectivity
2024-12-24
citybiz
CargoSprint Acquires Advent eModal
2024-12-17
PE Hub
Lone View-backed CargoSprint scoops up port community platform Advent eModal
2024-12-17
Company data provided by crunchbase