JRD Systems · 7 hours ago
Lead Data Engineer
United States
Contract
Remote
Senior Level, Lead/Staff
8+ years expJRD Systems is seeking a Lead Data Engineer to design, build, and scale modern data platforms. In this role, you will take ownership of complex data pipelines, guide architectural decisions, and mentor a team of data engineers while collaborating with analytics, product, and business stakeholders.
Information TechnologySoftware
Hiring Manager
Jinsha M.
Responsibilities
Lead the design and development of scalable, high-performance data pipelines using Databricks
Build and optimize ETL/ELT workflows using PySpark and SQL
Architect data solutions for batch and (if applicable) streaming workloads
Ensure data quality, reliability, performance, and governance best practices
Collaborate with data scientists, analysts, and business teams to enable analytics and ML use cases
Optimize Databricks jobs for cost, performance, and scalability
Review code, enforce engineering standards, and mentor junior engineers
Participate in technical design discussions and contribute to long-term data strategy
Qualification
Required
8+ years of experience in Data Engineering roles, with recent experience in a Lead or Senior capacity
Strong hands-on experience with Databricks (workspaces, notebooks, jobs, Delta Lake)
Advanced proficiency in PySpark for large-scale data processing
Strong SQL skills for data transformation, performance tuning, and analytics
Experience working with large datasets in cloud or distributed environments
Solid understanding of data modeling, partitioning, and performance optimization
Experience leading technical initiatives or mentoring engineers
Preferred
Experience with cloud platforms (AWS, Azure, or GCP)
Familiarity with Delta Lake, data lakes, or lakehouse architectures
Exposure to streaming technologies (Kafka, Structured Streaming)
Experience supporting analytics, BI, or ML workloads
Knowledge of CI/CD, data observability, or orchestration tools (Airflow, ADF, etc.)
Company
JRD Systems
JRD Systems is an information technology company that provides custom application development and staffing services.
201-500 employees
H1B Sponsorship
JRD Systems has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (4)
2023 (2)
2022 (3)
2021 (8)
2020 (18)
Funding
Current Stage
Growth StageCompany data provided by crunchbase