This job has closed.

Contech Systems Inc. · 1 month ago

Data Engineer - DataBricks

Newark, NJ

Full-time

Hybrid

Senior Level

$85/hr - $100/hr

Contech Systems Inc. is hiring a Senior Databricks Data Engineer to help build Horizon’s next-generation healthcare data platform. The role involves designing large-scale pipelines, implementing medallion architecture, optimizing Spark performance, and shaping modeling patterns for analytics and clinical data.

Software

Comp. & Benefits

H1B Sponsor Likely

Responsibilities

Architect, design, and develop large-scale ETL/ELT pipelines in Databricks, Spark, and Delta Lake

Implement medallion architecture and best practices for scalable data modeling

Build workflows, notebooks, jobs, and orchestration patterns within Databricks

Optimize Spark performance (clusters, caching, partitions, Z-ordering, autoscaling, shuffles)

Apply data quality frameworks (expectations, validations, profiling)

Work with cross-functional partners to translate requirements into actionable data solutions

Contribute to governance: lineage, cataloging, RBAC, compliance, metadata management

Troubleshoot and resolve issues across ETL pipelines, notebooks, and compute clusters

Mentor junior engineers as the team expands

Qualification

DatabricksSparkETL/ELT pipelinesSQLPythonCloud platformsData modelingPySparkHealthcare datasetsOrchestration toolsCI/CDFHIR

Required

Expert-level experience with Databricks, Spark, PySpark, and Delta Lake

Strong SQL and Python

Proven experience designing complex pipelines and distributed jobs

Experience with cloud platforms (Azure or AWS)

Solid understanding of data modeling (conceptual, logical, physical)

Ability to work end-to-end: design → build → optimize → document

Preferred

Experience with healthcare datasets (claims, eligibility, provider, clinical) is a major plus

Knowledge of FHIR or other healthcare interoperability standards

Experience with orchestration tools (Airflow, ADF, Databricks Jobs)

CI/CD for data engineering

Company

Contech Systems Inc.

Since 1998, Contech Systems delivered staffing solutions for Fortune 500 companies.

Founded in 1996

Staten Island, New York, USA

201-500 employees

http://www.contech-it.com

H1B Sponsorship

Contech Systems Inc. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2024 (1)

2022 (1)

2021 (1)

2020 (6)

Funding

Current Stage

Growth Stage

Leadership Team

Joseph Contino

Founder, Chief Customer Officer

Company data provided by crunchbase