Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

EXL · 5 hours ago

Data Engineer

EXL is seeking a Data Engineer specializing in Databricks to build scalable data pipelines. The role involves developing data ingestion processes, optimizing pipeline performance, and collaborating with architects and data scientists to ensure accurate feature engineering.

AnalyticsBankingOutsourcing
check
H1B Sponsor Likelynote
Hiring Manager
Chandra shekar reddy S
linkedin

Responsibilities

Build scalable PySpark/Spark SQL pipelines in Databricks to prepare curated, feature ready datasets for model development and scoring
Develop and manage data ingestion and harmonization pipelines
Implement transformations, validations, and schema alignment based on model requirements
Optimize pipeline performance, scheduling, and orchestration (Jobs, Workflows, Delta Live Tables)
Collaborate with Solution Architect, data architects, and scientists to ensure accurate feature engineering pipelines
Integrate and harmonize data from Snowflake into Databricks, ensuring schema alignment and data consistency
Prepare curated, feature-ready datasets that meet Client’s feature definitions and modeling requirements
Monitor pipeline health, data freshness, and quality, escalating issues early
Follow best practices for versioning, CI/CD, and operational MLOps workflows
Work closely with Data Scientists to translate feature logic into efficient, reusable pipelines
Implement orchestration and scheduling using Databricks Jobs/Workflows or Delta Live Tables
Monitor, optimize, and troubleshoot pipelines for performance, data quality, and SLAs
Ensure secure access patterns and compliance with customer data governance requirements
Support Dev/QA/Prod deployment of feature pipelines

Qualification

DatabricksPySparkSpark SQLDelta LakeSnowflake

Required

7+ years of hands-on experience in data engineering with cloud data platforms
Strong experience with Databricks, PySpark, Spark SQL, and Delta Lake
Proficiency with Snowflake and cross-platform data integration

Company

EXL

twittertwittertwitter
company-logo
EXL is a provider of Transformation and Outsourcing services to Global 1000 companies in multiple industries

H1B Sponsorship

EXL has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2020 (1)

Funding

Current Stage
Public Company
Total Funding
$150M
Key Investors
The Orogen GroupFTV Capital
2018-10-02Post Ipo Debt· $150M
2006-10-20IPO
2004-12-01Series Unknown

Leadership Team

leader-logo
Rohit Kapoor
Chairman & Chief Executive Officer
linkedin
leader-logo
Brad Burdick
SVP, Insurance Domain Platforms
linkedin
Company data provided by crunchbase