EXL · 5 hours ago
Data Engineer
EXL is seeking a Data Engineer specializing in Databricks to build scalable data pipelines. The role involves developing data ingestion processes, optimizing pipeline performance, and collaborating with architects and data scientists to ensure accurate feature engineering.
Responsibilities
Build scalable PySpark/Spark SQL pipelines in Databricks to prepare curated, feature ready datasets for model development and scoring
Develop and manage data ingestion and harmonization pipelines
Implement transformations, validations, and schema alignment based on model requirements
Optimize pipeline performance, scheduling, and orchestration (Jobs, Workflows, Delta Live Tables)
Collaborate with Solution Architect, data architects, and scientists to ensure accurate feature engineering pipelines
Integrate and harmonize data from Snowflake into Databricks, ensuring schema alignment and data consistency
Prepare curated, feature-ready datasets that meet Client’s feature definitions and modeling requirements
Monitor pipeline health, data freshness, and quality, escalating issues early
Follow best practices for versioning, CI/CD, and operational MLOps workflows
Work closely with Data Scientists to translate feature logic into efficient, reusable pipelines
Implement orchestration and scheduling using Databricks Jobs/Workflows or Delta Live Tables
Monitor, optimize, and troubleshoot pipelines for performance, data quality, and SLAs
Ensure secure access patterns and compliance with customer data governance requirements
Support Dev/QA/Prod deployment of feature pipelines
Qualification
Required
7+ years of hands-on experience in data engineering with cloud data platforms
Strong experience with Databricks, PySpark, Spark SQL, and Delta Lake
Proficiency with Snowflake and cross-platform data integration
Company
EXL
EXL is a provider of Transformation and Outsourcing services to Global 1000 companies in multiple industries
H1B Sponsorship
EXL has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2020 (1)
Funding
Current Stage
Public CompanyTotal Funding
$150MKey Investors
The Orogen GroupFTV Capital
2018-10-02Post Ipo Debt· $150M
2006-10-20IPO
2004-12-01Series Unknown
Leadership Team
Recent News
GlobeNewswire
2026-01-13
MarketScreener
2025-12-24
SalesTech Star
2025-12-24
Company data provided by crunchbase