Confidential · 5 hours ago
Data Engineer
Scottsdale, AZ
Contract
Onsite
Senior Level
$60/hr - $70/hrConfidential is seeking a senior Data Engineer to lead a critical data platform migration from Talend to Databricks. This role involves ensuring data integrity and reporting accuracy during a legacy system sunset scheduled for mid-2026, while also collaborating with stakeholders and documenting processes.
Staffing & Recruiting
Hiring Manager
Brandon Merrill
Responsibilities
Take ownership of the ongoing migration of legacy Talend ETL workflows into Databricks-based pipelines
Analyze existing data workflows and translate them into scalable, reliable Databricks solutions
Ensure data accuracy, consistency, and parity throughout the migration process
Troubleshoot and resolve pipeline issues to maintain operational stability
Collaborate with data, application, and business stakeholders to align migration outcomes with reporting and analytics needs
Document pipelines, processes, and operational runbooks to reduce single points of failure
Serve as a technical leader by influence—providing guidance, making informed tradeoffs, and keeping the project moving forward
Qualification
Required
Proven experience supporting or leading data platform or ETL migrations in enterprise environments
Strong hands-on experience with Databricks (PySpark, Spark SQL, Delta Lake, orchestration/workflows)
Experience translating or modernizing legacy ETL workflows (Talend or similar tools strongly preferred)
Solid background in data movement and transformation involving relational databases (SQL/Oracle or similar)
Demonstrated ability to troubleshoot failures, identify root causes, and implement durable solutions
Strong documentation and communication skills
Preferred
Prior experience migrating from Talend to Databricks
Familiarity with Azure data services (ADLS, ADF, DevOps pipelines)
Experience working in healthcare, analytics, or regulated environments
Local to Arizona (strongly preferred)
Company
Confidential
Centralizing All Types Of Next Opportunities For You In One Place.
Vancouver, US
2-10 employeesFunding
Current Stage
Early StageCompany data provided by crunchbase