Quantiphi · 2 weeks ago
Databricks Engineer
United States
Full-time
Remote
Senior LevelQuantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. The Databricks Engineer will design and maintain data pipelines, optimize data models, and collaborate with teams to deliver high-quality solutions in cloud environments.
Artificial Intelligence (AI)Cloud Data ServicesInsurTechMachine LearningSoftware
Responsibilities
Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks
Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows
Implement data models optimized for analytics, performance, and operational excellence
Build and manage data systems across Azure, AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency
Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices
Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions
Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness
Qualification
Required
Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework
Familiarity with Delta Lake, orchestration tools, or Unity Catalog
Experience with CI/CD for data pipelines and automated testing frameworks
Experience in data engineering or a related field
Strong expertise in PySpark, SQL, and data modeling for high-volume datasets
Hands-on experience building and optimizing data pipelines primarily in Azure Databricks, AWS or GCP environments
Track record of working with complex source systems and developing accurate extraction and transformation logic
Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions
Solid understanding of distributed computing, data partitioning, and performance tuning
Company
Quantiphi
Quantiphi is a digital engineering company that provides data science and machine learning software and services.
Founded in 2013
1001-5000 employees
H1B Sponsorship
Quantiphi has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (45)
2024 (65)
2023 (45)
2022 (94)
2021 (71)
2020 (46)
Funding
Current Stage
Late StageTotal Funding
$23.41MKey Investors
Multiples
2019-12-19Series A· $20M
2018-09-13Series Unknown· $3.41M
Leadership Team
Asif Hasan
Co-Founder
Ritesh Patel
Co-Founder
Recent News
2025-12-05
Company data provided by crunchbase