Quantiphi · 16 hours ago
Senior Data Engineer
Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making.
Artificial Intelligence (AI)Cloud ComputingSoftwareProperty & Casualty InsuranceCloud Data ServicesInsurTechMachine Learning
Responsibilities
Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks
Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows
Implement data models optimized for analytics, performance, and operational excellence
Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency
Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices
Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions
Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness
Qualification
Required
8+ years of experience in data engineering or a related field
Strong expertise in PySpark, SQL, and data modeling for high-volume datasets
Hands-on experience building and optimizing data pipelines in AWS or GCP environments
Track record of working with complex source systems and developing accurate extraction and transformation logic
Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions
Solid understanding of distributed computing, data partitioning, and performance tuning
Preferred
Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework
Familiarity with Delta Lake, orchestration tools, or Unity Catalog
Experience with CI/CD for data pipelines and automated testing frameworks
Company
Quantiphi
Quantiphi is a digital engineering company that provides data science and machine learning software and services.
H1B Sponsorship
Quantiphi has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (45)
2024 (65)
2023 (45)
2022 (94)
2021 (71)
2020 (46)
Funding
Current Stage
Late StageTotal Funding
$23.41MKey Investors
Multiples
2019-12-19Series A· $20M
2018-09-13Series Unknown· $3.41M
Recent News
Company data provided by crunchbase