Acrisure · 13 hours ago
Lead Data Engineer
Auris, acquired by Acrisure, is a payroll and HR partner for small and medium-sized businesses, providing technology and human services. The Lead Data Engineer will design and implement scalable data pipelines, optimize data models, and mentor a team of data engineers to ensure high-quality data solutions.
FinanceProperty & Casualty InsuranceFinancial ServicesInsuranceInsurTech
Responsibilities
Lead the design and implementation of scalable data pipelines across Azure Data Factory, batch, streaming, messaging platforms (Kafka, Event Hub, or similar)
Architect and optimize data models and storage patterns in Azure SQL, including performance tuning, partitioning, indexing, and workload optimization
Support and modernize legacy Oracle environments, including schema design, PL/SQL logic, and data extraction strategies
Drive the migration of data assets from Oracle to Azure SQL using tools such as SSMA, ADF, and custom ETL/ELT frameworks
Apply strong software engineering principles (CI/CD, version control, testing, code reviews, modular design) to all data engineering work
Build reusable frameworks, libraries, and automation to accelerate data ingestion, transformation, and quality checks
Ensure engineering best practices across the team, including coding standards, documentation, and observability
Design and implement streaming data pipelines using Spark Structured Streaming, Kafka, Event Hub, or similar technologies
Build and maintain high‑throughput, low‑latency data ingestion and processing systems
Integrate streaming and batch pipelines into unified, reliable data products
Implement data quality frameworks, monitoring, and observability across pipelines
Partner with data governance teams to ensure lineage, metadata, and compliance requirements are met
Enforce secure data access patterns and RBAC across Azure environments
Mentor and guide data engineers, promoting a culture of technical excellence and continuous learning
Collaborate with DBAs, analysts, architects, and business stakeholders to deliver high‑impact data solutions
Influence platform strategy, tooling decisions, and long‑term data architecture
Qualification
Required
10+ years of experience in data engineering with a strong foundation in software engineering
Deep expertise in Azure SQL (performance tuning, T‑SQL, security, optimization)
Strong experience with Oracle (PL/SQL, schema design, performance tuning, data extraction)
Hands‑on experience with Spark (Databricks, PySpark, or Scala Spark) is preferred
Experience building streaming pipelines using Kafka, Event Hub, or similar platforms
Strong proficiency in Python, SQL, and at least one general‑purpose programming language (Java, Scala, C#, etc.)
Experience with CI/CD, Git, DevOps practices, and infrastructure‑as‑code (Terraform, ARM, Bicep)
Strong understanding of distributed systems, data modeling, and data architecture patterns
Preferred
Hands‑on experience with Spark (Databricks, PySpark, or Scala Spark) is preferred
Benefits
Comprehensive medical insurance, dental insurance, and vision insurance
Life and disability insurance
Fertility benefits
Wellness resources
Paid sick time
Generous paid time off and holidays
Employee Assistance Program (EAP)
Complimentary Calm app subscription
Immediate vesting in a 401(k) plan
Health Savings Account (HSA) and Flexible Spending Account (FSA) options
Commuter benefits
Employee discount programs
Paid maternity leave and paid paternity leave (including for adoptive parents)
Legal plan options
Pet insurance coverage
Company
Acrisure
Acrisure offers financial services solutions for insurance, reinsurance, real estate, cyber services, and asset and wealth management.
H1B Sponsorship
Acrisure has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2022 (2)
Funding
Current Stage
Late StageTotal Funding
$11.37BKey Investors
Bain Capital Special SituationsAbu Dhabi Investment AuthorityBDT & MSD Partners
2025-06-06Debt Financing· $550M
2025-05-20Private Equity· $2.1B
2024-06-05Debt Financing· $1.6B
Recent News
Beinsure - Insurance, Reinsurance, InsurTech Insights
2026-01-14
2025-12-08
Company data provided by crunchbase