Apply on Employer Site

Allstate · 3 weeks ago

Property Claims Big Data Engineer - Senior Consultant II

United States

Full-time

Remote

Mid, Senior Level

$86K/yr - $153K/yr

3+ years exp

Allstate is a leading insurance company dedicated to protecting families and their belongings. The Property Claims Big Data Engineer Senior Consultant II will play a key role in advancing the company's cloud-first data modernization journey, focusing on engineering scalable and secure data solutions for real-time decision-making and advanced analytics in the Property line of business.

BankingFinanceFinancial ServicesInsuranceInsurTechVenture Capital

No H1B

Responsibilities

Designing, deploying, and maintaining Azure cloud resources using Infrastructure-as-Code (Terraform/Env0)

Engineering modern data ingestion, ETL/ELT pipelines, and event-streaming solutions across ADLS Gen2, Event Hub, Azure SQL MI, Snowflake Reader accounts, and OneLake/Fabric

Supporting and enhancing high-performance on-prem Linux ETL pipelines that integrate with Oracle, SQL Server, Snowflake, AWS S3, ADLS, OneLake, and vendor APIs

Developing code and automations that enable descriptive, predictive, and prescriptive analytics, as well as real-time Property Claims operational insights

Design, deploy, and maintain Azure cloud resources including ADLS Gen2 containers, Event Hub namespaces/instances, Function Apps, networking components, and Azure SQL Managed Instances

Build and maintain infrastructure-as-code deployments using Terraform and Env0 with GitHub-based CI/CD

Develop and support Fabric-native integrations, including Lakehouse ingestion, shortcuts, pipelines, and real-time event streaming

Engineer secure cloud-to-cloud vendor integrations (e.g., Verisk, Cotality, ClaimXperience, XactAnalysis) using OAuth, event streaming, and managed file transfer pipelines

Support and enhance a high-performance on-prem Linux server used for ETL, automation, and real-time data extraction/processing

Develop and maintain Python ETL pipelines orchestrated through Airflow that interact with Oracle, SQL Server, Snowflake, AWS S3, ADLS, OneLake, and SFTP/PGP sources

Build reusable Python libraries and automation patterns for:

API integrations

File ingestion and transformation

Scheduled data flows and cross-system orchestration

Ensure reliability, monitoring, and performance tuning of on-prem data services

Engineer robust Big Data solutions to support descriptive analytics, automated reporting, predictive modeling, and real-time decision analytics for Property Claims

Identify and integrate new data sources, patterns, and technologies that can improve operational insights and analytic capabilities

Partner with internal peers, Allstate Technology, and vendor engineering teams to deliver end-to-end solutions across systems

Drive execution of complex technical workstreams and contribute specialized engineering expertise to mission-critical projects