Apply on Employer Site

Allstate · 1 day ago

Property Claims Big Data Engineer - Senior Consultant II

United States

Full-time

Remote

Mid, Senior Level

$86K/yr - $153K/yr

3+ years exp

Allstate is a company dedicated to protecting families and their belongings from life's uncertainties. The Property Claims Big Data Engineer Senior Consultant II will be responsible for engineering scalable and secure data solutions that enhance real-time decision-making and advanced analytics across the Property line of business.

BankingFinanceFinancial ServicesInsuranceInsurTechVenture Capital

No H1B

Responsibilities

Design, deploy, and maintain Azure cloud resources including ADLS Gen2 containers, Event Hub namespaces/instances, Function Apps, networking components, and Azure SQL Managed Instances

Build and maintain infrastructure-as-code deployments using Terraform and Env0 with GitHub-based CI/CD

Develop and support Fabric-native integrations, including Lakehouse ingestion, shortcuts, pipelines, and real-time event streaming

Engineer secure cloud-to-cloud vendor integrations (e.g., Verisk, Cotality, ClaimXperience, XactAnalysis) using OAuth, event streaming, and managed file transfer pipelines

Support and enhance a high-performance on-prem Linux server used for ETL, automation, and real-time data extraction/processing

Develop and maintain Python ETL pipelines orchestrated through Airflow that interact with Oracle, SQL Server, Snowflake, AWS S3, ADLS, OneLake, and SFTP/PGP sources

Build reusable Python libraries and automation patterns for:

API integrations

File ingestion and transformation

Scheduled data flows and cross-system orchestration

Ensure reliability, monitoring, and performance tuning of on-prem data services

Engineer robust Big Data solutions to support descriptive analytics, automated reporting, predictive modeling, and real-time decision analytics for Property Claims

Identify and integrate new data sources, patterns, and technologies that can improve operational insights and analytic capabilities

Partner with internal peers, Allstate Technology, and vendor engineering teams to deliver end-to-end solutions across systems

Drive execution of complex technical workstreams and contribute specialized engineering expertise to mission-critical projects