West Monroe · 12 hours ago
Senior Data Engineer
Chicago
Full-time
Onsite
Senior Level
5+ years expWest Monroe is a global business and technology consulting firm passionate about creating measurable value for clients. They are seeking a Senior Data Engineer to lead the design, build, and delivery of data pipelines and solutions that support Intellio Labs products and internal analytics assets.
Business DevelopmentConsultingInformation ServicesInformation TechnologyService Industry
Responsibilities
Design and implement scalable, secure, and reliable data pipelines, models, and integrations using Databricks, Spark, and cloud-native technologies
Lead day-to-day execution of assigned data engineering workstreams, including effort estimation, task breakdown, and delivery commitments
Build and maintain metadata-driven ELT/ETL pipelines that support reuse, extensibility, and operational efficiency
Integrate data from multiple internal and external source systems into unified, analytics-ready outputs
Develop data assets that support analytics and AI/ML workflows, including feature-ready datasets and experimentation environments
Ensure data quality, reliability, security, and performance across owned pipelines and datasets
Define and implement automated data quality checks, validation rules, and monitoring
Troubleshoot pipeline failures, interpret system errors, and resolve data defects in collaboration with source system owners
Optimize pipeline performance and ensure successful execution of scheduled jobs
Participate in production support, incident resolution, and post-incident root cause analysis for owned pipelines
Collaborate with Product, Engineering, Analytics, and Data Science partners to deliver data-driven capabilities
Gather and document technical requirements and contribute to solution design across the Data Engineering & Analytics (DE&A) team
Coordinate with application and data source owners to understand source data structures, constraints, and integration requirements
Create curated data outputs that support reporting, dashboarding, and semantic models for tools such as Tableau and Power BI
Review data engineering work to ensure adherence to standards, best practices, and governance guidelines
Mentor and support junior engineers through code reviews, technical guidance, and knowledge sharing
Contribute to continuous improvement of engineering practices, patterns, and tooling within Intellio Labs
Qualification
Required
5+ years of professional experience in data engineering; consulting experience preferred
3+ years of hands-on experience with Databricks and Spark
Advanced SQL skills, including complex transformations and performance optimization
Experience designing and implementing metadata-driven ETL/ELT patterns
Experience with distributed data processing and streaming technologies (e.g., Spark, Kafka, Kinesis, Hadoop, Lambda)
Experience with ETL orchestration tools such as Azure Data Factory, AWS Glue, Informatica, Talend, or IBM DataStage
Proven experience in technical testing, issue identification, and production support
Strong verbal and written communication skills
Preferred
Experience with AWS-based data platforms (preferred but not required)
Exposure to analytics, BI, and AI/ML-enabled data solutions. (preferred but not required)
Company
West Monroe
West Monroe offers digital transformation, analytics, cloud, cyber security, business advisory, and management consulting services.
1001-5000 employees
H1B Sponsorship
West Monroe has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (4)
2024 (2)
2023 (2)
2022 (10)
2021 (7)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
MSD Partners
2021-10-15Series Unknown
2020-01-07Acquired
Leadership Team
Gil Mermelstein
Chief Executive Officer
Kevin McCarty
Co-Founder & Executive Chairman of West Monroe
Recent News
Company data provided by crunchbase