Capco · 14 hours ago
Senior Fabric Engineer
US - Washington DC
Full-time
Onsite
Senior Level
$152K/yr - $174K/yr
5+ years expCapco is a leading consultancy focused on financial services, helping clients navigate complex changes and drive digital transformation. The Senior Fabric Engineer will lead the design and implementation of data science and analytics capabilities, focusing on data processing, identity resolution, and data warehouse development on Microsoft Azure Fabric and Databricks.
ConsultingFinanceFinancial ServicesInsurance
Responsibilities
Design and develop data lakehouse and warehouse structures within Azure Databricks and Fabric environments
Build ETL and ELT pipelines to extract, cleanse, normalize, and enrich data from CRM, ERP, LMS, and financial systems
Develop reusable data transformation and validation frameworks leveraging PySpark, SQL, and Delta Live Tables
Support the operationalization of the central data warehouse using Azure SQL and Fabric Data Warehouse
Implement entity resolution models to unify customer, member, or participant records across systems using deterministic and probabilistic matching techniques
Design and deploy matching algorithms utilizing Databricks MLflow, PySpark, and Azure Machine Learning for cross-system deduplication and linkage
Collaborate with architects to define unique identifiers, external keys, and golden record frameworks for enterprise data integration
Monitor and continuously refine data matching accuracy, precision, and recall metrics
Develop and schedule data ingestion pipelines in Azure Fabric and Databricks for recurring Excel, CSV, and structured PDF sources using Power Automate, Form Recognizer, and Fabric Dataflows
Apply data quality and validation rules to flag incomplete, inconsistent, or stale records
Build and automate data lineage, change tracking (CDC), and error-handling workflows
Support performance tuning and scalability for high-volume processing environments
Provide curated and feature-engineered datasets for Power BI dashboards and machine learning use cases
Partner with data analysts to define KPIs and enable cross-system reporting and predictive insights
Develop scripts and notebooks to support exploratory data analysis (EDA) and visualization in Databricks
Qualification
Required
BA in Data Science, Computer Science, Applied Mathematics, or related discipline
5+ years of experience in data engineering and applied data science on Azure platforms
3+ years building and managing pipelines in Azure Databricks (PySpark, Delta Lake, MLflow)
2+ years hands-on experience with Microsoft Fabric (Data Factory, Dataflow Gen2, Data Warehouse)
Power BI integration and data modeling
Entity resolution and master data management (MDM) methods
Statistical modeling, clustering, and record linkage algorithms
Data governance, lineage tracking, and compliance (PII, HIPAA, etc)
Proven track record implementing identity resolution and entity linking frameworks
Strong background in SQL, Python, and large-scale data processing for analytics
Preferred
Microsoft Certified: Fabric Analytics Engineer Associate
Microsoft Certified: Azure Data Scientist Associate
Databricks Certified Machine Learning Professional
Azure Data Engineer Associate
Benefits
Medical, dental and vision insurance
401(k) plan
Tuition reimbursement
Company
Capco
Capco is a technology and management consulting firm that provides consulting for the financial services and energy industries.
5001-10000 employees
H1B Sponsorship
Capco has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (5)
2023 (8)
2022 (15)
2021 (2)
2020 (14)
Funding
Current Stage
Late StageTotal Funding
$80MKey Investors
Thomas Weisel Partners
2021-03-04Acquired
2000-05-24Private Equity· $80M
Leadership Team
Anne-Marie Rowland
Chief Executive Officer
Andrew McGinn
Partner - Digital, Data & Technology
Recent News
Company data provided by crunchbase