Apply on Employer Site

Kaygen, Inc. · 1 month ago

Fabrics Data Engineer

Los Angeles, CA

Full-time

Onsite

Mid Level

$75/hr - $80/hr

KAYGEN is an emerging leader in providing top talent for technology-based staffing services, and they are seeking a Fabrics Data Engineer. The role involves building, maintaining, and optimizing data ingestion pipelines and operational workflows within Microsoft Fabric.

AnalyticsBig DataData ManagementInformation ServicesInformation TechnologyStaffing Agency

Growth Opportunities

H1B Sponsor Likely

Responsibilities

Architect and maintain medallion data frameworks

Build ingestion pipelines using Data Factory, Spark Notebooks, Dataflows Gen2, Event Streams, and Lakehouse connectors

Develop Silver/Gold transformations including cleansing, enrichment, merging, and standardization

Implement data quality checks, validation rules, auditing columns, and error-handling patterns

Optimize Lakehouse and Delta Lake operations (schema evolution, partitioning, Z Order, caching, vacuum, compaction)

Support production operations including monitoring, incident triage, defect resolution, and performance tuning

Create/Maintain mapping sheets, schema documentation, lineage diagrams, and runbooks

Coordinate with analytics teams to prepare model-ready Gold datasets

Participate in Agile ceremonies, design reviews, and technical planning

Support UAT, test data preparation, and validation activities

Qualification

Microsoft FabricData FactorySpark NotebooksLakehouse tablesDataflows Gen2Event StreamsDelta Lake operationsAgile methodologiesData quality checksPerformance tuning

Required

Builds, maintains, and optimizes data ingestion pipelines, Lakehouse tables, transformation logic, data quality checks, and operational workflows within Microsoft Fabric