Kaygen, Inc. ยท 3 weeks ago
MS Fabric Data Engineer
KAYGEN is an emerging leader in providing top talent for technology-based staffing services. They are seeking an MS Fabric Data Engineer to design and implement Lakehouse architecture, develop data engineering pipelines, and ensure data security and compliance within the Microsoft Fabric environment.
AnalyticsBig DataData ManagementInformation ServicesInformation TechnologyStaffing Agency
Responsibilities
Design and implement Lakehouse architecture using Microsoft Fabric
Develop and optimize data engineering pipelines for large-scale data ingestion and transformation
Work extensively with Delta tables and Direct Lake mode for high-performance analytics
Ensure data security, governance and compliance within Microsoft Fabric environment
Integrate Microsoft Fabric with Power BI for advanced reporting and visualization
Handle multiple source systems including Amazon S3, SAP and SQL Database using inbuilt connectors and queries
Implement Medallion architecture for structured data organization
Compare and evaluate Fabric vs Databricks and Fabric vs ADF for solution design
Develop custom transformations and scripts using Python, PySpark and SQL for data processing
Manage end-to-end project delivery independently, including architecture, development and deployment
Qualification
Required
Expertise in Microsoft Fabric components including Lakehouse, Dataflows and Pipelines
Strong knowledge of Delta tables, Direct Lake mode and Medallion architecture
Proficiency in Power BI integration and advanced data modeling
Experience with Azure Data Factory and data orchestration
Ability to ingest and process data from multiple sources (Amazon S3, SAP, SQL Database)
Understanding of data security, governance and compliance frameworks
Strong programming skills in Python, PySpark and SQL for data engineering tasks
Preferred
Familiarity with Databricks and advanced big data concepts
Experience in performance tuning and optimization of data pipelines
Ability to write efficient queries and transformations using PySpark and SQL
Strong analytical and problem-solving skills with ability to work independently
Benefits
Free Healthcare Insurance
Vision and Dental Insurance
401(k) Retirement Plan
Free Life Insurance
Sick Time Off
Certifications
Mentorship Program
Referrals
Family and Wellness benefits
Continuous Growth and Career Development
Company
Kaygen, Inc.
Kaygen, an award-winning technology consulting and talent firm, assists organizations to achieve digital transformation.
H1B Sponsorship
Kaygen, Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (4)
2023 (2)
2022 (3)
2021 (8)
2020 (16)
Funding
Current Stage
Growth StageCompany data provided by crunchbase