Data Engineer 2 - Partner Engineering Platform (PEP) Reporting jobs in United States
info-icon
This job has closed.
company-logo

Microsoft · 7 hours ago

Data Engineer 2 - Partner Engineering Platform (PEP) Reporting

Microsoft is a leading technology company, and they are seeking a Data Engineer 2 to join their Partner Engineering Platform (PEP) Reporting team. In this role, you will design, build, and optimize cloud scale data systems that process high-volume Windows OEM telemetry, enabling engineering teams to make fast, accurate, data-driven decisions.

Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Build and maintain scalable data pipelines using Azure Data Lake, Lakehouse patterns, Azure Datastores, and Parquet-based datasets
Develop Kusto (ADX) queries, tables, and ingestion processes; optimize KQL for performance and cost efficiency
Design and tune Cosmos DB collections, partitioning, indexing, and RU consumption
Implement streaming and batch workflows using COSMOS Streams and large distributed data systems
Improve pipeline reliability, latency, and availability through monitoring, diagnostics, and performance engineering
Ensure secure and compliant data access using Azure RBAC, ACLs, managed identities, and fine-grained access patterns
Collaborate with PM/TPM, platform, reliability, OEM engagement, and telemetry teams to deliver high value insights

Qualification

Data EngineeringKQLAzure Cosmos DBAzure Data LakeSQLPythonData ModelingStreaming WorkflowsCollaborationProblem Solving

Required

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Preferred

3+ years in data engineering, software engineering, or largescale analytics
Strong experience with KQL and Azure Data Explorer (Kusto)
Hands-on experience with Azure Cosmos DB, Azure Data Lake/Lakehouse, and Parquet datasets
Strong SQL skills and proficiency in one programming language (Python, C#, or similar)
Demonstrated ability to optimize data pipelines for performance, scalability, and availability
Familiarity with Azure Synapse, Fabric Semantic Models, PySpark, Scala, and distributed compute engines
Experience building high-volume data pipelines (batch and streaming) using Cosmos Streams or equivalent
Experience with device telemetry, reliability metrics, or OEM ecosystem data flows
Knowledge of Azure access control models (RBAC/ABAC) and secure data governance
Experience building observability dashboards and pipeline health metrics

Company

Microsoft

company-logo
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)

Funding

Current Stage
Public Company
Total Funding
$1M
Key Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M

Leadership Team

leader-logo
Satya Nadella
Chairman and CEO
linkedin
leader-logo
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
linkedin
Company data provided by crunchbase