SIGN IN
Data Engineer 2 - Partner Engineering Platform (PEP) Reporting jobs in United States
cer-icon
Apply on Employer Site
company-logo

Microsoft · 3 days ago

Data Engineer 2 - Partner Engineering Platform (PEP) Reporting

Microsoft's Partner Engineering Platform (PEP) Reporting team is focused on delivering high scale telemetry insights to enhance device reliability and improve the Windows customer experience. As a Data Engineer 2, you will design and optimize cloud scale data systems for processing high-volume telemetry data, enabling data-driven decisions for engineering teams.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Build and maintain scalable data pipelines using Azure Data Lake, Lakehouse patterns, Azure Datastores, and Parquet-based datasets
Develop Kusto (ADX) queries, tables, and ingestion processes; optimize KQL for performance and cost efficiency
Design and tune Cosmos DB collections, partitioning, indexing, and RU consumption
Implement streaming and batch workflows using COSMOS Streams and large distributed data systems
Improve pipeline reliability, latency, and availability through monitoring, diagnostics, and performance engineering
Ensure secure and compliant data access using Azure RBAC, ACLs, managed identities, and fine-grained access patterns
Collaborate with PM/TPM, platform, reliability, OEM engagement, and telemetry teams to deliver high value insights

Qualification

Data EngineeringAzure Data LakeKQLAzure Cosmos DBSQLPythonData ModelingTelemetryCollaborationProblem Solving

Required

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Preferred

3+ years in data engineering, software engineering, or largescale analytics
Strong experience with KQL and Azure Data Explorer (Kusto)
Hands-on experience with Azure Cosmos DB, Azure Data Lake/Lakehouse, and Parquet datasets
Strong SQL skills and proficiency in one programming language (Python, C#, or similar)
Demonstrated ability to optimize data pipelines for performance, scalability, and availability
Familiarity with Azure Synapse, Fabric Semantic Models, PySpark, Scala, and distributed compute engines
Experience building high-volume data pipelines (batch and streaming) using Cosmos Streams or equivalent
Experience with device telemetry, reliability metrics, or OEM ecosystem data flows
Knowledge of Azure access control models (RBAC/ABAC) and secure data governance
Experience building observability dashboards and pipeline health metrics

Benefits

Certain roles may be eligible for benefits and other compensation.

Company

Microsoft

company-logo
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)

Funding

Current Stage
Public Company
Total Funding
$1M
Key Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M

Leadership Team

leader-logo
Satya Nadella
Chairman and CEO
linkedin
leader-logo
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
linkedin
Company data provided by crunchbase