Senior Data Engineer jobs in United States
info-icon
This job has closed.
company-logo

Jobs via Dice · 1 hour ago

Senior Data Engineer

Microsoft is on a mission to reinvent productivity with AI, and they are seeking a Senior Data Engineer to architect and build the next generation of intelligence, analytics, and experimentation infrastructure. The role involves designing and operating large-scale data pipelines and ensuring high data quality and reliability while collaborating with cross-functional teams.

Computer Software

Responsibilities

Architect and build large-scale data pipelines across meetings, calendar actions, user behaviors, Teams signals, and Copilot interactions to unlock analytics, AI modeling, and product insights
Design and maintain unified data models and feature stores that support personalization, meeting prep intelligence, time insights, and agentic AI features
Ensure high data quality and reliability through robust validation, monitoring, lineage tracking, schema governance, and automated anomaly detection
Build and operate experimentation and metric infrastructure that supports A/B testing, quasi-experiments, telemetry analysis, and longitudinal user studies
Partner with applied scientists and model engineers to provide high-quality datasets for post-training, RLHF, evaluation, and model diagnostics
Develop scalable, efficient data pipelines using technologies such as Spark, Kusto, Cosmos, Synapse, Data Factory, Delta Lake, or similar distributed systems
Collaborate cross-functionally with PM, Applied Science, and Engineering to translate business needs into data pipelines and scalable production systems
Drive engineering excellence through code reviews, documentation, automation, observability, and best practices in security, compliance, and privacy
Provide technical leadership by mentoring engineers, setting architectural direction, and ensuring long-term maintainability of core data systems

Qualification

Data EngineeringData PipelinesData GovernanceAI/ML WorkflowsReal-time Data SystemsExperimentation FrameworksMentoring EngineersData PrivacyCross-functional CollaborationTechnical Leadership

Required

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR equivalent experience

Preferred

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR equivalent experience
2+ years experience with data governance, data compliance and/or data security
Experience designing end-to-end data architectures for AI/ML workflows, including training data generation, evaluation datasets, and feature pipelines
Experience with real-time or near-real-time data systems, streaming, or event-driven architectures (EventHub, Kafka, etc.)
Experience supporting experimentation frameworks and telemetry-based metrics
Familiarity with Responsible AI, data privacy, GDPR, or enterprise compliance considerations
Demonstrated ability to influence cross-functional teams and drive large-scale technical initiatives
Experience mentoring engineers and leading technical design discussions at an org-wide level

Company

Jobs via Dice

twitter
company-logo
Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want.

Funding

Current Stage
Early Stage
Company data provided by crunchbase