Member of Technical Staff - Data Platform jobs in United States
info-icon
This job has closed.
company-logo

Microsoft · 5 hours ago

Member of Technical Staff - Data Platform

Microsoft is a leading technology company that empowers individuals and organizations to achieve more. They are seeking a Member of Technical Staff for their Data Platform team, responsible for designing distributed systems and building the infrastructure for AI applications.

Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Core Platform Engineering: Design and build the underlying frameworks (based on Spark/Databricks) that allow internal teams to process massive datasets efficiently, abstracting away the complexity of "ETL" into self-service infrastructure
Distributed Systems Architecture: Modernize our data stack by moving from batch-heavy patterns to event-driven architectures, utilizing modern streaming architecture to reduce latency for AI inference
Unstructured AI Data Pipelines: Architect high-throughput pipelines capable of processing complex, non-tabular data (documents, code repositories, chat logs) for LLM pre-training, fine-tuning and evaluations datasets
AI Feedback Loops: Engineer the high-throughput telemetry systems that capture user interactions with Copilot, creating the critical data loops required for Reinforcement Learning and model evaluation
Infrastructure as Code: Treat the data platform as software. Define and deploy all storage, compute, and networking resources using IaC (Bicep/Terraform) rather than manual configuration
Data Reliability Engineering: Move beyond simple "validation checks" to build automated governance and observability systems that detect anomalies in the data mesh before they impact downstream models
Compute Optimization: Deep-dive into query execution plans and cluster performance. Optimize shuffle operations, partition strategies, and resource allocation to ensure our platform is as cost-efficient as it is fast

Qualification

Distributed Systems ArchitectureData InfrastructurePythonStreaming TechnologiesLakehouse ArchitectureContainer OrchestrationAI/ML WorkloadsTeam CollaborationProblem SolvingCommunication Skills

Required

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience

Preferred

Bachelor's or Master's Degree in Computer Science, Software Engineering, or related technical field
4+ years of experience in Software Engineering or Data Infrastructure
Proficiency in Python, Scala, Java, or Go. You write production-grade application code with unit tests, CI/CD, and modular design
Deep Distributed Systems Knowledge: Demonstrated technical understanding of massive-scale compute engines (e.g., Apache Spark, Flink, Ray, Trino, or Snowflake). You should understand internals like query planning, memory management, and distributed consistency
Experience architecting Lakehouse environments at scale (using Delta Lake, Iceberg, or Hudi)
Experience building internal developer platforms or 'Data-as-a-Service' APIs
Strong background in streaming technologies (Kafka, Azure EventHubs, Pulsar) and stateful stream processing
Experience with container orchestration (Kubernetes) for deploying data applications
Experience enabling AI/ML workloads (Feature Stores, Vector Databases)

Company

Microsoft

company-logo
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)

Funding

Current Stage
Public Company
Total Funding
$1M
Key Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M

Leadership Team

leader-logo
Satya Nadella
Chairman and CEO
linkedin
leader-logo
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
linkedin
Company data provided by crunchbase