NVIDIA · 6 hours ago
Senior Software Engineer, Observability
Santa Clara, CA
Full-time
Onsite
Senior Level, Lead/Staff
$184K/yr - $356K/yr
8+ years expNVIDIA's Observability team is seeking a Senior/Staff Engineer to compose and build the next-generation, multi-region observability platform. You will be responsible for architecting, building, and operating NVIDIA’s unified observability stack, collaborating with teams to ensure engineers have deep access to system health and performance.
Artificial Intelligence (AI)Consumer ElectronicsGPUHardwareSoftwareVirtual Reality
Responsibilities
Designing and operating scalable observability systems (metrics, logging, tracing) across multi-datacenter Kubernetes environments
Architecting end-to-end observability pipelines, including ingestion, storage, querying, and visualization
Extending monitoring and alerting with Prometheus, Alertmanager, Thanos/Mimir, Grafana, and OpenTelemetry
Building scalable log collection and processing pipelines with Fluent Bit, Vector, Loki, or ELK/Opensearch stacks
Implementing distributed tracing platforms (Tempo, Jaeger, OpenTelemetry) and integrating with service meshes, load balancers, and APIs
Defining and driving adoption of SLOs, SLIs, and error budgets across services and teams
Automating provisioning and scaling of observability infrastructure with Kubernetes, Terraform, and custom tooling (Go, Python)
Ensuring reliability and cost efficiency of telemetry pipelines while supporting high-volume workloads (AI/ML, HPC clusters, GPU infrastructure)
Embedding security guidelines into observability platforms, including RBAC, TLS, secret management, and multi-tenant access controls
Mentoring engineers and shaping Nvidia observability strategy and technical roadmap
Qualification
Required
8+ years of experience with distributed systems, with a focus on observability and monitoring systems
BS or MS in EE, ECE, CS, or equivalent experience
Deep expertise with metrics systems (Prometheus, Thanos, Mimir, Cortex), logging pipelines (Fluent Bit, Vector, Loki, ELK/Opensearch), and tracing platforms (Jaeger, Tempo, OpenTelemetry)
Strong programming skills in Go or Python for automation, operators, and custom integrations
Experience running observability platforms on Kubernetes and operating them at scale across multi-datacenter environments
Demonstrated skill in crafting, optimizing, and scaling telemetry pipelines handling high cardinality and high efficiency data
Solid understanding of distributed systems, performance engineering, and debugging complex workloads
Familiarity with service meshes, networking, and workload instrumentation (Envoy, Istio, OpenTelemetry SDKs)
Collaboration skills and the ability to influence engineering teams to adopt observability guidelines
Preferred
Strong background in software design and system architecture with excellent coding skills in Go and Python for building telemetry pipelines and microservices
Experience operating large-scale, multi-region observability platforms (metrics, logs, traces)
Proven track record to meet strict SLAs for high-throughput, high-cardinality distributed systems
Deep expertise in data platforms and telemetry ingestion, storage, and querying layers
Demonstrated success collaborating across teams to drive platform improvements and standardization
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1418)
2024 (1356)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
2025-12-30
Morningstar.com
2025-12-30
SiliconANGLE
2025-12-30
Company data provided by crunchbase