Apply on Employer Site

Broadcom · 7 hours ago

Senior Software Engineer, Tanzu Intelligent Assist

United States

Full-time

Remote

Senior Level, Lead/Staff

$91K/yr - $162K/yr

4+ years exp

Broadcom is seeking a Staff Engineer to lead the design, development, and scaling of their end-to-end machine learning systems. In this role, you will be responsible for architecting backend services, deploying LLM-powered systems, and ensuring system reliability and performance.

MobileSemiconductorWireless

No H1B

Responsibilities

Architect, build, and maintain highly scalable backend services and APIs in Java and Python to support ML and LLM workloads

Lead the deployment and integration of LLM and ML capabilities into our core products, collaborating closely with product managers, data scientists, and other engineering teams

Take ownership of the production environment, including containerization, CI/CD pipelines (GitHub Actions), and Kubernetes deployments to ensure system reliability and performance at scale

Implement comprehensive observability through logging, monitoring, and metrics, anticipating potential failure modes and building in robust safeguards

Drive technical initiatives and provide mentorship to teammates, establishing and championing engineering best practices and technical standards

Ensure security and privacy are considered at every stage of the development and operations lifecycle, adhering to industry best practices

Qualification

Machine Learning SystemsBackend EngineeringContainerization (Docker)KubernetesJavaPythonCI/CD PrinciplesObservability ToolsSecurity FundamentalsCloud InfrastructureDistributed SystemsGolangC++Compliance FrameworksTechnical Leadership

Required

Bachelor of Science degree in Computer Science or related field and a minimum of 5+ years of experience OR Master's Degree with 4+ years of relevant experience

Extensive experience designing, developing, and deploying end-to-end machine learning systems into a production environment

Hands-on expertise with LLM systems and the modern LLM ecosystem

Proven expertise in backend engineering with Java and Python

Deep production experience with containerization (Docker) and Kubernetes

Strong understanding of CI/CD principles with practical experience building and managing pipelines

Solid experience with observability and operational readiness, including monitoring and logging tools

A strong grasp of security and privacy fundamentals in software development

Must have legal authorization to work in the U.S

Preferred

Familiarity with modern cloud infrastructure, including public cloud platforms (AWS, GCP, or Azure), infrastructure-as-code tools (Terraform), Kubernetes tooling (Helm), and observability stacks (Prometheus and Grafana)

Experience with distributed systems at scale

Familiarity with other programming languages like Golang or C++

Demonstrated ability to lead technical initiatives and influence a cross-functional team

Knowledge of compliance frameworks (GDPR, SOC2, etc.)