Staff Software Engineer, AI, Infrastructure, Applied AI jobs in United States
cer-icon
Apply on Employer Site
company-logo

Google · 1 day ago

Staff Software Engineer, AI, Infrastructure, Applied AI

Google is a leading technology company that develops next-generation technologies to enhance user interaction with information. The Staff Software Engineer in AI, Infrastructure, and Applied AI will be responsible for architecting and building high-performance distributed infrastructure for AI workflows, ensuring system reliability and efficiency, and providing technical guidance on system architecture and code quality.

AppsArtificial Intelligence (AI)Cloud StorageSearch EngineSEO
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Architect and build high-performance, distributed infrastructure to support agentic AI workflows. Leverage C++ to ensure low-latency agentic systems for real-world enterprise loads
Take full ownership of the tech stack, transitioning experimental models into production services. Ensure system reliability, observability, and fault tolerance in complex, multi-agent environments
Drive inference cost optimization and system efficiency. Implement efficient connectors, optimize kernels, manage memory usage, and reduce latency to ensure our AI solutions are not just powerful, but economically viable and at scale
Provide technical guidance on system architecture and code quality. Foster a culture of engineering excellence through design reviews, code audits, and the adoption of best practices
Maintain a tight loop between hypothesis and deployment. Quickly prototype new capabilities and seamlessly harden them for production release while focusing customer needs

Qualification

C++Infrastructure engineeringMachine Learning (ML)Data structuresAlgorithmsSoftware designArchitectureTechnical leadershipSpeech/audio technologyReinforcement learningModel deploymentModel evaluationData processingDebuggingFine tuningCross-functional collaboration

Required

Bachelor's degree or equivalent practical experience
8 years of experience in software development focusing on infrastructure engineering in C++
5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture
5 years of experience with one or more of the following: speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), or specialization in another ML field
5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning)

Preferred

Master's degree or PhD in Engineering, Computer Science, or a related technical field
8 years of experience with data structures and algorithms
3 years of experience in a technical leadership role leading project teams and setting technical direction
3 years of experience working in a complex organization involving cross-functional, or cross-business projects

Benefits

Bonus
Equity
Benefits

Company

Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet.

H1B Sponsorship

Google has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (8763)
2024 (8872)
2023 (9682)
2022 (11626)
2021 (9109)
2020 (9785)

Funding

Current Stage
Public Company
Total Funding
$26.1M
Key Investors
Andy Bechtolsheim
2004-08-19IPO
1999-06-07Series Unknown· $25M
1998-11-01Angel· $1M

Leadership Team

leader-logo
Sundar Pichai
CEO
linkedin
leader-logo
Thomas Kurian
CEO - Google Cloud
linkedin
Company data provided by crunchbase