Principal Software Engineer- OCI GenAI Agent Service jobs in United States
cer-icon
Apply on Employer Site
company-logo

Oracle · 5 months ago

Principal Software Engineer- OCI GenAI Agent Service

positionUnited States
timeFull-time
remoteRemote
senioritySenior Level, Lead/Staff
date6+ years exp

Oracle Cloud Infrastructure (OCI) is focused on building the future of cloud computing, optimized for AI at scale. The Principal Software Engineer will design and implement scalable, distributed systems to support Large Language Models and agent-based workflows, collaborating with scientists and engineers to deliver reliable AI infrastructure.

Data GovernanceData ManagementEnterprise SoftwareInformation TechnologySaaSSoftware
badNo H1Bnote

Responsibilities

Contribute to the development and optimization of distributed systems for model inference and agent execution
Implement features and enhancements in LLM service infrastructure using modern cloud technologies
Collaborate with cross-functional teams to support scalable and secure deployment pipelines
Assist in diagnosing and resolving production issues, improving observability and reliability
Write maintainable, well-tested code and contribute to documentation and design discussions

Qualification

Backend software developmentCloud infrastructureGoDistributed servicesKubernetesCI/CD practicesAlgorithmsOperating systemsNetworkingLLM serving frameworksCloud-native observability toolsAgent-based AI systemsCompiler designSystems-level software design

Required

BS in Computer Science or related technical field
6+ years of experience in backend software development with cloud infrastructure
Strong proficiency in at least one language such as Go, Java, Python, or C++
Experience building and maintaining distributed services in a production environment
Familiarity with Kubernetes, container orchestration, and CI/CD practices
Solid understanding of computer science fundamentals such as algorithms, operating systems, and networking

Preferred

MS in Computer Science
Experience working with LLM serving frameworks like vLLM, DeepSpeed, or FasterTransformer
Exposure to agent-based AI systems or tool-based inference workflows
Knowledge of cloud-native observability tools and scalable service design
Interest in compiler or systems-level software design is a plus

Company

Oracle

twittertwittertwitter
Glassdoor3.8
company-logo
Oracle is an integrated cloud application and platform services that sells a range of enterprise information technology solutions.
dateFounded in 1977
location
Austin, Texas, USA
people-size10001+ employees
web-link
https://www.oracle.com/

Funding

Current Stage
Public Company
Total Funding
$25.75B
Key Investors
Sequoia Capital
2025-09-24Post Ipo Debt· $18B
2025-02-03Post Ipo Debt· $7.75B
1986-03-12IPO

Leadership Team

leader-logo
Esteban Rubens
Healthcare Field CTO
linkedin
G
Gerard Warrens
Field CTO, Business Strategy and Transformative Technologies
linkedin

Recent News

LinkedIn
Oracle highlights IntellIA as a leading Uruguayan Health AI startup
2026-01-10
Investing.com
Less than zero: Paramount reaffirms Warner Bros offer, dumps on cable spinoff
2026-01-09
Business Insider
Why Paramount is now saying the TV networks it wants to buy from WBD are worth $0.00 per share
2026-01-09
Company data provided by crunchbase