AI/ML Infrastructure Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Oracle · 10 hours ago

AI/ML Infrastructure Engineer

positionUnited States
timeFull-time
remoteRemote
seniorityMid, Senior Level
money$79K/yr - $178K/yr
date4+ years exp

Oracle is at the forefront of developing cutting-edge AI solutions that push the boundaries of machine learning and agentic AI. They are seeking a highly skilled AI/ML Infrastructure Engineer to design, build, and support systems and tools that power large-scale machine learning workflows. The role involves collaborating across teams to deliver secure and scalable infrastructure that accelerates AI innovation.

Data GovernanceData ManagementEnterprise SoftwareInformation TechnologySaaSSoftware
check
H1B Sponsor Likelynote

Responsibilities

Design, deploy, and operate infrastructure components—including cloud compute, distributed systems, and data storage—to support AI/ML model training, evaluation, and deployment
Build automation pipelines for provisioning, configuring, and monitoring AI/ML infrastructure using Terraform, Docker, Kubernetes, and related tools
Optimize resource utilization and performance through cluster tuning, caching, data preprocessing, and system-level performance enhancements
Troubleshoot and resolve complex issues in distributed computing environments, ensuring high availability, reliability, and scalability
Enforce strong security and compliance standards through access control, vulnerability management, and encryption best practices
Partner closely with applied scientists, platform engineers, and cloud infrastructure teams to gather requirements and deliver frictionless ML workflows
Produce clear and comprehensive documentation for infrastructure, APIs, designs, troubleshooting, and best practices
Stay current with emerging trends in AI infrastructure, agent frameworks, HPC systems, and cloud-native technologies; evaluate and integrate them where appropriate

Qualification

Distributed systemsCloud-native platformsAI/ML infrastructureDockerKubernetesLinux administrationPublic cloud expertiseDevOpsProblem ownershipResearch capabilitiesCommunicationTeam collaboration

Required

4–7 years of software engineering experience focused on backend systems, distributed systems, or AI/ML applications
Hands-on experience with Docker and deploying containerized applications in Kubernetes environments
Strong Linux administration skills, including shell scripting, package management, troubleshooting, and performance tuning
Proven experience designing or managing infrastructure for AI/ML or HPC workloads. HA, Failover, Cross-Region DR
Expertise with at least one public cloud (OCI, AWS, Azure, GCP) and willingness to specialize in OCI
Excellent communication skills, particularly in distributed and asynchronous team environments
Demonstrated ability to own problems end-to-end and collaborate effectively with internal teams and external customers
Knowledge of DevOps and CI/CD pipelines

Preferred

Strong research and evaluation capabilities for new technologies and approaches
Advanced understanding of applications, server technologies, network routing, and security

Benefits

Medical, dental, and vision insurance, including expert medical opinion
Short term disability and long term disability
Life insurance and AD&D
Supplemental life insurance (Employee/Spouse/Child)
Health care and dependent care Flexible Spending Accounts
Pre-tax commuter and parking benefits
401(k) Savings and Investment Plan with company match
Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
11 paid holidays
Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
Paid parental leave
Adoption assistance
Employee Stock Purchase Plan
Financial planning and group legal
Voluntary benefits including auto, homeowner and pet insurance

Company

Oracle

twittertwittertwitter
Glassdoor3.8
company-logo
Oracle is an integrated cloud application and platform services that sells a range of enterprise information technology solutions.
dateFounded in 1977
location
Austin, Texas, USA
people-size10001+ employees
web-link
https://www.oracle.com/

H1B Sponsorship

Oracle has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1271)
2024 (846)
2023 (995)
2022 (1192)
2021 (985)
2020 (755)

Funding

Current Stage
Public Company
Total Funding
$25.75B
Key Investors
Sequoia Capital
2025-09-24Post Ipo Debt· $18B
2025-02-03Post Ipo Debt· $7.75B
1986-03-12IPO

Leadership Team

leader-logo
Esteban Rubens
Healthcare Field CTO
linkedin
G
Gerard Warrens
Field CTO, Business Strategy and Transformative Technologies
linkedin

Recent News

Benzinga.com
'Big Short' Investor Michael Burry Bets Against Oracle—Here's His Advice
2026-01-12
The Motley Fool
Should You Forget Nvidia and Buy These 2 Artificial Intelligence (AI) Stocks Right Now?
2026-01-12
Tech
Oracle announces departure of two oldest directors, narrowing board to 12
2026-01-11
Company data provided by crunchbase