Red Hat · 2 days ago
Senior Software Engineer, AI Model Serving
Raleigh, NC
Full-time
Hybrid
Mid, Senior Level
$116K/yr - $192K/yr
5+ years expRed Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. The Senior Software Engineer will contribute to the architecture, design, development, and testing of new features and solutions for the Red Hat OpenShift AI platform, focusing on MLOps and participating in open-source communities.
Enterprise SoftwareInsurTechLinuxOpen SourceOperating SystemsSoftware
Responsibilities
Contribute to the architecture, design, development, and testing of new features and solutions for RHOAI
Innovate in the MLOps domain by participating in upstream communities, such as KubeFlow and KServe
Ensure non-functional requirements including security, resiliency, and maintainability are met
Write unit and integration tests and work with quality engineers to ensure product quality
Use CI/CD best practices to deliver solutions as productization efforts into RHOAI
Contribute to a culture of continuous improvement by sharing recommendations and technical knowledge with team members
Collaborate with product management, other engineering and cross-functional teams to analyze and clarify business requirements
Communicate effectively to stakeholders and team members to ensure proper visibility of development efforts
Give thoughtful and prompt code reviews
Represent RHOAI in external engagements including industry events, customer meetings, and open-source communities
Mentor and guide other engineers
Give thoughtful and prompt code reviews
Proactively utilize AI-assisted development tools (e.g., GitHub Copilot, Cursor, Claude Code) for code generation, auto-completion, and intelligent suggestions to accelerate development cycles and enhance code quality
Explore and experiment with emerging AI technologies relevant to software development, proactively identifying opportunities to incorporate new AI capabilities into existing workflows and tooling
Qualification
Required
Minimum of 5 years of experience
Passion for writing and maintaining reliable code
Experience with monitoring and alerting tools such as Prometheus and Grafana
Excellent written and verbal communication skills; fluent English language skills
Strong experience developing applications in Python, GoLang is a plus
Strong experience in Kubernetes or OpenShift
Experience with source code management tools such as Git
Strong system understanding and troubleshooting capabilities
Autonomous work ethic, thriving in a dynamic, fast-paced environment
Familiarity with data science workflows and machine learning pipelines
Excellent written and verbal communication skills
Preferred
While a Bachelor's degree or higher in computer science or a related discipline is valued, we prioritize practical experience and technical prowess
Understanding of how Open Source and Free Software communities work
Experience with development for public cloud services (AWS, GCE, Azure)
Experience working with or deploying MLOps platforms
Experienced in OpenShift based solutions
An existing contributor in one or more MLOps open-source projects such as KubeFlow, KServe, RayServe, and vLLM is a huge plus
Benefits
Comprehensive medical, dental, and vision coverage
Flexible Spending Account - healthcare and dependent care
Health Savings Account - high deductible medical plan
Retirement 401(k) with employer match
Paid time off and holidays
Paid parental leave plans for all new parents
Leave benefits including disability, paid family medical leave, and paid military leave
Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!
Company
Red Hat
Red Hat is a software company that offers enterprise open-source software solutions. It is a sub-organization of IBM.
10001+ employees
H1B Sponsorship
Red Hat has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (159)
2024 (148)
2023 (156)
2022 (181)
2021 (154)
2020 (106)
Funding
Current Stage
Public CompanyTotal Funding
unknown2018-10-28Acquired
1999-08-20IPO
1999-03-09Corporate Round
Leadership Team
Chris Wright
Chief Technology Officer and Senior Vice President Global Engineering
Andrew Brown
Senior Vice President and Chief Revenue Officer
Recent News
FinSMEs
2026-01-09
2026-01-07
MarketScreener
2026-01-07
Company data provided by crunchbase