Senior Software Engineer, Managed AI jobs in United States
cer-icon
Apply on Employer Site
company-logo

Crusoe · 6 hours ago

Senior Software Engineer, Managed AI

Crusoe is on a mission to accelerate the abundance of energy and intelligence, focusing on sustainable technology in the AI sector. They are seeking a Senior Software Engineer to shape the architecture of their AI inference platform, leading the design and implementation of core systems and collaborating with cross-functional teams to deliver high-performance AI services.

AI InfrastructureArtificial Intelligence (AI)Data CenterEnergyEnergy ManagementOil and Gas
check
H1B Sponsor Likelynote

Responsibilities

Design and develop core infrastructure for the Managed AI platform:
Lead the design and implementation of resilient fault-tolerant queues, model catalogs, and scheduling mechanisms
Build and optimize systems for high-volume AI inference, handling millions of API requests per second
Develop and maintain core services for AI model deployment and management
Collaborate with cross-functional teams:
Work closely with product managers, data scientists, and other engineers to define and deliver AI services
Integrate with other Crusoe Cloud services to provide a seamless user experience
Collaborate with research and development teams to explore and implement new AI technologies
Ensure high availability and performance:
Design and implement systems with high availability, low latency, and fault tolerance
Optimize performance across all stages of the AI inference pipeline, including model loading, execution, and response handling
Continuously monitor and improve the performance and reliability of AI services

Qualification

Distributed systems designCloud-based servicesAI/ML expertiseGolangPythonContainer runtimesREST APIsCI/CD toolsAI infrastructureProactivePassion for quality productsCommunicationCollaboration skillsResults-oriented

Required

Advanced degree in Computer Science, Engineering, or a related field
Proven experience in distributed systems design and implementation
Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed databases, etc
Experience with container runtimes (e.g., Kubernetes) and microservices architectures
Experience using REST APIs and common communication protocols, such as gRPC
Demonstrated experience in the software development cycle and familiarity with CI/CD tools
Experience in Generative AI (Large Language Models, Multimodal)
Proven track record of delivering early-stage projects under tight deadlines
Strong communication and collaboration skills
Proactive and results-oriented with the ability to work independently and as part of a team
Passion for building high-quality, scalable, and impactful products

Preferred

Proficiency in Golang or Python for large-scale, production-level services
Familiarity with AI infrastructure, including training, inference, and ETL pipelines
Contributions to open-source AI projects such as VLLM or similar frameworks
Performance optimizations on GPU systems and inference frameworks

Benefits

Restricted Stock Units in a fast growing, well-funded technology company
Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
Employer contributions to HSA accounts
Paid Parental Leave
Paid life insurance, short-term and long-term disability
Teladoc
401(k) with a 100% match up to 4% of salary
Generous paid time off and holiday schedule
Cell phone reimbursement
Tuition reimbursement
Subscription to the Calm app
MetLife Legal
Company paid commuter benefit; $300 per month

Company

Crusoe

twittertwittertwitter
company-logo
Crusoe is a vertically integrated AI infrastructure company that builds and operates data centers powered by energy sources.

H1B Sponsorship

Crusoe has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (69)
2024 (14)
2023 (2)
2022 (1)
2021 (1)

Funding

Current Stage
Late Stage
Total Funding
$3.9B
Key Investors
Victory Park CapitalBrookfield Asset ManagementUpper90
2025-12-19Secondary Market
2025-10-23Series E· $1.4B
2025-08-25Debt Financing· $175M

Leadership Team

leader-logo
Chase Lochmiller
Co-Founder and Chief Executive Officer
linkedin
leader-logo
Cully Cavness
Co-Founder, President and Chief Strategy Officer
linkedin
Company data provided by crunchbase