Hercules · 1 month ago
Sr. AI Engineer
HerculesAI is a company that aids finance and operations leaders in managing complex problems through automation. The Sr. AI Engineer will focus on applied research and engineering to build AI capabilities, enhance user experience, and drive business value through robust model implementation.
AppsArtificial Intelligence (AI)Information TechnologyMachine LearningSoftware
Responsibilities
Create training environments that elevate the quality ceiling of synthetic data, and provide high-quality reward signals for both off- and on-policy learning
Design model behaviors that optimize for interpretability and an outstanding user experience
Train agentic models that autonomously interact with complex structured and unstructured environments, write and prototype code, and navigate multimodal inputs
Utilize the best tool for the job – SFT over synthetic data, on-policy distillation, RL or any combination of these to drive down the cost of specialized intelligence
Own benchmarking pipelines – assemble high-quality datasets and measure impact of different training parameters or methodologies
Architect scalable inference strategies that maximize compute efficiency
Maintain solutions to ensure stable, reliable execution for customers
Closely collaborate with engineering team to design important intersections of AI and product services such as interfaces, inference tracking, checkpointing, data persistence and caching
Contribute to engineering culture; mentor peers, evolve patterns, raise the bar on code quality, testing strategy, and documentation
Work with bleeding-edge open-weights models and internal training frameworks
Stay at the forefront of open research and tooling– rapidly prototype and validate novel approaches
Contribute to internal tooling for inference, training, orchestration, and data generation
Communicate ideas and explain solutions – even to a non-technical audience
Autonomously build demonstrations and showcase work to the wider company
Break down ambiguous problems into a clear technical scope – think beyond immediate business needs and incorporate future scalability into each design
Proactively collaborate with team members and seek out all resources relevant to the task at hand
Qualification
Required
Strong background in both ML and engineering
Great communication skills and rapid understanding of problem descriptions
High agency; willing to propose, prototype and own solutions
Experience in post-training large models (SFT, distillation, RL)
Experience deploying models at production scale
Previous work with dockerized systems (Docker, Kubernetes, etc.)
Previous contributions to open research or AI infrastructure
Strong familiarity with latest AI research and open-source tooling
Experience shipping complex software and owning production-code
Preferred
Experience performance-engineering inference architecture for maximum throughput (vLLM, SGlang, llama.cpp)
Detailed knowledge of RL frameworks (verifiers, ART, prime-rl, trl)
Published models or blog posts/publications
Company
Hercules
HerculesAI helps finance and operations leaders solve problems that are too complex, large-scale, or time-consuming for human teams to manage alone.
H1B Sponsorship
Hercules has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2022 (2)
Funding
Current Stage
Growth StageTotal Funding
$38.23MKey Investors
StreamlinedNFX
2024-05-30Series B· $26.11M
2022-03-01Series A· $12M
2020-05-10Series Unknown
Recent News
Indico Capital Partners
2025-10-27
Company data provided by crunchbase