Technical Integrity · 1 month ago
Senior Staff AI or ML Engineer
Technical Integrity is a rapidly growing startup developing AI systems that improve how large organizations think, communicate, and make decisions. They are seeking a Senior Staff AI or ML Engineer to architect and implement core systems for an AI-powered enterprise collaboration platform, while leading a small, senior team to deliver innovative solutions in distributed systems and AI integration.
Responsibilities
Architect and implement core systems for an AI-powered enterprise collaboration platform
Define, design, and deliver innovative solutions in distributed systems, backend logic, and AI integration
Lead hands-on coding while setting technical direction across a small, senior team
Collaborate closely with product, design, and AI research peers to shape both strategy and implementation
Ensure infrastructure reliability, scalability, and security through modern cloud and Kubernetes technologies
Work with other Senior Staff Engineers to foster a culture of technical excellence, autonomy, and curiosity
Utilize advanced information retrieval concepts (such as MRR and IDF) to develop and refine ranking models that improve the quality and relevance of search results
Collaborate across engineering and product teams to define ranking metrics, set quality benchmarks, and drive data-centric evaluations of search algorithms
Design, develop, and implement algorithmic strategies for ranking, including keyword matching, semantic analysis, and machine learning-based scoring techniques
Conduct offline and online experimentation (e.g., A/B tests) to assess improvements in search result quality using metrics like MRR, DCG, NDCG, and click-through rate
Build and optimize LLM-powered systems that support autonomous agent workflows, including agents that iteratively generate, evaluate, and refine prompts
Develop training loops, evaluation pipelines, and reward mechanisms that enable automated prompt tuning and self-improving model behavior
Apply advanced model optimization techniques (e.g., quantization, pruning, distillation, LoRA/QLoRA) to improve model efficiency, reduce latency, and accelerate agent iteration cycles
Design and maintain scalable inference, retrieval, and vector-search components that support fast agent decision-making and prompt evaluation
Qualification
Required
At least 7 years of experience in engineering, with a record of rapid advancement
Experience in architecting and implementing core systems for AI-powered platforms
Ability to define, design, and deliver innovative solutions in distributed systems, backend logic, and AI integration
Hands-on coding experience while setting technical direction across a team
Collaboration skills to work closely with product, design, and AI research teams
Experience ensuring infrastructure reliability, scalability, and security through modern cloud and Kubernetes technologies
Experience in developing high-quality search and retrieval systems
Ability to design ranking algorithms grounded in modern information retrieval concepts
Experience building semantic and keyword-based scoring models
Ability to define metrics that determine search relevance and quality
Experience developing offline evaluation pipelines and online experimentation frameworks
Utilization of advanced information retrieval concepts to develop and refine ranking models
Collaboration across engineering and product teams to define ranking metrics and set quality benchmarks
Experience designing, developing, and implementing algorithmic strategies for ranking
Conducting offline and online experimentation to assess improvements in search result quality
Experience in designing and optimizing large language model-powered systems
Ability to build and refine LLM agents that can iteratively generate, evaluate, and improve prompts
Experience developing training loops, evaluation pipelines, and reward mechanisms for automated prompt tuning
Application of advanced model optimization techniques to improve inference performance
Designing and maintaining scalable inference, retrieval, and vector-search components
Preferred
Strong analytical ability, judgment, and breadth of experience
Experience in backend and business logic development
Experience in startup and enterprise environments
Ability to work efficiently and sustainably, producing exceptional results within a 45–50 hour workweek
Curiosity about AI and LLM development
Collaborative and solution-oriented communication style
Benefits
Very solid Health benefits (Medical, Dental, and Vision)
401K match
Flexible work arrangements — Colorado-based 1-2 days per week in Boulder.