Ontra · 5 days ago

Staff Machine Learning Platform Engineer

United States

Full-time

Remote

Senior Level

$200K/yr - $320K/yr

7+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Document ManagementInformation Technology

Growth Opportunities

Insider Connection @Ontra

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Collaborate: Work across teams such as Infrastructure Engineering, Application Development, and Machine learning to develop and deploy LLM applications

Build: Build ML infrastructure to develop, fine-tune, and serve GenAI & LLM applications

Model serving: Utilize Kubernetes and AWS services to containerize and serve our applications effectively

Improve process: Integrate tools and practices to standardize workflows and improve LLM prompt engineering, model evaluation, performance monitoring, and reproducibility.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Machine learningPythonKubeflowLangchainLlmaindexLlmOpenaiLlamaPrompt engineeringRagFine tuningInfrastructure buildingKubernetesTerraformAwsTeam player mentality

Required

Machine Learning Experience: 7+ years of experience as an ML Platform/ML Ops Engineer, preferably in a high-growth, scaling environment

ML Toolset: Proficiency using Python to write and optimize code to support ML models as well as tools such as Kubeflow, LangChain and LlamaIndex

LLM knowledge: Hands-on experience in productionization of OpenAI, LLaMA or other LLM based applications using techniques such as Prompt Engineering, RAG, or Fine Tuning

Infrastructure building: Experience designing, building, and scaling ML infrastructure using Kubernetes, Terraform, and AWS

Team Player Mentality: A background in working across multiple functions to achieve team-wide and company-wide goals, fostering a culture of innovation