Evergreen · 1 day ago
Sr. Machine Learning Integration Engineer
Atlanta, GA
Full-time
Onsite
Senior Level
6+ years expEvergreen is the professional services division of Insight Global, recognized for sourcing IT, healthcare, and engineering professionals. The role involves leading the integration of advanced AI/ML systems into enterprise environments, ensuring robust and scalable deployments while collaborating with cross-functional teams.
Information Technology & Services
Hiring Manager
Emily Goldsberry
Responsibilities
Architect and implement integration strategies for AI agents, LLM workflows, and evaluation frameworks into enterprise systems
Develop APIs, microservices, and orchestration layers for scalable and secure deployment of AI components
Optimize inference pipelines for latency, throughput, and cost efficiency in production environments
Design containerized and orchestrated solutions using Docker, Kubernetes, and Azure/AWS/GCP services
Implement CI/CD pipelines for AI/ML systems leveraging GitHub Actions, Azure DevOps, or equivalent
Ensure compliance with enterprise security, governance, and interoperability standards
Integrate LLMs with structured and unstructured data sources using knowledge graphs, vector databases (e.g., Pinecone, Weaviate, FAISS), and retrieval-augmented generation (RAG) techniques
Implement data pipelines for ingestion, validation, and monitoring using Python, SQL, and ETL frameworks
Build and deploy multi-agent systems using orchestration frameworks (e.g., LangChain, Haystack, OpenAI Agents, CrewAI)
Enable workflow automation and fine-tuning pipelines for domain-specific tasks
Implement observability for AI services using Prometheus, Grafana, and logging frameworks
Drive continuous optimization and automation in deployment workflows
Qualification
Required
6–8 years of experience in software engineering with at least 3 years focused on AI/ML integration in production environments
Strong proficiency in Python, RESTful APIs, and cloud platforms (Azure, AWS, or GCP)
Hands-on experience with containerization (Docker) and orchestration (Kubernetes)
Familiarity with ML frameworks (TensorFlow, PyTorch) and model serving technologies (TorchServe, MLflow, FastAPI)
Expertise in agent orchestration, workflow automation, and LLM integration
Knowledge of CI/CD, DevOps, and observability tools for AI systems
Strong problem-solving skills and ability to work in cross-functional teams
Excellent communication and leadership skills
Company
Evergreen
Evergreen is the professional services division of Insight Global, an international staffing and services company specializing in sourcing IT, healthcare, and engineering professionals for Fortune 1000 clients.
201-500 employees
H1B Sponsorship
Evergreen has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2022 (2)
Funding
Current Stage
Growth StageCompany data provided by crunchbase