Apply on Employer Site

Boston Consulting Group (BCG) · 20 hours ago

AI/ML Engineering Director

Atlanta, GA

Full-time

Hybrid

Director/Executive

$200K/yr - $244K/yr

12+ years exp

Boston Consulting Group (BCG) partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. As the Director of AI/ML Engineering within BCG’s Data Layer Team, you will lead and operationalize the intelligence layer that transforms BCG’s vast data landscape into AI-ready capabilities, directing the design and optimization of AI/ML systems that enable BCG’s GenAI applications.

Business DevelopmentConsultingInnovation ManagementManagement ConsultingMarketing

H1B Sponsor Likely

Responsibilities

Define and own the AI/ML engineering strategy for the Intelligence Layer, ensuring alignment with Data Layer vision and enterprise architecture principles

Architect end-to-end AI and LLM systems (RAG pipelines, embeddings, retrieval frameworks, model orchestration) to make BCG’s data actionable and consumable by GenAI applications

Lead the design and implementation of scalable pipelines for data preprocessing, feature/embedding generation, knowledge graph construction, semantic indexing, and retrieval optimization

Oversee integration of AI services into enterprise systems, ensuring reliability, security, observability, and compliance with internal standards

Partner with Product Owners, Data Engineers and Architects to ensure pipelines reflect highest standards of data quality, provenance, governance, and ML-readiness

Drive implementation of advanced retrieval, reasoning, and grounding systems to support BCG’s internal GenAI products

Collaborate with Product Owners and GenAI teams to translate user needs into technical capabilities, ensuring measurable, high-value outcomes for consulting teams and practice areas

Engage with TAL, PPL, and other engineering chapters to align resource strategy, scale best practices, and evolve AI/ML engineering capabilities

Ensure systems meet stringent performance, accuracy, stability, and resilience requirements -leveraging expertise such as prompt engineering, LLM optimization, evaluation frameworks, and multi-agent pipelines

Introduce emerging techniques (fine-tuning, model compression, retrieval optimization, evaluators, guardrails) to continuously improve system effectiveness

Lead, mentor, and develop Data engineers driving excellence in modern engineering, responsible AI, and advanced ML craftsmanship

Contribute to community building, knowledge sharing, and uplift across the AI/ML and Data Layer engineering chapters

Qualification

AI/ML engineeringLLM system designPythonData engineeringCloud-native infrastructureData governanceCross-functional leadershipTeam leadershipCommunication skills

Required

12+ years of experience in AI/ML engineering, including 3–5 years leading teams building production-grade ML/LLM systems

Demonstrated expertise in LLM-based system design, including embeddings, retrieval architectures (VectorDBs, OpenSearch, semantic search), RAG patterns, and multi-agent systems

Strong software engineering background across Python, modern ML libraries, APIs/microservices, and cloud-native infrastructure (Containers, Kubernetes)

Deep understanding of data engineering, modelling, and pipeline design to support ML workloads (aligns with AI/ML MSD3 requirement to design infrastructure for ML/AI systems)

Proven ability to define architecture strategy, technical roadmaps, and solution blueprints for complex AI/ML systems at enterprise scale

Exceptional cross-functional leadership: able to influence senior stakeholders, resolve ambiguity, and set direction across distributed teams

Strong grounding in data governance, model evaluation, responsible AI, and security considerations for enterprise deployments

Benefits

Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children

Low $10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs

Dental coverage, including up to $5,000 in orthodontia benefits

Vision insurance with coverage for both glasses and contact lenses annually

Reimbursement for gym memberships and other fitness activities

Fully vested Profit Sharing Retirement Fund contributions made annually, whether you contribute or not, plus the option for employees to make personal contributions to a 401(k) plan

Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement

Generous paid time off including 12 holidays per year, an annual office closure between Christmas and New Years, and 15 vacation days per year (earned at 1.25 days per month)

Paid sick time on an as needed basis

Company

Boston Consulting Group (BCG)

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities.

Founded in 1963

Boston, Massachusetts, USA

10001+ employees

http://www.bcg.com

H1B Sponsorship

Boston Consulting Group (BCG) has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (617)

2024 (632)

2023 (475)

2022 (474)

2021 (423)

2020 (385)