BRG · 2 days ago
AI Lab Infrastructure Engineer
Berkeley Research Group's AI Department is seeking an AI Infrastructure Engineer to lead the development of their Virtual AI Lab initiative. The role focuses on creating a virtual access layer for a high-performance AI Lab, ensuring secure and efficient remote processing capabilities for large-scale document processing.
AdviceConsultingFinanceFinancial ServicesManagement Consulting
Responsibilities
Design and implement a virtual access layer for the physical Ai Lab infrastructure
Build scalable remote processing capabilities supporting 100,000+ documents per day
Create customizable, expandable interfaces for different BRG business units
Optimize infrastructure for maximum LLM token throughput (OpenAI/Anthropic)
Implement secure authentication and access management systems
Ensure high availability and fault tolerance for mission-critical AI workloads
Lead infrastructure projects from conception to production deployment
Qualification
Required
Bachelor's degree in Computer Science, Information Technology, or a related field
Minimum six to eight (6-8) years of hands-on experience designing, deploying, and managing scalable cloud infrastructure
Strong experience with Infrastructure as Code (IaC) tools and methodologies
Experience designing, implementing, and maintaining scalable, secure, and cost-efficient cloud/on-prem solutions
Proven ability to manage and lead projects to deliver high-quality, replicable solutions
Proficiency in VCS (Git/GitHub), modern coding languages (Python, .NET, Java, etc.), Software Development Life Cycle, and CI/CD practices
Experience with API design and implementation for distributed systems
Knowledge of GPU infrastructure and optimization for AI workloads
Hands-on experience with AWS Services including: EC2/Lambda (apps/functions), SageMaker (ML), S3 (file management), Fargate/ECS/EKS (containerization), CDK/Terraform (IaC), Cost Explorer/Budgets
Preferred
Experience with LLM deployment and optimization (OpenAI, Anthropic, etc.)
Background in building AI/ML infrastructure and platforms
Experience with virtual desktop infrastructure (VDI) or remote access solutions
Knowledge of distributed computing and job scheduling systems
AWS certifications (Solutions Architect, Machine Learning, or similar)
Experience with cost management and optimization strategies in the cloud
Familiarity with security best practices for AI systems and data handling
Company
BRG
BRG combines world-leading academic credentials with world-tested business expertise, purpose-built for agility and connectivity, which sets us apart—and gets our clients ahead.
H1B Sponsorship
BRG has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (23)
2024 (7)
2023 (6)
2022 (8)
2021 (4)
2020 (2)
Funding
Current Stage
Late StageTotal Funding
$84.56MKey Investors
Endeavour Capital
2025-02-27Acquired
2020-07-02Series Unknown· $19.44M
2017-03-29Private Equity· $62.5M
Leadership Team
Recent News
2025-12-01
2025-11-19
Company data provided by crunchbase