Bright Vision Technologies · 4 weeks ago
AI Infrastructure Engineer
United States
Full-time
Remote
Senior Level
$100K/yr - $150K/yr
6+ years expBright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads.
Artificial Intelligence (AI)Cyber SecurityInformation TechnologySoftware
No H1B
Responsibilities
Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations
Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams
Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering
Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate
Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication
Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics
Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale
Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing
Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently
Partner with research and applied ML teams to plan capacity for upcoming training runs
Implement security controls, isolation, and access management for multi-tenant AI infrastructure
Drive automation across cluster provisioning, lifecycle management, and configuration enforcement
Maintain runbooks, capacity dashboards, and operational documentation for the AI platform
Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling
Qualification
Required
Bachelor's or Master's degree in Computer Science or a related field
Six or more years of experience in infrastructure, platform, or HPC engineering
Hands-on experience operating GPU clusters or large-scale ML training infrastructure
Strong proficiency in Python and at least one systems language such as Go or C++
Deep understanding of distributed training, accelerator architectures, and collective communication
Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads
Strong understanding of Linux internals, networking, and high-performance storage
Experience with at least one major cloud provider's ML infrastructure offerings
Strong software engineering practices including testing, CI/CD, and code review
Excellent communication and cross-functional collaboration skills
Preferred
Experience operating InfiniBand or RDMA networking at scale
Contributions to open-source ML infrastructure projects
Familiarity with custom orchestrators or research-grade training stacks
Exposure to frontier model training operations
Experience with FinOps for AI workloads
Benefits
Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party)
Competitive base salary commensurate with experience, plus benefits.
No new H1B sponsorship available. H1B transfers welcomed for qualified candidates.
Company
Bright Vision Technologies
Bright Vision Technologies is an information technology company that offers software development, AI, and cybersecurity services.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase