Network Engineer, AI/ML Infrastructure jobs in United States
info-icon
This job has closed.
company-logo

Boson AI ยท 1 week ago

Network Engineer, AI/ML Infrastructure

positionSanta Clara, CA
timeFull-time
remoteOnsite
seniorityMid, Senior Level
money$150K/yr - $250K/yr
date4+ years exp

Boson AI is seeking an experienced Network Engineer to design, build, and optimize their high-performance networking infrastructure for AI/ML operations. The role involves managing InfiniBand and ultra-high-speed Ethernet fabrics, troubleshooting network issues, and collaborating with HPC and ML teams to ensure optimal performance.

Artificial Intelligence (AI)Information TechnologyMarket Research
check
H1B Sponsor Likelynote

Responsibilities

Configure and maintain InfiniBand and high-speed Ethernet fabrics
Optimize network performance for RDMA, and GPU-to-GPU communication
Manage network switches (Mellanox, NVIDIA, Micas Networks)
Troubleshoot network bottlenecks and latency issues
Plan and execute network upgrades and expansions
Network security implementation (firewalls, VLANs, ACLs)
Collaborate on storage network optimizationInfrastructure monitoring

Qualification

InfiniBandHigh-speed EthernetNetwork securityL2/L3 networking protocolsHPC network topologiesNetwork automation toolsTroubleshooting skillsCloud networkingProblem-solving skills

Required

4+ years of network engineering experience in production environments
Strong understanding of L2/L3 networking protocols (TCP/IP, BGP, OSPF, VLANs)
Hands-on experience with high-speed networking (100Gb+ Ethernet and InfiniBand)
Hands-on experience with network security (firewalls, ACLs, network segmentation)
Knowledge of HPC network topologies
Experience with InfiniBand fabrics including RDMA, RoCE, IPoIB
Strong troubleshooting and problem-solving skills

Preferred

Experience in data center environments or AI/ML infrastructure
Hands-on experience with high-performance Ethernet switches (e.g., Broadcom Tomahawk), and latest InfiniBand switches (e.g., Nvidia/Mellanox)
Experience optimizing networks for GPU-to-GPU communication
Experience with open-source firewall solutions (OPNsense, pfSense, or similar)
Experience with network automation tools
Understanding of distributed storage networking (Ceph cluster networks)
Familiarity with network monitoring and observability tools (Prometheus, Grafana)
Knowledge of multi-site network connectivity and WAN optimization
Familiarity with cloud networking in at least one platform (AWS, GCP, or Azure) including VPC design, site-to-site VPN configuration, Direct Connect/ExpressRoute/Cloud Interconnect, hybrid cloud connectivity, and cloud-to-datacenter network integration

Company

Boson AI

twittertwittertwitter
company-logo
Boson AI is an AI company that develops large language model tools.
dateFounded in 2023
location
Santa Clara, California, USA
people-size11-50 employees
web-link
https://boson.ai/

H1B Sponsorship

Boson AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (4)
2024 (7)
2023 (2)

Funding

Current Stage
Early Stage

Leadership Team

leader-logo
Alex Smola
CEO & Cofounder
linkedin
leader-logo
Mu Li
Co-Founder & CTO
linkedin
Company data provided by crunchbase