AI Infrastructure Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

BNY · 2 days ago

AI Infrastructure Engineer

BNY is a leading global financial services company that influences nearly 20% of the world’s investible assets. They are seeking an AI Infrastructure Engineer to join their Technology team, where the role involves managing enterprise-grade AI infrastructure, deploying AI workloads, and automating operations to enhance platform reliability.

Financial Services

Responsibilities

Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale
Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:AI and NVIDIA BCM
Own the observability of our AI platforms—monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity
Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation
Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads

Qualification

NVIDIA AI infrastructureKubernetesDockerPythonLinux administrationCI/CD workflowsInfrastructure automationCloud platformsAnalytical skillsCommunication skills

Required

Bachelor's degree in computer science or a related discipline, or equivalent work experience required
8-10 years of related experience required
Experience with Linux administration (RHEL/Ubuntu), shell scripting, and system-level debugging
Proven experience running distributed systems in Kubernetes and containerized environments using Docker
Familiarity with GPU resource management, including NVIDIA GPU Operator and device plugin lifecycle
Experience with CI/CD workflows and infrastructure automation tools such as GitLab CI, Jenkins, Terraform, Helm, or Ansible
Knowledge of networking fundamentals and persistent storage systems
Exposure to cloud platforms (AWS, GCP, Azure) and hybrid GPU environments
Ability to read and support Python code focused on ML/AI pipeline integration
Strong analytical and troubleshooting skills with a collaborative mindset
Effective communication skills and proactive ownership of platform reliability and performance

Preferred

advanced degree preferred
experience in the securities or financial services industry is a plus

Benefits

Highly competitive compensation
Benefits
Wellbeing programs
Generous paid leaves
Paid volunteer time

Company

We help make money work for the world — managing it, moving it and keeping it safe.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Brian A. Ruane
CEO Government Securities Services & Global Client Management
linkedin
leader-logo
Chris Kearns
CEO, Depositary Receipts
linkedin
Company data provided by crunchbase