Principal Architect & Lead Engineer – Enterprise AI Platforms jobs in United States
cer-icon
Apply on Employer Site
company-logo

Marvell Technology · 1 month ago

Principal Architect & Lead Engineer – Enterprise AI Platforms

Marvell Technology is a leading semiconductor solutions provider that enables new possibilities in data infrastructure. They are seeking a Principal Architect & Lead Engineer to design and build foundational architecture for enterprise AI platforms, focusing on multi-agent orchestration and model lifecycle management.

DSPInternet of ThingsManufacturingSemiconductorWireless
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Architect and lead development of core AI platform capabilities, including agent orchestration layers, memory stores, function calling frameworks, and evaluation pipelines for continuous improvement
Design scalable, microservices-based services supporting multi-agent collaboration, retrieval-augmented generation (RAG), tool and API chaining, message passing, and event-driven orchestration
Partner with the Data Office to integrate data pipelines, vector databases, feature stores, and model registries into cohesive vertical solutions
Evaluate, design, and implement model training, serving, and continuous improvement frameworks that connect seamlessly with enterprise systems
Own system architecture decisions reference implementations, and the platform roadmap, including build vs. buy assessments, model routing, and integration with third-party or open-source frameworks
Define observability, reliability and reliability baselines using Prometheus, OpenTelemetry, and Grafana to monitor agent performance, latency, and health
Lead and mentor a small, high-impact team of engineers and contractors
Define engineering standards, API design patterns, and CI/CD pipelines for platform components
Collaborate with business, product, and IT leaders to align platform capabilities with strategic goals and use cases
Serve as a trusted technical advisor to the Head of Enterprise AI & Platform on architectural strategy, scalability and platform evolution
Stay at the forefront of the evolving AI ecosystem — especially in agentic systems, distributed reasoning, and multi-model orchestration
Develop and maintain a clear point of view on architecture evolution, agent interoperability standards, and scaling patterns
Contribute to AI governance, model observability frameworks, prompt security and responsible AI design

Qualification

AI platform architectureMulti-agent orchestrationCloud-native technologiesEnterprise architecturePythonKubernetesData pipelinesModel lifecycle managementStakeholder managementSystems thinkingPragmatic visionaryCollaboration

Required

8–12+ years in software or platform engineering; 3+ years in architecture or technical lead capacity
Proven experience architecting enterprise-grade AI/ML or data platforms, ideally with components for workflow orchestration, service integration, or multi-agent coordination
Deep understanding of enterprise architecture, modular design, and security and identity frameworks (OAuth2, RBAC, SSO), and scalability across distributed environments
Hands-on experience with cloud-native technologies and modern engineering stacks (Python, Go, TypeScript, Terraform, Docker, Kubernetes, Kafka, Redis, etc.)
Familiarity with LLM orchestration frameworks and vector databases or RAG pipeline architectures
Knowledge of feature engineering, dataset versioning, and evaluation frameworks (Feast, DVC, Hydra)
Ability to balance rapid prototyping with long-term platform robustness and compliance requirements
Strong stakeholder management skills; able to communicate architectural decisions to both executives and engineers
Builder + Architect — you can design systems and build them
Systems thinker — you understand how data, models, and workflows interconnect
Collaborative — you thrive on co-creation and transparency with partners
Pragmatic visionary — ambitious about the art of the possible, grounded in the constraints of reality

Benefits

Flexible time off
401k
Year-end shutdown
Floating holidays
Paid time off to volunteer

Company

Marvell Technology

company-logo
We believe that infrastructure powers progress. That execution is as essential as innovation. That better collaboration builds better technology.

H1B Sponsorship

Marvell Technology has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (242)
2024 (186)
2023 (154)
2022 (210)
2021 (210)
2020 (165)

Funding

Current Stage
Public Company
Total Funding
unknown
2017-01-20Post Ipo Equity
2016-05-13Post Ipo Equity
2015-02-05Acquired

Leadership Team

leader-logo
Matthew Murphy
Chairman and CEO
linkedin
leader-logo
Radha Nagarajan
SVP & CTO, Optical Engineering
linkedin

Recent News

Inside HPC & AI News | High-Performance Computing & Artificial Intelligence
Company data provided by crunchbase