Agentic AI Benchmarking and Evaluation Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Qualcomm · 1 month ago

Agentic AI Benchmarking and Evaluation Engineer

Qualcomm Technologies, Inc. is looking for talented ML/AI algorithm evaluation engineers with experience in machine learning to enable embedded GenAI and Agentic AI. In this role, you will design and implement highly optimized machine learning solutions for generative AI, collaborating with a multi-disciplinary team to evaluate ML software tools and ensure they meet quality standards.

Artificial Intelligence (AI)Generative AISoftwareTelecommunicationsWireless
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

As Agentic AI (GenAI) Benchmarking and Evaluation Engineer, you will work with world-class engineers at Qualcomm Research to evaluate ML software tools and algorithms to ensure they meet quality standards
As a member of our team, you will get a chance to learn latest cutting-edge technologies in machine learning and new emerging applications and participate in each step of the development process and drive quality improvements
You would be porting AI/ML solutions to various platforms and optimize the performance on multiple hardware accelerators (like CPU/GPU/NPU)
You’ll collaborate with members of the software teams and plan a comprehensive evaluation approach
You will work with a small team of engineers to implement the evaluation strategy, deciding key performance metrics (KPIs), developing automation, and performing qualitative tests
You will be responsible for developing a deep understanding of the ML algorithms developed in the project
You will apply tools and algorithms on wide variety of use cases, develop best practices, provide detailed analysis, extend research, and identify areas for further optimization
Perform in-depth benchmarking, and model evaluation, to ensure AI systems meet safety standards

Qualification

Machine Learning fundamentalsML algorithms implementationPyTorchTensorFlowGenerative AISoftware developmentPythonAI agent frameworksMachine learning acceleratorsInterpersonal skillsWritten communicationOral communication

Required

Exceptional software development skills with excellent analytical, development, and debugging skills
Strong understanding of Machine Learning fundamentals
Understanding of generative AI and its usage in various application
Experience with LLM, LVM, LMM models, and other NN architectures
Proficiency in designing, implementing and training ML algorithms in high-level languages/frameworks (PyTorch and TensorFlow)
Excellent interpersonal, written, and oral communications skills
Bachelor's degree in Computer Science, Engineering, Information Systems, or related field

Preferred

MS or PhD in Computer Science/Engineering with 2+ years of professional or equivalent experience
2 years of proven experience in software development for GenAI, machine learning or high-performance computing with strong programming skills in Python and software design
Familiarity with AI agent frameworks (like LangChain, LlamaIndex, Autogen)
Experience using/integrating Qualcomm AI Stack products (e.g. QNN, SNPE, QAIRT)
Experience with machine learning accelerators, optimizing algorithms for hardware acceleration cores, working with heterogeneous or parallel computing systems
Experience driving cross-functional projects, including close collaboration with AI application teams to translate product needs into evaluation frameworks
Design and develop generalized AI solutions, including RAG systems, to enhance user capabilities with our AI accelerators
Experience in Android/Linux or other embedded systems

Benefits

Competitive annual discretionary bonus program
Opportunity for annual RSU grants
Highly competitive benefits package

Company

Qualcomm

company-logo
Qualcomm designs wireless technologies and semiconductors that power connectivity, communication, and smart devices.

H1B Sponsorship

Qualcomm has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2013)
2024 (1910)
2023 (3216)
2022 (2885)
2021 (2104)
2020 (1181)

Funding

Current Stage
Public Company
Total Funding
$3.5M
1991-12-20IPO
1988-01-01Undisclosed· $3.5M

Leadership Team

leader-logo
Cristiano Amon
President & CEO
linkedin
I
Isaac Eteminan
CEO
linkedin
Company data provided by crunchbase