HP IQ · 1 day ago
Senior Machine Learning Engineer – Fine-Tuning and On-device AI
Palo Alto, CA
Full-time
Hybrid
Mid, Senior Level
$120K/yr - $215K/yr
7+ years expHP IQ is HP’s new AI innovation lab focused on creating intelligent technologies that redefine how the world works. They are seeking a Senior Machine Learning Engineer to lead the fine-tuning, optimization, and deployment of AI models, particularly for on-device inference and intelligent decision-making systems.
Computer Software
Responsibilities
Fine-tune large language models, multimodal models, and task-specific models for orchestration, planning, and any other workflows as defined
Design and run experiments to improve task accuracy, robustness, and generalization
Explore and apply methods like full fine-tuning, LoRA, QLoRA and other types of parameter-efficient fine-tuning
Employee advanced techniques such as QAT, DPO, GRPO to further improve the model quality
Prune, quantize and compress models (e.g., INT8, INT4, mixed-precision) for CPU, GPU, NPU and edge accelerators
Optimize models for low-latency inference using frameworks like OpenVINO, ONNX Runtime, QNN etc
Build robust data pipelines for domain-specific datasets, including synthetic data generation and annotation
Define evaluation metrics. Perform evaluations and analyze results
Establish best practices for versioning, reproducibility, and continuous improvement of model performance
Develop and refine models to support multi-step reasoning, tool orchestration, and decision planning
Work with stakeholders on orchestrator architecture
Collaborate with product and research teams to design intelligent, context-aware assistant capabilities
Qualification
Required
7+ years of experience in applied machine learning, including at least 3 years in LLM fine-tuning
Proficiency in Python and ML frameworks ecosystem (HuggingFace, PyTorch)
Strong understanding of transformer architectures, attention mechanisms, and PEFT techniques
Experience with on-device inference optimization (OpenVINO, ONNX, QNN)
Familiarity with orchestration/planning architectures and techniques for AI assistants
Track record of delivering production-ready ML solutions in latency-sensitive environments
Preferred
Experience with multi-agent systems or AI assistant orchestration
Familiarity with advanced inference optimization techniques such as KV cache paging, flash attention
Knowledge about common inference engines, including but not limited to llama.cpp, vLLM
Benefits
Health insurance
Dental insurance
Vision insurance
Long term/short term disability insurance
Employee assistance program
Flexible spending account
Life insurance
Generous time off policies, including;
4-12 weeks fully paid parental leave based on tenure
11 paid holidays
Additional flexible paid vacation and sick leave (US benefits overview)
Company
HP IQ
HP IQ (formerly Humane) is HP’s new AI innovation lab focused on building an intelligent ecosystem across HP’s products and services for the future of work.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase