First Soft Solutions LLC · 2 months ago
Machine Learning Engineer, LLM Fine-Tuning
San Jose, CA
Full-time
Onsite
Senior Level, Lead/Staff
10+ years expFirst Soft Solutions LLC is actively hiring for a Machine Learning Engineer specializing in LLM Fine-Tuning. The role involves owning the technical roadmap for Verilog/RTL-focused LLM capabilities, leading a team of applied scientists and engineers, and designing privacy-first ML pipelines on AWS.
Information Technology & Services
Responsibilities
Own the technical roadmap for Verilog/RTL‑focused LLM capabilities—from model selection and adaptation to evaluation, deployment, and continuous improvement
Lead a hands‑on team of applied scientists/engineers: set direction, unblock technically, review designs/code, and raise the bar on experimentation velocity and reliability
Fine‑tune and customize models using state‑of‑the‑art techniques (LoRA/QLoRA, PEFT, instruction tuning, preference optimization/RLAIF) with robust HDL‑specific evals:
Compile‑/lint‑/simulate‑based pass rates, pass@k for code generation, constrained decoding to enforce syntax, and “does‑it‑synthesize” checks
Design privacy‑first ML pipelines on AWS:
Training/customization and hosting using Amazon Bedrock (including Anthropic models) where appropriate; SageMaker (or EKS + KServe/Triton/DJL) for bespoke training needs
Artifacts in S3 with KMS CMKs; isolated VPC subnets & PrivateLink (including Bedrock VPC endpoints), IAM least‑privilege, CloudTrail auditing, and Secrets Manager for credentials
Enforce encryption in transit/at rest, data minimization, no public egress for customer/RTL corpora
Stand up dependable model serving: Bedrock model invocation where it fits, and/or low‑latency self‑hosted inference (vLLM/TensorRT‑LLM), autoscaling, and canary/blue‑green rollouts
Build an evaluation culture: automatic regression suites that run HDL compilers/simulators, measure behavioral fidelity, and detect hallucinations/constraint violations; model cards and experiment tracking (MLflow/Weights & Biases)
Partner deeply with hardware design, CAD/EDA, Security, and Legal to source/prepare datasets (anonymization, redaction, licensing), define acceptance gates, and meet compliance requirements
Drive productization: integrate LLMs with internal developer tools (IDEs/plug‑ins, code review bots, CI), retrieval (RAG) over internal HDL repos/specs, and safe tool‑use/function‑calling
Mentor & uplevel: coach ICs on LLM best practices, reproducible training, critical paper reading, and building secure‑by‑default systems
Qualification
Required
10+ years total engineering experience with 5+ years in ML/AI or large-scale distributed systems
3+ years working directly with transformers/LLMs
Proven track record shipping LLM-powered features in production and leading ambiguous, cross-functional initiatives at Staff level
Deep hands-on skill with PyTorch, Hugging Face Transformers/PEFT/TRL, distributed training (DeepSpeed/FSDP), quantization-aware fine-tuning (LoRA/QLoRA), and constrained/grammar-guided decoding
AWS expertise to design and defend secure enterprise deployments, including: Amazon Bedrock (model selection, Anthropic model usage, model customization, Guardrails, Knowledge Bases, Bedrock runtime APIs, VPC endpoints), SageMaker (Training, Inference, Pipelines), S3, EC2/EKS/ECR, VPC/Subnets/Security Groups, IAM, KMS, PrivateLink, CloudWatch/CloudTrail, Step Functions, Batch, Secrets Manager
Strong software engineering fundamentals: testing, CI/CD, observability, performance tuning; Python a must (bonus for Go/Java/C++)
Demonstrated ability to set technical vision and influence across teams; excellent written and verbal communication for execs and engineers
Preferred
LLM Fine‑Tuning (Verilog/RTL Applications)
AWS (primary; Bedrock + SageMaker)
Company
First Soft Solutions LLC
When you hire First Soft Solutions, you're hiring a strategic technology consulting partner committed to helping you meet your unique business and technology objectives on time, on budget and with an optimal experience.
51-200 employees
H1B Sponsorship
First Soft Solutions LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (3)
2023 (5)
2022 (9)
2021 (11)
2020 (11)
Funding
Current Stage
Growth StageCompany data provided by crunchbase