This job has closed.

Damco Solutions · 2 months ago

AI Research Engineer / Data Scientist (LLM)

Morristown, NJ

Full-time

Onsite

Mid, Senior Level

4+ years exp

Damco Solutions is seeking an AI Research Engineer / Data Scientist specializing in LLM systems. The role involves owning the end-to-end delivery of LLM systems, driving architecture and evaluation strategy, and mentoring junior team members while collaborating with product and stakeholders.

Enterprise SoftwareInformation TechnologyInsuranceSoftwareSoftware EngineeringWeb Development

H1B Sponsor Likely

Responsibilities

Lead POC → pilot → production for LLM/agent solutions (tool/function calling, planning, fallbacks)

Architect retrieval stacks (chunking strategies, hybrid search, metadata, re-ranking) and hallucination controls

Design offline + online evaluations, golden sets, CI eval gates, and experiment frameworks for correctness, faithfulness, safety, and bias

Implement confidence scoring and calibration (retrieval/LLM agreement, self-consistency, logprobs/entropy) with abstain/deferral and user-visible citations

Optimize cost/latency/reliability (caching, batching, routing, distillation/quantization where useful)

Stand up secure APIs/services with observability, tracing, RBAC, and audit logs; uphold privacy and compliance requirements

Advise on prompting vs. fine-tuning/LoRA; own model and vendor selection and trade-offs

Mentor teammates; collaborate on roadmaps and stakeholder-facing KPIs

Qualification

LLM applicationsEval strategyPython engineeringCloud experienceRetrieval experienceConfidence scoringContainersObservabilityDomain expertiseMentoringCollaboration

Required

4–8+ years in applied ML/data/engineering, with shipped LLM applications (RAG, agent/tool calling, structured extraction, domain QA)

Demonstrated ownership of eval strategy (golden sets, pass/fail thresholds, A/B) and integration of eval gates into CI/CD

Hands-on confidence & calibration techniques and production abstention/deferral policies

Deep retrieval experience (hybrid search, filters, re-ranking, chunking) and mitigation of hallucinations

Strong Python engineering (FastAPI), SQL/data wrangling, containers, and observability (logs/spans/metrics)

Cloud experience (Azure/AWS/GCP) and vector/search tech (e.g., Azure AI Search, Elasticsearch, Pinecone/FAISS)

Track record of taking ambiguous business problems to measurable outcomes and shipping on timelines

Preferred

Fine-tuning/LoRA, prompt routing, multi-agent orchestration (planner/critic/tool catalogs)

Advanced uncertainty: calibration curves, conformal methods, or LLM-as-a-judge with safeguards

Distillation/quantization and model serving efficiency; GPU/CPU trade-offs

Document AI (layout-aware models, VLMs), Snowflake/Databricks, Airflow/Prefect

Safety/compliance leadership (red-teaming playbooks, model cards, DPIA/PIA inputs)

Domain expertise (e.g., insurance/finance/healthcare) and regulated data handling

Company

Damco Solutions

Glassdoor3.9

Damco Solutions is a provider of IT solutions, services, and products.

Founded in 1996

Plainsboro, New Jersey, USA

1001-5000 employees

https://www.damcogroup.com/

H1B Sponsorship

Damco Solutions has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (5)

2024 (8)

2023 (13)

2022 (11)

2021 (4)

2020 (7)