Damco Solutions · 3 months ago
AI Research Engineer / Data Scientist (LLM)
Morristown, NJ
Full-time
Onsite
Mid, Senior Level
4+ years expDamco Solutions is a company seeking an AI Research Engineer / Data Scientist specializing in LLM systems. The role involves leading the delivery of LLM solutions, driving architecture and evaluation strategies, and mentoring junior team members while collaborating with stakeholders.
Enterprise SoftwareInformation TechnologyInsuranceSoftwareSoftware EngineeringWeb Development
Responsibilities
Lead POC → pilot → production for LLM/agent solutions (tool/function calling, planning, fallbacks)
Architect retrieval stacks (chunking strategies, hybrid search, metadata, re-ranking) and hallucination controls
Design offline + online evaluations, golden sets, CI eval gates, and experiment frameworks for correctness, faithfulness, safety, and bias
Implement confidence scoring and calibration (retrieval/LLM agreement, self-consistency, logprobs/entropy) with abstain/deferral and user-visible citations
Optimize cost/latency/reliability (caching, batching, routing, distillation/quantization where useful)
Stand up secure APIs/services with observability, tracing, RBAC, and audit logs; uphold privacy and compliance requirements
Advise on prompting vs. fine-tuning/LoRA; own model and vendor selection and trade-offs
Mentor teammates; collaborate on roadmaps and stakeholder-facing KPIs
Qualification
Required
4–8+ years in applied ML/data/engineering, with shipped LLM applications (RAG, agent/tool calling, structured extraction, domain QA)
Demonstrated ownership of eval strategy (golden sets, pass/fail thresholds, A/B) and integration of eval gates into CI/CD
Hands-on confidence & calibration techniques and production abstention/deferral policies
Deep retrieval experience (hybrid search, filters, re-ranking, chunking) and mitigation of hallucinations
Strong Python engineering (FastAPI), SQL/data wrangling, containers, and observability (logs/spans/metrics)
Cloud experience (Azure/AWS/GCP) and vector/search tech (e.g., Azure AI Search, Elasticsearch, Pinecone/FAISS)
Track record of taking ambiguous business problems to measurable outcomes and shipping on timelines
Preferred
Fine-tuning/LoRA, prompt routing, multi-agent orchestration (planner/critic/tool catalogs)
Advanced uncertainty: calibration curves, conformal methods, or LLM-as-a-judge with safeguards
Distillation/quantization and model serving efficiency; GPU/CPU trade-offs
Document AI (layout-aware models, VLMs), Snowflake/Databricks, Airflow/Prefect
Safety/compliance leadership (red-teaming playbooks, model cards, DPIA/PIA inputs)
Domain expertise (e.g., insurance/finance/healthcare) and regulated data handling
Company
Damco Solutions
Damco Solutions is a provider of IT solutions, services, and products.
1001-5000 employees
H1B Sponsorship
Damco Solutions has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (8)
2023 (13)
2022 (11)
2021 (4)
2020 (7)
Funding
Current Stage
Late StageLeadership Team
Mohit Gupta
CEO
Kathy Carter
Sr. Client Partner
Recent News
2025-09-17
UAE Business Review
2025-09-17
Company data provided by crunchbase