Veracity Software Inc ยท 4 months ago
Data scientists, AI engineering, LLM engineer, Machine Learning Engineers
Charlotte, NC
Full-time
Onsite
Mid LevelVeracity Software Inc is seeking Data Scientists and Machine Learning Engineers with expertise in AI engineering. The role involves implementing advanced AI solutions, including a chatbot for banking applications, and requires proficiency in various technologies such as LLMs and Python.
Information TechnologySaaSSoftwareTechnical SupportWeb Development
Responsibilities
Implemented a chatbot internally with the bank, build interface and now users can interact
It's a RAG framework so instead of tuning it into the actual applications you can prompt it to give you prevectorized queries
Able to feed it documents even if they don't know what your team is or who you are. Should have 1000 users by the end of the year and another 2000 next year
Qualification
Required
Experience with major LLMs, specifically Llama 3, Mistral, and possibly 'Quinn.'
Direct experience with VLLM (an inference engine) is a perfect match, as it's the core technology they are using to handle batched requests
Experience with Nvidia Triton is a 'big bonus' and a key part of their model serving infrastructure
Python: A mandatory skill. They are using Python 3.12, but experience with 3.10 and above is sufficient
Knowledge of Flask or FastAPI is required, as they are using a Python endpoint to host the LLM
Java: A 'secondary preferred' skill, used to create the REST service that interacts with the front-end UI
Experience with Redis and other vector databases is essential for the RAG component
SQL: Required
The candidate needs to understand how to handle the business-side parameters from the product team and push back if they are technically unfeasible
Knowledge of containers and OpenShift (a Kubernetes platform) for CI/CD
Experience with XLR and Datical for pipeline deployments is required
A solid understanding of GPUs is necessary, as they are the most critical and challenging component of their infrastructure
The team uses Agile methodology
The project's growth is tied to hardware availability
Preferred
General awareness of Vector DB as opposed to relational and others
Pushing code to a controlled environment and seeing something go into production. Better if it's an AI application
Any model experience they have had professionally, some quantitative models in the past or have written white papers before (required at Client)
Company
Veracity Software Inc
The definition of Veracity is accuracy and habitual truthfulness. This truly defines our brand in simplistic terms.
51-200 employees
H1B Sponsorship
Veracity Software Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (12)
2024 (13)
2023 (7)
2022 (16)
2021 (23)
2020 (29)
Funding
Current Stage
Growth StageLeadership Team
Chitra Jain
Co-Founder & CEO
Manohar Suryavanshi
Founder & President
Recent News
Help Net Security
2025-04-29
Company data provided by crunchbase