Veracity Software Pvt. Ltd. ยท 4 months ago
Data scientists, AI engineering, LLM engineer, Machine Learning Engineers
Charlotte, NC
Full-time
Onsite
Mid, Senior LevelVeracity Software Pvt. Ltd. is seeking Data Scientists and Machine Learning Engineers to work on innovative AI projects within the banking and financial domain. The role involves implementing a chatbot for internal use, leveraging LLMs, and managing data using advanced technologies and frameworks.
Information Technology & Services
Responsibilities
Implemented a chatbot internally with the bank, build interface and now users can interact
It's a RAG framework so instead of tuning it into the actual applications you can prompt it to give you prevectorized queries
Able to feed it documents even if they don't know what your team is or who you are. Should have 1000 users by the end of the year and another 2000 next year
Qualification
Required
Experience with major LLMs, specifically Llama 3, Mistral, and possibly 'Quinn.'
Direct experience with VLLM (an inference engine) is a perfect match
Experience with Nvidia Triton is a 'big bonus'
Python: A mandatory skill, experience with Python 3.12 or 3.10 and above
Knowledge of Flask or FastAPI is required
Java: A 'secondary preferred' skill
Experience with Redis and other vector databases is essential
SQL: Required
Understanding how to handle the business-side parameters from the product team
Knowledge of containers and OpenShift (a Kubernetes platform) for CI/CD
Experience with XLR and Datical for pipeline deployments is required
A solid understanding of GPUs is necessary
The team uses Agile methodology
Preferred
Based on exp, likes to dig deep on exp
General awareness of Vector DB as opposed to relational and others
Pushing code to a controlled environment and seeing something go into production
Any model experience they have had professionally, some quantitative models in the past or have written white papers before
Company
Veracity Software Pvt. Ltd.
At Veracity, if you have an idea you want to validate, a product you need to build, or an existing product that needs optimization, our teams are trained to jump in wherever needed.
Founded in 2010
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase