Tether.io · 4 months ago
Senior AI Research Engineer, Model Inference (Remote)
United States
Full-time
Remote
Senior LevelTether.io is pioneering a global financial revolution with their innovative digital finance solutions. They are seeking a Senior AI Research Engineer to optimize model inference and fine-tuning for language models, focusing on GPU acceleration and mobile applications.
BitcoinBlockchainCryptocurrencyDecentralized Finance (DeFi)FinanceFinancial ServicesFinTechSoftware
Responsibilities
Implement and optimize custom inference and fine-tuning kernels for small and large language models across multiple hardware backends
Implement and optimize full and LoRA fine-tuning for small and large language models across multiple hardware backends
Design and extend datatype and precision support (int, float, mixed precision, ternary QTypes, etc.)
Design, customize, and optimize Vulkan compute shaders for quantized operators and fine-tuning workflows
Investigate and resolve GPU acceleration issues on Vulkan and integrated/mobile GPUs
Architect and prepare support for advanced quantization techniques to improve efficiency and memory usage
Debug and optimize GPU operators (e.g., int8, fp16, fp4, ternary)
Integrate and validate quantization workflows for training and inference
Conduct evaluation and benchmarking (e.g., perplexity testing, fine-tuned adapter performance)
Conduct GPU testing across desktop and mobile devices
Collaborate with research and engineering teams to prototype, benchmark, and scale new model optimization methods
Deliver production-grade, efficient language model deployment for mobile and edge use cases
Work closely with cross-functional teams to integrate optimized serving and inference frameworks into production pipelines designed for edge and on-device applications. Define clear success metrics such as improved real-world performance, low error rates, robust scalability, optimal memory usage and ensure continuous monitoring and iterative refinements for sustained improvements
Qualification
Required
Deep expertise in kernel development, model optimization, fine-tuning, and GPU acceleration
Hands-on experience with quantization techniques
Experience with LoRA architectures
Experience with Vulkan backend
Experience with mobile GPU debugging
Proficiency in C++ and GPU kernel programming
Proven expertise in GPU acceleration with Vulkan framework
Strong background in quantization and mixed-precision model optimization
Experience and expertise in Vulkan compute shader development and customization
Familiarity with LoRA fine-tuning and parameter-efficient training methods
Ability to debug GPU-specific performance and stability issues on desktop and mobile devices
Hands-on experience with mobile GPU acceleration and model inference
Familiarity with large language model architectures (e.g., Qwen, Gemma, LLaMA, Falcon etc.)
Experience implementing custom backward operators for fine-tuning
Experience creating and curating custom datasets for style transfer and domain-specific fine-tuning
Demonstrated ability to apply empirical research to overcome challenges in model
Company
Tether.io
Tether has evolved to meet global needs with agility and vision.
Founded in 2014
201-500 employees
Funding
Current Stage
Growth StageLeadership Team
Simon McWilliams
Chief Financial Officer
Recent News
2026-01-12
2026-01-11
2026-01-07
Company data provided by crunchbase