webAI · 3 months ago
Senior AI Software Engineer
webAI is pioneering the future of artificial intelligence by establishing a distributed AI infrastructure dedicated to personalized AI. The Senior AI Software Engineer will design and optimize inference engines for on-device applications on Apple platforms, focusing on performance and memory efficiency in high-performance computing and machine learning inference.
Computer Software
Responsibilities
Implement and optimize advanced ML architectures (Transformers, Mixture of Experts, Diffusion models) in C++, with a focus on performance and memory efficiency
Develop and fine-tune custom Metal kernels for performance-critical inference operations
Apply advanced model quantization techniques (low-bit, mixed-precision) to accelerate performance while minimizing footprint
Profile, benchmark, and tune inference on Apple Silicon (M-series, A-series), identifying and eliminating bottlenecks
Collaborate on API design and build Python bindings for C++ libraries
Contribute to robust testing frameworks to ensure reliability and performance
Qualification
Required
Bachelor's degree in CS, EE, or a related field, or equivalent experience
4+ years of professional experience in C++ systems programming
Strong understanding of computer architecture, data structures, and algorithms
Demonstrated experience with performance profiling and low-level optimization
Familiarity with deep learning concepts and architectures (Transformers, Diffusion models, Mixture of Experts)
Preferred
Deep expertise with Apple's MLX framework
Demonstrable experience writing and optimizing custom Metal kernels
Experience with model quantization techniques and their performance implications
Familiarity with the iOS/macOS development ecosystem and build systems (CMake)
Experience creating Python bindings for C++ libraries
Benefits
Competitive salary and performance-based incentives.
Comprehensive health, dental, and vision benefits package.
401k Match (US-based only)
$200/mos Health and Wellness Stipend
$400/year Continuing Education Credit
$500/year Function Health subscription (US-based only)
Free parking, for in-office employees
Unlimited Approved PTO
Parental Leave for Eligible Employees
Supplemental Life Insurance
Company
webAI
webAI is designed to streamline the training, deployment, and execution of AI models by offering a unified execution layer for AI that seamlessly integrates cloud-based services and local devices.
H1B Sponsorship
webAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (2)
Funding
Current Stage
Growth StageRecent News
Google Patent
2024-04-16
Company data provided by crunchbase