Taskify AI · 1 day ago
Senior Software Engineer (Remote)
United States
Contract
Remote
Mid, Senior Level
4+ years expTaskify AI is seeking a skilled Senior Software Engineer to support the evaluation and improvement of large language models. The role involves writing and debugging production-quality code, designing evaluations, and analyzing AI model behavior to enhance reliability and performance.
Higher Education
Responsibilities
Write, review, and debug production-quality code across multiple programming languages
Design coding, reasoning, and debugging tasks for AI model evaluation
Analyze AI-generated outputs to identify hallucinations, regressions, and failure patterns
Build reproducible development environments using Docker and automation tools
Develop scripts, pipelines, and tooling for data generation, scoring, and validation
Produce structured annotations, judgments, and high-quality datasets
Run systematic evaluations to improve model reliability and reasoning
Collaborate with engineers, researchers, and quality stakeholders to align on standards and continuously improve quality
Qualification
Required
Strong hands-on software engineering experience (professional or research-based) in one or more of the following: Python, JavaScript / Node.js, TypeScript
Experience with Linux, Bash scripting, and automation
Proficiency with Docker, reproducible environments, and development containers
Strong Git skills, including branching, diffs, patches, and conflict resolution
Solid understanding of testing and quality assurance practices (unit, integration, edge-case testing)
Ability to overlap a portion of working hours with Pacific Time
Preferred
Bachelor's degree in a technical field with approximately 6+ years of relevant experience
Master's degree in a technical field with approximately 4+ years of relevant experience
PhD in a technical field with approximately 2+ years of relevant experience
Equivalent practical experience will also be considered
Company
Taskify AI
While our platform provides the intelligence, our Staffing & Placement team provides the results.
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase