Keystone Recruitment · 13 hours ago
Software Engineer (Remote)
United States
Contract
Remote
Senior Level
$60/hr - $100/hr
5+ years expKeystone Recruitment is seeking experienced Software Engineering, Data Science, and Systems Design professionals to support the evaluation and improvement of advanced AI systems. This remote, project-based opportunity focuses on assessing AI models' reasoning about code and generating technical solutions.
Staffing & Recruiting
Responsibilities
Evaluate AI-generated responses to coding and software engineering prompts for technical accuracy, reasoning quality, and completeness
Validate code outputs through execution and structured testing
Review algorithmic correctness, system design logic, performance considerations, and edge-case handling
Identify factual errors, logical gaps, inefficiencies, or unclear explanations
Provide structured annotations and feedback aligned with defined evaluation guidelines
Apply consistent technical standards across diverse programming tasks and complexity levels
Qualification
Required
Bachelor's, Master's, or PhD in Computer Science or a closely related technical field
5+ years of professional experience in software engineering, systems design, data science, or related technical roles
Strong proficiency in at least two programming languages (e.g., Python, Java, C++, C, JavaScript, Go, Rust, Ruby, SQL, Bash, Swift, Kotlin, R, TypeScript)
Demonstrated ability to solve complex algorithmic and systems-level problems independently
Experience reviewing production-level code for quality, performance, and maintainability
Strong analytical thinking and attention to detail
Excellent written communication skills in English
Preferred
Experience with AI model evaluation, technical annotation, or structured quality review processes
Background in competitive programming or advanced algorithm design
Experience contributing to open-source projects
Ability to clearly explain complex technical concepts
Company
Keystone Recruitment
Great companies are built on strong people. At Keystone Recruitment, we identify the pivotal talent that holds your organisation together.
11-50 employeesFunding
Current Stage
Early StageCompany data provided by crunchbase