Meridial Marketplace, by Invisible · 1 day ago
Kotlin Expert (SME) - Freelance Project
United States
Contract
Remote
Senior Level
$25/hr - $65/hr
5+ years expMeridial Marketplace, by Invisible is seeking a highly experienced Kotlin Software Engineering professional to serve as a Subject Matter Expert (SME) on advanced software development and AI benchmarking projects. This role involves designing, documenting, and validating Kotlin-based tasks and functionalities that test and refine the coding capabilities of large language models, particularly within Android development environments.
Computer Software
Responsibilities
Define, document, and validate Kotlin-based Android functionalities used in AI benchmarking and software simulation projects
Author comprehensive functional and technical documentation, including feature requirements, system behavior, and expected outcomes
Translate open-ended requirements into realistic, well-scoped Android tasks representing genuine engineering challenges
Ensure each benchmark task is complete, verifiable, and grounded in authentic developer workflows
Maintain structured repositories of Kotlin challenges, categorized by complexity, topic, and functional type
Define Kotlin-specific quality metrics, benchmarking criteria, and rubrics aligned with Android production standards
Develop SOPs and QA frameworks enforcing stylistic consistency, idiomatic Kotlin use, and functional clarity
Conduct rigorous QA passes on deliverables — verifying code correctness, documentation completeness, and benchmark adherence
Apply quality principles to maintain dataset and code task evaluation standards
Curate gold-standard Kotlin examples representing benchmark-worthy implementations
Collaborate with recruitment and project leads to define role competencies for Kotlin contributors
Develop technical evaluation frameworks for vetting Kotlin developers, including practical code tasks and debugging exercises
Lead calibration sessions with contractors to ensure consistency and quality
Create skill matrices and capability documentation for Kotlin engineering talent aligned to benchmarking needs
Provide continuous feedback and training materials for quality improvement
Collaborate with AI research teams to design and refine Android benchmarking datasets for evaluating LLM coding performance
Source, assess, and refine Kotlin-based Android tasks testing comprehension, reasoning, and problem-solving
Document evaluation criteria including accuracy, code structure, and maintainability
Contribute to post-project analysis, surfacing insights on performance trends and task design improvements
Recommend dataset refinements to enhance domain coverage
Support project setup, scoping, and execution of Kotlin-oriented AI training and evaluation projects
Provide expert-level input on tooling, frameworks, and pipeline design (Ktor, Jetpack, Gradle, KSP)
Collaborate closely with ML engineers, QA specialists, and data annotators to meet research-grade standards
Produce summary documentation and retrospective reports detailing lessons learned and recommendations
Qualification
Required
5+ years of professional experience in Kotlin software engineering (Android, backend, or multiplatform)
Mastery of Kotlin idioms, coroutines, Flow, Jetpack Compose, and asynchronous programming
Proven ability to define and enforce technical and stylistic standards across distributed teams
Strong collaboration and communication skills with the ability to articulate complex logic clearly
Exceptional attention to detail and documentation discipline
Fluent in English, with precise writing and communication abilities
Preferred
Experience in technical documentation, benchmark dataset design, or QA of coding tasks
Benefits
Health insurance
PTO
Company
Meridial Marketplace, by Invisible
We are the AI training and scaling partner for the leading foundation model providers, enterprises, and governments, bridging the gap between AI potential and production.
5001-10000 employees
Funding
Current Stage
Late StageCompany data provided by crunchbase