About the role
About the Role
We are looking for a Code Reviewer with expertise in Kotlin to join our AI training QA team. You will be responsible for auditing annotator evaluations of AI-generated responses written in Kotlin. Your role will be to ensure technical correctness, instruction adherence, proof-of-work validation, and consistent application of evaluation rubrics.
Responsibilities
-
Audit annotator evaluations of AI-generated Kotlin responses
-
Verify if responses follow prompt requirements regarding Kotlin syntax, null safety, and idiomatic structure.
-
Evaluate Kotlin code for correctness, performance, security, and readability
-
Run and validate proof-of-work code submitted by annotators to confirm functionality
-
Review annotator-submitted Loom videos to assess evaluation and testing accuracy
-
Ensure responses align with instruction-following expectations including style, tone, and clarity
-
Identify and document errors, omissions, or rating inconsistencies
-
Provide clear, constructive QA feedback based on rubric and guideline criteria
-
Collaborate with internal teams for clarifications on complex or ambiguous items Required Qualifications
-
5–7+ years of experience in Kotlin development, QA, or code review
-
Strong understanding of core Kotlin concepts and development best practices
-
Experience with debugging, testing tools, and code execution environments
-
Strong analytical and critical thinking skills
-
Excellent written communication for documenting evaluations and feedback
-
English proficiency at B2, C1, C2, or Native level Preferred Qualifications
-
Experience with AI/LLM workflows, human-in-the-loop QA, or model evaluation
-
Familiarity with structured code evaluation processes and rubrics
-
Experience using QA/annotation platforms such as SuperAnnotate Why Join Us
Join a forward-thinking team shaping how AI learns to understand and write Kotlin code. Your expertise will directly influence the quality, reliability, and instructional value of AI-generated content. This is a fully remote role offering flexible hours, milestone-based structure, and competitive compensation.
Similar Jobs
About the role
About the Role
We are looking for a Code Reviewer with expertise in Kotlin to join our AI training QA team. You will be responsible for auditing annotator evaluations of AI-generated responses written in Kotlin. Your role will be to ensure technical correctness, instruction adherence, proof-of-work validation, and consistent application of evaluation rubrics.
Responsibilities
-
Audit annotator evaluations of AI-generated Kotlin responses
-
Verify if responses follow prompt requirements regarding Kotlin syntax, null safety, and idiomatic structure.
-
Evaluate Kotlin code for correctness, performance, security, and readability
-
Run and validate proof-of-work code submitted by annotators to confirm functionality
-
Review annotator-submitted Loom videos to assess evaluation and testing accuracy
-
Ensure responses align with instruction-following expectations including style, tone, and clarity
-
Identify and document errors, omissions, or rating inconsistencies
-
Provide clear, constructive QA feedback based on rubric and guideline criteria
-
Collaborate with internal teams for clarifications on complex or ambiguous items Required Qualifications
-
5–7+ years of experience in Kotlin development, QA, or code review
-
Strong understanding of core Kotlin concepts and development best practices
-
Experience with debugging, testing tools, and code execution environments
-
Strong analytical and critical thinking skills
-
Excellent written communication for documenting evaluations and feedback
-
English proficiency at B2, C1, C2, or Native level Preferred Qualifications
-
Experience with AI/LLM workflows, human-in-the-loop QA, or model evaluation
-
Familiarity with structured code evaluation processes and rubrics
-
Experience using QA/annotation platforms such as SuperAnnotate Why Join Us
Join a forward-thinking team shaping how AI learns to understand and write Kotlin code. Your expertise will directly influence the quality, reliability, and instructional value of AI-generated content. This is a fully remote role offering flexible hours, milestone-based structure, and competitive compensation.