Coding Agent Evaluation Specialist --Brazil

Job description

• Apply and adapt coding rubrics to evaluate LLM code responses and agent trajectories (correctness, code quality, efficiency, security, tool usage)
• Run and test code, reproduce issues, and verify outcomes against test cases and acceptance criteria
• Identify and attribute errors (reasoning, implementation, tool use, environment) and write structured feedback
• Complete rubric interpretation and golden-task training; pass the post-training qualification before starting work