Job
Expert Talent Pool, Evals and Benchmarks (Associate)
Clera Clera offers roles in legal evaluation of AI systems and ML internship opportunities
Remote, full-time role designing and running human-led evaluations of AI models. Open to candidates worldwide with strong evaluation and data-analysis skills.
At a glance
- Deadline
- Location
- Remote
- Salary
- 30 – 60 USD / hour
- Paid
- Yes
- Employment type
- Full Time
- Minimum years of experience
- 5
- Listed
About this opportunity
Clera is seeking a mid-level specialist to join a team that designs and runs human-led evaluations of AI models. You’ll help measure model capabilities by creating rigorous questions, rubrics, and comparative assessments, contributing to a clearer understanding of AI performance.
This is a fully remote, full-time position with project lengths ranging from one week to several months. Compensation ranges from $30 to $60 per hour, depending on the project, field, and experience.
Candidates should be prepared to write test questions, develop scoring rubrics, create reference answers, and grade model outputs against criteria. You will also analyze error patterns, compare models using identical prompts, and validate benchmarks.
Strong candidates bring experience in QA, assessment design, data analysis, or related fields, excellent written communication, and comfort using tools like spreadsheets or Python. Familiarity with evaluation tools (Inspect, lm-eval-harness, HELM, promptfoo) is helpful but not required.
What you get
- Salary: USD 30 - 60 per hour
- Fully remote work
- Project-based compensation
- Flexible project durations (one week to several months)
Responsibilities
- Write questions and tasks that test model capabilities
- Develop rubrics that define strong, partial, and weak answers
- Create reference answers and edge-case scenarios
- Grade model outputs against rubrics and explain scores
- Analyze incorrect answers and document error patterns
- Compare multiple models using the same prompts
- Validate benchmarks and flag unreliable questions
- Support small studies of evaluation methods and user interactions
Requirements
- Zero to five years of professional experience; prior AI-data work not required
- Experience or training in QA, test engineering, assessment design, psychometrics, UX research, data analysis, ML evaluation, or related areas
- Experience writing test cases, exam questions, rubrics, or evaluation tasks
- Ability to use spreadsheets or Python to organize and analyze results
- Experience with evaluation tools such as Inspect, lm-eval-harness, HELM, or promptfoo is useful but not required
- Clear, professional written communication
How to apply
- Apply through the listing page or the official application link if provided
- Prepare a resume/CV highlighting evaluation design and data-analysis experience
- Include any prior work with QA, rubrics, or model evaluation if available
Ready to apply?
WorkInRwanda never asks for money to apply. If anyone does, report it. Report this listing
About Clera
Clera is involved in legal and artificial intelligence work, offering roles that blend EU law expertise with AI evaluation. The listings indicate remote opportunities available worldwide and focus on senior legal professionals with EU knowledge as well as entry-level ML work.
See everything from Clera