Job

Expert Talent Pool, Evals and Benchmarks (Associate)

Clera Clera offers roles in legal evaluation of AI systems and ML internship opportunities

Remote, full-time role designing and running human-led evaluations of AI models. Open to candidates worldwide with strong evaluation and data-analysis skills.

Open to Rwandans

At a glance

Deadline
Location
Remote
Salary
30 – 60 USD / hour
Paid
Yes
Employment type
Full Time
Minimum years of experience
5
Listed

About this opportunity

Clera is seeking a mid-level specialist to join a team that designs and runs human-led evaluations of AI models. You’ll help measure model capabilities by creating rigorous questions, rubrics, and comparative assessments, contributing to a clearer understanding of AI performance.

This is a fully remote, full-time position with project lengths ranging from one week to several months. Compensation ranges from $30 to $60 per hour, depending on the project, field, and experience.

Candidates should be prepared to write test questions, develop scoring rubrics, create reference answers, and grade model outputs against criteria. You will also analyze error patterns, compare models using identical prompts, and validate benchmarks.

Strong candidates bring experience in QA, assessment design, data analysis, or related fields, excellent written communication, and comfort using tools like spreadsheets or Python. Familiarity with evaluation tools (Inspect, lm-eval-harness, HELM, promptfoo) is helpful but not required.

What you get

  • Salary: USD 30 - 60 per hour
  • Fully remote work
  • Project-based compensation
  • Flexible project durations (one week to several months)

Responsibilities

  • Write questions and tasks that test model capabilities
  • Develop rubrics that define strong, partial, and weak answers
  • Create reference answers and edge-case scenarios
  • Grade model outputs against rubrics and explain scores
  • Analyze incorrect answers and document error patterns
  • Compare multiple models using the same prompts
  • Validate benchmarks and flag unreliable questions
  • Support small studies of evaluation methods and user interactions

Requirements

  • Zero to five years of professional experience; prior AI-data work not required
  • Experience or training in QA, test engineering, assessment design, psychometrics, UX research, data analysis, ML evaluation, or related areas
  • Experience writing test cases, exam questions, rubrics, or evaluation tasks
  • Ability to use spreadsheets or Python to organize and analyze results
  • Experience with evaluation tools such as Inspect, lm-eval-harness, HELM, or promptfoo is useful but not required
  • Clear, professional written communication

How to apply

  • Apply through the listing page or the official application link if provided
  • Prepare a resume/CV highlighting evaluation design and data-analysis experience
  • Include any prior work with QA, rubrics, or model evaluation if available

Ready to apply?

59days left
Deadline
Apply on the official site

WorkInRwanda never asks for money to apply. If anyone does, report it. Report this listing

About Clera

Clera is involved in legal and artificial intelligence work, offering roles that blend EU law expertise with AI evaluation. The listings indicate remote opportunities available worldwide and focus on senior legal professionals with EU knowledge as well as entry-level ML work.

See everything from Clera
59 days left Apply