Short answer
What is the difference between data annotation and AI evaluation?
Data annotation usually labels or structures examples, while AI evaluation judges model outputs, reasoning, safety, or task quality. Some roles blend both, so read the current listing closely.
Context
Annotation roles may focus on classification, images, text, audio, or workflow labels. Evaluation roles more often ask reviewers to compare quality or explain a decision.
Current general AI evaluation examples
These current roles are examples of the kind of AI evaluation work described above. Read each listing because the actual tasks and requirements differ.
Mercor · general
Google Workspace & Business Profile Owners
$60 / hour
Micro1 · general
Data-Video Generalist (US-based)
$13 - $15 / hour
Mercor · general
Payment-posting & Reconciliation Manager
$85 / hour