Behavioral Health Expert, AI Safety and Model Evaluation
Help a leading AI lab ensure its models respond to people with care, balance and sound judgment.
- Pay
- Firm hourly pay: $45-$70 per hour
- Location
- United States
- Eligibility
- Remote; check the U.S. location wording
- Qualification difficulty
- Selective
How current is this information?
The public role and application path were checked. Details can still change; this is not an endorsement or guarantee.
- Platform
- Mercor
- Fit category
- General professional
- Listing/source checked
- Oct 3, 2026
- Inventory presence checked
- Nov 16, 2026
- Apply link checked
- Oct 3, 2026
Application
Continue to the current Mercor listing
Apply on MercorOpens the current Mercor page in a new tab. This may be a referral link, and Specialist AI Work may be paid if the platform credits it. That does not change the role's advertised pay or how roles are ordered here.
What this role involves
Help a leading AI lab ensure its models respond to people with care, balance and sound judgment. 1. Overview A leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle sensitive, everyday conversations. People increasingly turn to AI for support with relationships, family dynamics, emotional wellbeing, personal beliefs and difficult life decisions.
These conversations rarely involve crisis content, but they are exactly where a model's judgment matters most: whether it stays balanced, avoids taking sides, resists telling people what they want to hear, respects a person's beliefs without endorsing or dismissing them, and understands the limits of its role. You'll review these interactions, assess whether the model's responses are appropriate, neutral and safe, and help the lab's researchers define what good looks like.
If you bring professional experience in mental health, counseling, social work or behavioral science, and you can articulate clearly why one response serves a person better than another, this role is for you. This is a part-time commitment of at least 20 hours per week, with the option to increase to up to 40 hours per week. This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce. 2.
Key Responsibilities
Evaluate conversations between users and AI models across topics such as relationship and family advice, emotional wellbeing, spiritual and metaphysical questions, and unconventional or unfounded beliefs, and assess whether responses are neutral, appropriate and safe. Identify patterns of concern, including excessive agreement, taking sides, reinforcing distorted or unfounded beliefs, moralizing, or overstepping into clinical or directive advice, and document them with clear written rationale.
Develop rubrics, guidelines and reference responses that define a balanced, supportive and appropriately bounded reply, grounded in established practice from counseling and behavioral health. Design test scenarios and conversations that probe how models handle sensitive but non crisis topics. Collaborate with the lab's researchers and fellow experts to keep evaluation standards consistent, calibrated and well documented. 3.
Core Qualifications A degree in psychology, counseling, social work, behavioral health, behavioral science, human services or a closely related field, or equivalent professional experience in the mental health field. 3+ years of professional experience supporting people in a mental health, counseling or social services setting, for example as a therapist, counselor, clinical social worker, psychologist, psychiatric nurse, case manager, crisis counselor, peer support specialist or mental health advocate.
Before you apply
Review the main fit signals and unresolved details before opening the platform.
Why it may fit
- Professionals whose experience matches the current Behavioral Health Expert, AI Safety and Model Evaluation requirements.
- Applicants comfortable completing Mercor's role-specific assessment.
Check before applying
Reasons to pause
- You cannot meet the listing's stated remote or location eligibility.
- You need guaranteed acceptance, hours, or project duration.
Still to verify
- Review the official Mercor listing before applying. Requirements, screening, pay, hours, and project availability can change.
- The reviewed listing had limited public detail; check the current platform page for the full requirements.
What to prepare
- Complete Mercor's role-specific application or assessment.
Role tools
Where these choices are saved
Save, Not for me, Compare, and application tracking remain in this browser.
Application tips
- Complete Mercor's role-specific application or assessment carefully.
- Review the current Mercor listing and its eligibility details before applying.