Repo-based Code Annotator
- Build reproducible, standardized test environments using Docker images to accurately replicate known issues or generate expected outputs according to specified procedures.
- Pay
- Variable/qualified pay: USD $80 - 120/Day, dependent on actual skills and experience
- Location
- Worldwide
- Eligibility
- Remote worldwide
- Qualification difficulty
- Selective
How current is this information?
The public role and application path were checked. Details can still change; this is not an endorsement or guarantee.
- Platform
- REX / RemoExperts
- Fit category
- Software engineering
- Listing/source checked
- Sep 17, 2026
- Apply link checked
- Sep 19, 2026
Application
Continue to the current REX / RemoExperts listing
Apply on REX / RemoExpertsOpens the current REX / RemoExperts page in a new tab. This may be a referral link, and Specialist AI Work may be paid if the platform credits it. That does not change the role's advertised pay or how roles are ordered here.
What this role involves
- Build reproducible, standardized test environments using Docker images to accurately replicate known issues or generate expected outputs according to specified procedures. - Review and enhance the coverage and effectiveness of existing unit tests to assess the correctness and stability of target code. - Validate the completeness and rationality of test sets, ensuring that workflows for tasks related to SWE-Bench and Terminal-Bench are precisely aligned.
- Write high-quality task documentation (task.yaml/README), emphasizing reproducibility and standardized processes.
Before you apply
Review the main fit signals and unresolved details before opening the platform.
Why it may fit
- Required Skills:**
- Proficient in Linux command line and Shell scripting, skilled with tools like grep, sed, awk, curl, jq.
Check before applying
Reasons to pause
- The opportunity no longer appears in REX's complete public Open Opportunities inventory
- The current role does not show applicant compensation
Still to verify
- Review the current REX opportunity before applying. Country eligibility, exams, identity verification, device requirements, compensation, project availability, and task access can change by role.
What to prepare
- Use examples from your own professional experience and follow REX assessment rules
- Review the current public REX opportunity before applying because project details can change
Role tools
Where these choices are saved
Save, Not for me, Compare, and application tracking remain in this browser.
Requirements
- Proficient with Docker, including writing Dockerfiles and building reproducible environments.
- Familiar with testing frameworks like pytest, capable of writing structured unit tests and using techniques for mocking data and controlling randomness.
- Familiar with Git/GitHub workflows, able to submit high-quality, reproducible pull requests.
- Professional Background:**
- Background in Computer Science, Software Engineering, Artificial Intelligence, or related fields; or experience in roles such as Software Development, Test Engineering, DevOps, or Data Engineering.
- Contributors to open-source projects (especially in automated testing, CI/CD, containerization) are preferred.
Best for
- Proficient with Docker, including writing Dockerfiles and building reproducible environments.
Skip this if...
- You cannot meet the role-specific country, skill, device, exam, or identity requirements