Business Domain Expert — AI Model Evaluation
Recruitment Room →Business Domain Expert — AI Model Evaluation at Recruitment Room is a contract role based in Remote · Barbados-19 (remote). The listing states pay of $124,800–$166,400 and asks for 5–15 yrs of experience. Listed skills: Admin / Business Operations, Marketing, Human Resources and Accounting. It was published on 21 August 2026 and was open at last check.
| Role | Business Domain Expert — AI Model Evaluation |
|---|---|
| Company | Recruitment Room |
| Location | Remote · Barbados-19 (remote) |
| Employment type | Contract |
| Pay (as listed) | $124,800–$166,400 |
| Experience asked | 5–15 yrs |
| Skills listed | Admin / Business Operations, Marketing, Human Resources and Accounting |
| Published | 21 August 2026 |
| Status | Open at last check |
Business Domain Expert — AI Model Evaluation Pilot
Job Type: Independent Contractor
Location: Remote
Schedule: Flexible, short-term project
Compensation: $60–$80/hour (approximately $124,800–$166,400 annualized, based on 40 hours/week)
About the Opportunity
We are seeking experienced professionals in Business Operations, Marketing, Human Resources, and Accounting to participate in a structured AI model evaluation pilot.
You will complete one realistic professional task within your area of expertise and evaluate five AI-generated attempts at the same task. Your professional judgment will help assess how effectively advanced AI models perform real-world professional work.
This is a one-time evaluation study, rather than an ongoing production role.
What You'll Do
- Sign a confidentiality agreement before receiving study materials.
- Complete one realistic, domain-specific task using the provided source materials.
- Review five AI-generated outputs for the same task.
- Rank the outputs from 1–5 with no ties.
- Score each output from 0–100 based on its quality and effectiveness.
- Write clear, evidence-based rationales referencing specific parts of each output.
- Provide structured feedback on the task and study design.
Areas of Expertise
We are looking for professionals with experience in one of these domains:
- Administration / Business Operations
- Marketing
- Human Resources
- Accounting
Time Commitment
The study requires up to 13 hours total:
- 3–10 hours to complete the assigned task.
- Approximately 2 hours to review, rank, and score the five outputs.
- Approximately 1 hour to provide feedback.
Study Requirements
- No rubric or predefined answer will be provided. Your professional judgment is the basis of the evaluation.
- The use of LLMs, AI assistants, or other AI tools is prohibited throughout the study, including while completing the task, evaluating outputs, assigning scores, or writing rationales.
- Evaluations must be based on your own professional knowledge and experience.
Requirements
- 5+ years of hands-on professional experience in at least one of the four target domains.
- Current or recent professional experience in your area of expertise.
- Strong professional judgment and ability to assess the quality of real-world business work.
- Excellent written communication skills.
- Ability to provide specific, clear, and evidence-based reasoning.
- Reliable availability to complete the study within a short turnaround window.
Eligibility Restriction
You are not eligible for this pilot if you have previously worked on Project Alchemy in any capacity, including as a task author, reviewer, domain expert, or anyone who has had access to its source-world data. Prior exposure to the material would compromise the integrity of the study.
Contract Details
- Independent contractor engagement.
- Fully remote with flexible scheduling.
- One-time, short-term evaluation project.
- Projects may be extended, shortened, or concluded early depending on requirements and performance.
- Payments are made weekly based on services rendered.
- H-1B and STEM OPT candidates are not currently supported.
- Work will not require access to confidential or proprietary information belonging to another employer, client, or institution.
Why Participate
- Apply your professional expertise to the evaluation of frontier AI models.
- Help measure how effectively AI performs realistic professional tasks.
- Contribute expert human judgment to the development of next-generation AI systems.
- Participate in emerging AI evaluation work within your area of expertise.
Ideal Candidate: An experienced professional who can independently evaluate business work, identify meaningful strengths and weaknesses, and clearly explain their judgment using specific evidence.
Create a free OnJob profile to apply and see your AI match score before you apply. · Posted 21 Aug 2026.
Business Domain Expert — AI Model Evaluation at Recruitment Room — questions answered
What does the Business Domain Expert — AI Model Evaluation role at Recruitment Room pay?
The Business Domain Expert — AI Model Evaluation at Recruitment Room listing states pay of $124,800–$166,400 for the Remote · Barbados-19 (remote) position. That figure is taken directly from the employer's own posting as published, not estimated or averaged from other roles, and the same listing asks for 5–15 yrs of experience.
Is the Business Domain Expert — AI Model Evaluation role at Recruitment Room remote?
Yes — Recruitment Room advertises this Business Domain Expert — AI Model Evaluation role as remote, tied to Remote · Barbados-19, and it is listed as contract work. Remote terms come from the employer's own posting, so confirm the expected working hours, timezone and any on-site days with Recruitment Room before you apply.
What skills does the Business Domain Expert — AI Model Evaluation role at Recruitment Room require?
The Business Domain Expert — AI Model Evaluation at Recruitment Room listing names Admin / Business Operations, Marketing, Human Resources and Accounting. Those are the skills the employer put on the posting itself, so they are the ones worth matching in your profile and covering first in an interview.
How much experience do you need for the Business Domain Expert — AI Model Evaluation role at Recruitment Room?
Recruitment Room asks for 5–15 yrs of experience on this Business Domain Expert — AI Model Evaluation posting, alongside Admin / Business Operations, Marketing and Human Resources. Employers commonly consider candidates slightly under a stated band when the listed skills line up.
Is the Business Domain Expert — AI Model Evaluation role at Recruitment Room still open?
The Business Domain Expert — AI Model Evaluation posting at Recruitment Room was open at OnJob's last check of the employer's careers page, having been published on 21 August 2026. OnJob re-checks source listings on each build and marks a role closed once it disappears, but listings can close without notice, so the employer's own page is the final word.
How do you apply for the Business Domain Expert — AI Model Evaluation role at Recruitment Room?
Apply to the Business Domain Expert — AI Model Evaluation at Recruitment Room role through OnJob with a free profile: OnJob scores your fit against the listing, shows the skills lowering that score, and submits an ATS-ready profile. Creating a profile is free and needs no card.
Explore more on OnJob
Hiring for a role like this?
Post a job on OnJob and reach AI-matched candidates.
