AI Evaluator — Shopping Assistant

AI Evaluator — Shopping Assistant

Engagement: Independent Contractor
Work Arrangement: Remote
Compensation: $40/hour
Workload: 20+ hours per week

About the Opportunity

We are looking for AI Evaluators to assess the accuracy, usefulness, and reasoning of a digital shopping assistant across real-world e-commerce interactions.

You will review user conversations, identify errors and weaknesses in the assistant's responses, and develop structured evaluation criteria that can be used to measure and improve response quality.

What You'll Do

• Review real user interaction traces with an AI shopping assistant.

• Identify inaccurate, illogical, incomplete, or unhelpful responses.

• Evaluate the quality and relevance of product recommendations.

• Analyze conversations to identify specific reasoning or response failures.

• Create structured rubrics for consistently evaluating future responses.

• Develop verifiers to assess response quality against defined criteria.

• Complete evaluation work through the internal platform for 20+ hours per week.

Who Should Apply

This role is suited to professionals with experience in areas such as:

• AI evaluation or AI training

• Data evaluation or annotation

• Quality assurance

• E-commerce

• Prompt engineering

• Software testing

You should have strong analytical and attention-to-detail skills, be comfortable deeply reviewing text-based interactions, and be able to develop structured evaluation frameworks.

Requirements

• Experience in data evaluation, quality assurance, AI training, or a related field.

• Strong ability to identify subtle errors and inconsistencies in written responses.

• Familiarity with e-commerce search and digital shopping experiences.

• Ability to analyze AI-generated responses critically.

• Ability to commit to 20+ hours per week on an ongoing basis.

Engagement & Payment

• Independent contractor engagement.

• Fully remote, with work completed on your own schedule.

• $40/hour, paid weekly based on services rendered.

• Engagements may be extended, shortened, or concluded early depending on project needs and performance.

• Work must not involve confidential or proprietary information belonging to any employer, client, or institution.

• H-1B and STEM OPT candidates cannot be supported at this time.

Apply

If you have experience in AI evaluation, quality assurance, e-commerce, data annotation, prompt engineering, or software testing and can commit 20+ hours per week, this remote opportunity offers the chance to directly contribute to improving an AI-powered shopping assistant.

$40/hour | Remote | 20+ hours/week | Independent Contractor