AI training and LLM evaluation jobs
AI Product Evaluator
Apply on micro1 ↗View source posting ↗
AI product evaluators will run models and agents through predefined scenarios, test instruction-following, accuracy, reasoning, and responsiveness, and record anomalies in structured reports. The workflow is operationally intensive: contributors repeat evaluations around usage-limit resets and submit resulting datasets through training platforms. The source seeks people who already use AI products, can follow complex instructions precisely, and maintain consistent attention to detail. This remote contractor role is explicitly limited to applicants in India, Japan, or the United Kingdom.
Responsibilities
- Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
- Execute a series of operational tasks designed to test model accuracy, reasoning, and responsiveness.
- Document findings, observations, and any anomalies in structured written reports.
- Reset usage limits and repeat evaluations as required by project protocols.
- Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
- Maintain a high standard of attention to detail and rigor across all evaluation tasks.
Requirements
- Experience with AI products, AI models, or AI agent evaluation and testing.
- Demonstrated ability to follow complex instructions with precision and consistency.
- Exceptional attention to detail and operational thoroughness.
- Someone who already uses AI in daily life.
- Comfort working with repetitive or high-volume operational tasks within strict timeframes.
- Prior participation in digital product, software QA, or AI research projects is a plus.
- Detail-oriented, great at following instructions and documenting each step.
Eligibility
India · Japan · United Kingdom