06 sep
|
Innodata
|
Chile
About the Role
We are seeking detail-oriented Content Evaluators to test, review, and benchmark AI-generated customer support interactions across major platforms .
In this role, you will evaluate AI model outputs against strict evaluation rubrics and authoritative business knowledge bases to help improve the quality, accuracy, and natural tone of next-generation customer support LLMs.
Key Responsibilities
- Evaluate AI Outputs: Review and score AI-generated customer support conversations for accuracy, tone, compliance, faithfulness, and correct agent handoff.
- Fact-Checking & Verification: Verify customer intents and factual responses against business FAQs, product catalogs, SOPs, and official documentation to detect hallucinations or errors.
- Quality & Alignment: Participate in dual-review sessions and daily calibration audits to maintain high scoring consistency.
- Timely Delivery:
Complete assigned evaluations accurately within the project's required turnaround time (TAT).
Qualifications & Skills
- Education: Minimum of a Bachelor's Degree in any discipline.
- Language Proficiency: Native or Professional Proficiency in Spanish, along with excellent written English skills.
Assessment Process To be considered for onboarding, candidates must complete two pre-onboarding assessments specific to this project to evaluate rubric alignment and attention to detail.
"Please note that the organization follows a strict no-fee recruitment policy and does not request any payment from candidates at any stage of the hiring process, including through third-party agencies or consultants. Candidates are advised to immediately report any such payment requests in connection with employment opportunities, as they are unauthorized and fraudulent."
📌 Content Evaluator – Customer Support & LLM Benchmarking (Chile)
🏢 Innodata
📍 Chile