Image Annotator

Role Overview

We are looking for an experienced professional to evaluate AI-generated responses for conversational AI agents used in travel-related products. The role focuses on assessing response accuracy, relevance, completeness, and quality to improve AI performance.

Key Responsibilities

• Evaluate AI-generated responses against predefined guidelines and quality standards.
• Perform data annotation, labeling, classification, and quality reviews.
• Identify incorrect, misleading, irrelevant, or incomplete responses and potential AI hallucinations.
• Analyze evaluation data to identify recurring errors, quality gaps, and improvement opportunities.
• Track quality metrics, document findings, and recommend improvements.
• Use Excel/Google Sheets and basic SQL, where applicable, to analyze evaluation data.
• Collaborate with AI and Machine Learning teams to improve conversational AI performance.

Required Skills

• 5–8 years of experience in Data Annotation, AI Evaluation, Content Quality, Search Relevance, or Quality Assurance.
• Strong analytical, problem-solving, and attention-to-detail skills.
• Experience applying evaluation guidelines and quality standards consistently.
• Proficiency in Excel or Google Sheets.
• Good written communication and documentation skills.
• Understanding of quality metrics and data analysis.

Good to Have

• Exposure to Generative AI, LLMs, conversational AI, or AI response evaluation.
• Experience with Human-in-the-Loop (HITL), AI training data validation, or hallucination detection.
• Basic SQL knowledge.
• Experience in travel, hospitality, or search quality evaluation.