Quality Analyst - AI & LLM Evaluation

• Quality Analyst – AI & LLM Evaluation
• Remote | United States Only | Contract Role | Immediate Openings
• Contract Duration: 16 Weeks
• Open Positions: 130
• Employment Type: Short-Term Contract
• Availability: Full-Time (8 Hours/Day)

• Role Overview
• We are hiring Quality Analysts for a remote, contract-based AI evaluation project. Selected candidates will assess and compare AI chatbot responses, identify errors and inconsistencies, and provide structured feedback to improve AI model accuracy, reliability, and overall quality.

• Key Responsibilities
• Evaluate and compare responses generated by multiple AI chatbots.
• Assess content for accuracy, relevance, clarity, completeness, and consistency.
• Identify factual errors, missing information, and quality issues.
• Provide structured feedback and detailed evaluation reports.
• Follow established quality standards and evaluation guidelines.
• Maintain high accuracy and productivity across assigned tasks.
• Escalate complex or ambiguous cases when required.

• Minimum Eligibility Requirements (Mandatory)
• Location: Must be currently residing in the United States.
• Experience: Minimum 3 years of experience in Quality Assurance, data annotation, content evaluation, testing, or related fields.
• Communication: Excellent written and verbal English communication skills.
• Analytical Skills: Strong critical thinking, attention to detail, and problem-solving abilities.
• Technical Skills: Comfortable working with AI chatbots, online evaluation tools, and digital platforms.
• Availability: Must be available full-time (8 hours daily), with at least 4 hours of overlap with Pacific Time (PST/PDT).
• Work Schedule: Five working days per week, including weekends when required, with two weekdays off.
• Preferred Qualifications
• Previous experience in AI chatbot evaluation, LLM testing, or AI data-quality projects.
• Familiarity with annotation guidelines, quality scoring, and response evaluation.
• Ability to work independently and meet deadlines.

Important: This is a 16-week, full-time contract opportunity. Candidates must meet the minimum 3-year experience requirement and be available to start immediately.

Apply now through the Intake Form to be considered for this exciting AI quality evaluation project. Apply today for immediate consideration!