AI Quality Analyst – Portuguese (Remote)

About the role

We are seeking a detail‑oriented AI Quality Analyst to evaluate Portuguese language interactions generated by our conversational AI systems. This full‑time, remote position focuses on ensuring personalized, accurate, and helpful responses.

Key responsibilities

• Design and execute conversational prompts to assess AI interactions.
• Evaluate how well AI models use personal context to generate relevant responses.
• Assess model outputs for grounding, personalization accuracy, integration quality, and overall helpfulness.
• Compare and rank AI‑generated responses using predefined criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural response behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper use of available data sources.
• Maintain data quality standards and follow project guidelines throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and excellent written communication skills.
• Ability to objectively evaluate nuanced and ambiguous AI responses.
• Comfortable working independently in a remote environment with full‑time availability (30‑40 hours/week) and a stable internet connection.

Required skills

What we offer

• Short‑term contract (2 months) with the possibility of extension.
• Competitive hourly rate of $15 USD.
• Fully remote work with flexible scheduling.