Portuguese AI Quality Analyst (Remote, $15/hr)

About the role

We are seeking a Portuguese-speaking AI Quality Analyst to join our remote team on a short‑term contract. You will evaluate AI‑generated conversational responses, ensuring they are personalized, accurate, and helpful.

Key responsibilities

• Design and execute prompts to test personalized AI interactions.
• Assess how well AI models use personal context to generate relevant replies.
• Evaluate model outputs for grounding, personalization accuracy, integration quality, and overall helpfulness.
• Compare and rank AI responses using predefined criteria, identifying hallucinations, flawed inferences, incorrect personalization, and unnatural behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper use of data sources.
• Maintain data quality standards throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and excellent written communication.
• Ability to evaluate nuanced and ambiguous AI responses objectively.
• Comfortable working independently in a remote environment with full‑time availability (30‑40 hours/week, including 4 hours overlap with PST).
• Access to a desktop or laptop with a stable internet connection.

Required skills

What we offer

• Short‑term contract (2 months) with a competitive rate of $15.3 USD per hour.
• Fully remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge conversational AI development.