Portuguese AI Quality Analyst – Remote (Full‑time)

About the role

We are looking for a Portuguese Language Expert to join our AI Quality team on a short‑term, full‑time contract. You will work remotely, evaluating how well conversational AI models personalize responses using user context.

Key responsibilities

• Design and execute prompts to test personalized AI interactions.
• Assess model responses for relevance, grounding, personalization accuracy, and overall helpfulness.
• Compare and rank AI‑generated replies using predefined criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper data source utilization.
• Maintain data quality standards throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and excellent written communication.
• Ability to work independently in a remote environment with full‑time availability (30‑40 hrs/week, including 4 hrs overlap with PST).

Required skills

• Familiarity with prompt creation and conversational AI systems.

What we offer

• Short‑term contract (2 months) with a competitive rate of $15 USD per hour.
• Fully remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge AI personalization research.