Portuguese Content Analyst – Remote

About the role

This remote, short‑term contract role focuses on evaluating AI‑generated conversational content in Portuguese. You will help ensure that AI responses are personalized, accurate, and helpful by reviewing and ranking model outputs against defined criteria.

Key responsibilities

• Design and execute conversational prompts to test personalized AI interactions.
• Assess how well AI models use personal context to generate relevant responses.
• Evaluate model outputs for grounding, personalization accuracy, integration quality, and overall helpfulness.
• Compare and rank AI‑generated responses side‑by‑side using predefined evaluation criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural response behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper use of available data sources.
• Maintain data quality standards and follow project guidelines throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking and attention to detail.
• Excellent written communication skills.
• Ability to evaluate nuanced and ambiguous AI responses objectively.
• Comfortable working independently in a remote environment with a stable internet connection.

Required skills

• Desktop or laptop computer with reliable internet access.