Brazilian Portuguese - AI Model Rater

Accountabilities

• Test and evaluate AI chatbots and language models through structured conversations using assigned goals, prompts, and evaluation criteria.
• Assess AI-generated responses for quality, relevance, helpfulness, safety, linguistic accuracy, and overall effectiveness.
• Interact with AI systems in Brazilian Portuguese and provide insights that can help improve their ability to understand and communicate naturally in the language.
• Participate in voice-based AI evaluation projects when required, including recorded sessions that may be shared with project clients as part of the deliverables.
• Submit accurate project deliverables such as written evaluations, ratings, screenshots, audio recordings, or other materials specified in the applicable project instructions.
• Ask thoughtful follow-up questions and probe AI models effectively to evaluate their capabilities and limitations.
• Follow project-specific guidelines and Statements of Work (SOWs) carefully while maintaining consistent evaluation standards.
• Communicate promptly with project teams and complete assigned tasks within required timelines.
• Adapt to different AI evaluation projects as assignments become available, including projects involving written, voice, or video-based interactions.

Requirements

• Native or expert-level proficiency in Brazilian Portuguese, equivalent to approximately C2 level under the CEFR.
• Strong English reading, writing, and communication skills, with an assessment potentially required during the selection process.
• At least 18 years of age.
• Hands-on experience using AI models, generative AI tools, or large language models.
• Comfortable communicating through both written and spoken interactions, with the ability to ask clear, precise, and insightful follow-up questions.
• Strong attention to detail and the ability to evaluate language and AI responses objectively against defined criteria.
• Comfortable using web-based tools and completing structured digital tasks independently.
• Access to your own smartphone, computer or laptop, and reliable internet connection.
• Willingness to complete language proficiency assessments and an AI evaluation task as part of the onboarding process.
• Strong responsiveness and communication skills, particularly when receiving project or onboarding updates.
• Ability to begin work within approximately 48 hours of being contacted.
• Comfortable completing tasks that may involve voice or short video recordings, depending on project requirements.
• Ability to successfully complete required identity verification before engagement.

Benefits

• $14 USD per hour for completed project work.
• Fully remote work that can be performed from Brazil or another eligible location outside the United States.
• Flexible scheduling, allowing you to choose which tasks to accept and when to work.
• Independent contractor engagement with the freedom to work with other clients simultaneously.
• Task-based and project-based assignments without ongoing day-to-day micromanagement.
• Opportunity to apply your Brazilian Portuguese language expertise to real-world AI development projects.
• Potential access to future projects after completing the initial application and onboarding process.
• Practical experience evaluating and improving generative AI systems.
• Clear project specifications and task requirements provided before work begins.
• Work with international teams on projects focused on language, AI evaluation, and data quality.
• Project-based flexibility, with work typically delivered in batches and the possibility of pauses between assignments.
• Equal opportunity environment welcoming contributors from diverse backgrounds and abilities.