Data Scientist Talent Network

Accountabilities:

• Participate in future data science projects involving the evaluation, assessment, or improvement of AI-generated and human-created technical work.
• Design precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical models, machine learning pipelines, experimentation and A/B testing work, feature engineering, notebooks, and technical reports.
• Evaluate data science outputs against established criteria, ensuring assessments are technically rigorous, consistent, and evidence-based.
• Review analytical approaches, statistical reasoning, modeling decisions, experimental designs, and conclusions for accuracy and quality.
• Provide detailed written explanations supporting evaluation scores, clearly identifying strengths, weaknesses, errors, and areas for improvement.
• Apply consistent and defensible judgment when assessing complex or ambiguous technical work.
• Ensure evaluations are reproducible by grounding assessments in objective evidence and clearly defined standards.
• Incorporate structured feedback from senior reviewers and refine evaluations based on established calibration guidelines.
• Translate complex technical findings into clear, well-structured written feedback.
• Contribute subject-matter expertise to projects focused on training, evaluating, and enhancing advanced AI systems.
• Adapt to project-specific evaluation frameworks and responsibilities as priorities and requirements evolve.

Requirements

• 1+ years of professional experience in data science or a closely related analytical field.
• Experience working in a leading technology, research, quantitative, AI, or similarly rigorous environment is highly valued.
• Strong proficiency in Python and SQL, with the ability to work confidently with complex and messy real-world datasets.
• Strong knowledge of statistical modeling, machine learning, experimentation, and causal inference.
• Demonstrated ability to conduct rigorous exploratory data analysis and translate findings into actionable conclusions.
• Experience developing or evaluating machine learning pipelines, feature engineering approaches, experiments, statistical analyses, or technical reports.
• Exceptional written communication skills, with the ability to explain complex technical concepts and findings clearly and precisely.
• Strong analytical judgment and a highly detail-oriented approach to reviewing technical work.
• Ability to identify methodological issues, inconsistencies, unsupported conclusions, and technical inaccuracies.
• Ability to apply evaluation standards consistently while exercising sound professional judgment when requirements are ambiguous.
• Comfortable receiving feedback, calibrating judgment against established standards, and iterating on submitted work.
• Strong independent working skills and the ability to manage project responsibilities remotely.
• Ability to maintain objectivity and focus on evidence when evaluating technical deliverables.

Benefits

• Fully remote opportunity that can be completed from India.
• Flexible schedule, allowing you to manage project work around your own availability.
• Opportunity to contribute to projects supporting the development and improvement of advanced AI systems.
• Exposure to cutting-edge applications of AI, machine learning, data science, and human-in-the-loop evaluation.
• Opportunity to collaborate with experienced researchers, reviewers, and other technical professionals.
• Competitive compensation based on services rendered.
• Weekly payments through Stripe or Wise.
• Potential for projects to be extended, shortened, or concluded early depending on project needs and performance.
• Independent contractor engagement providing flexibility across project opportunities.
• Opportunity to apply your data science expertise to challenging evaluation and analytical problems.
• Work that focuses on professional expertise without requiring access to confidential or proprietary information from previous employers, clients, or institutions.
• Referral opportunity offering up to $600 for each successful referral, subject to applicable restrictions.
• Opportunity to help shape the development of next-generation AI systems through rigorous data science expertise.
• Please note that H-1B and STEM OPT candidates cannot be supported at this time.