Onsite
A Little About Us
We are a global service organization providing human evaluation and diagnostic services including content analysis and insights, testing and training data, and product quality optimization.
A Lot About You
As Content Analysts and Knowledge Engineers, we do human evaluation, content management, data analysis, training data development and evaluation for tuning models, taxonomy and tagging systems, and other information management projects for Yahoo-branded products and applications. Through structured data extraction processes, we transform unstructured data in non-semantic HTML pages into structured data using internal tools and workflows. That transformed structured data helps Yahoo create products that enhance and personalize user experiences.
Our team also plays a critical role in bridging human judgment and AI systems by supporting the development, evaluation, and continuous improvement of Large Language Models (LLMs), Machine Learning (ML) systems, and human-in-the-loop workflows.
You are both a strategic operator and people leader, capable of balancing delivery execution, operational excellence, stakeholder alignment, and team development in a fast-paced, highly cross-functional environment.
Location: Bangalore, Karnataka, India
This is a hybrid role requiring employees to work from the Bangalore office at least 3 days / week.
Your Day
Team Leadership
Lead and develop a global team of Content Analysts and Knowledge Engineers across disciplines including LLM evaluation, metrics, editorial review, QA, taxonomy, and content operations.
Manage day-to-day team operations, ensuring high-quality execution, operational consistency, and successful project delivery across multiple concurrent initiatives.
Forecast resource needs, prioritize workloads, and allocate staffing effectively to meet evolving business priorities and delivery timelines.
Establish clear operating rhythms, workflows, communication practices, and quality standards to improve efficiency, transparency, and accountability.
Provide coaching, mentorship, performance management, and career development opportunities to support team growth and progression.
Build and sustain a collaborative, inclusive, and high-trust team culture focused on continuous improvement and operational excellence.
Proactively identify and resolve team challenges, conflicts, staffing gaps, and operational risks.
Develop and optimize human-in-the-loop workflows, including assisted labeling, AI-supported evaluation, and automated quality assurance systems.
Identify opportunities to integrate AI into operational workflows to improve efficiency, consistency, scalability, and quality outcomes.
You Must Have
A BA or BS degree. Preferred fields: Linguistics, Computer Science, Library & Information Science, Information Management, or related disciplines.
7+ years of relevant professional experience, including people leadership or operational management responsibilities.
Experience managing or mentoring teams in content operations, annotation, evaluation, taxonomy, ML data workflows, or related disciplines.
Exceptional organizational, communication, and stakeholder management skills, including the ability to articulate complex technical concepts clearly and effectively.
Demonstrated ability to lead operational execution across multiple concurrent projects while balancing quality, timelines, and resource constraints.
Strong analytical, editorial, operational, and business judgment.
Proven experience collaborating cross-functionally with Engineering, Product, Research, and Operations teams.
Expertise in taxonomy development, content categorization, and data classification schema.
Familiarity with prompt engineering, AI-assisted workflows, model evaluation concepts, human-in-the-loop systems, or annotation operations preferred.
Experience leveraging AI tools and automation to improve operational quality, productivity, and scalability preferred.
Important notes for your attention
Applications:
All applicants must apply for Yahoo openings direct with Yahoo. We do not authorize any external agencies in India to handle candidates’ applications. No agency nor individual may charge candidates for any efforts they make on an applicant’s behalf in the hiring process.
Our internal recruiters will reach out to you directly to discuss the next steps if we determine that the role is a good fit for you. Selected candidates will go through formal interviews and assessments arranged by Yahoo direct.
Offer Distributions:
Our electronic offer letter and documents will be issued through our system for e-signatures, not via individual emails.
Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.
Yahoo has a high degree of flexibility around employee location and hybrid working. In fact, our flexible-hybrid approach to work is one of the things our employees rave about. Most roles don’t require specific regular patterns of in-person office attendance. If you join Yahoo, you may be asked to attend (or travel to attend) on-site work sessions, team-building, or other in-person events. When these occur, you’ll be given notice to make arrangements.
If you’re curious about how this factors into this role, please discuss with the recruiter.
Currently work for Yahoo? Please apply on our internal career site.
Want to know if this job is worth applying to?
