Want to know if this job is worth applying to?
San Francisco, California, United States
Hybrid
Sage Care is a fast-growing, early-stage healthcare startup transforming care navigation with AI. Our platform helps patients find the right care, enables providers to focus on the people who need them most, and improves access, quality, and economic outcomes at scale.
Founded by leaders from Apple, Uber, and Carbon Health, Sage Care is backed by top-tier investors including General Catalyst and Chelsea Clinton. We work with health systems across the U.S. and have expanded internationally to the MENA region, where we are partnering with healthcare organizations to deploy our AI-powered care navigation platform.
We’re hiring a Product Manager for Agent Intelligence to own the systems that measure, understand, and improve agent performance.
This is a high-ownership role at the intersection of product, data, evaluation, and AI quality. You will define the roadmap for the intelligence layer that turns agent interactions into structured insights, reliable evaluations, and product improvements.
You’ll partner closely with engineering, design, operations, customer teams, and other product leads to define quality standards, identify failure patterns, and close the loop between real-world conversations and better agent behavior.
This role is ideal for a product manager who is excited to build 0-to-1 systems, work with large-scale conversational data, and create the foundation for agents that become more accurate, reliable, and effective over time.
Create evaluation rubrics for agent calls and conversations, including correctness, completeness, workflow adherence, customer experience, and outcome quality.
Establish scoring standards that work across workflows, customers, and use cases.
Define what “good” looks like for both individual interactions and overall agent performance.
Own the systems and processes used to measure agent performance.
Develop human-in-the-loop review workflows, automated evaluation pipelines, and scenario-based testing.
Help Sage Care and its customers understand where agents are performing well, where they are failing, and why.
Build ways to analyze, cluster, and explore large volumes of conversational data.
Identify recurring issues, edge cases, workflow gaps, and opportunities for improvement.
Translate raw interaction data into clear product insights and prioritization inputs.
Convert failures into test scenarios, product requirements, training examples, and improvement opportunities.
Partner with product, engineering, and operations teams to make sure insights lead to action.
Track whether product changes improve agent performance, reliability, and customer outcomes.
Work on retrieval, ranking, personalization, and feedback systems that make agents more effective.
Help build the foundations for agents that learn from usage, customer feedback, and operational review.
Identify opportunities to use automation and AI to improve evaluation, quality monitoring, and product development workflows.
Experience as a Product Manager, ideally working on technical, data-intensive, AI, automation, or platform products.
Strong analytical skills and comfort working with data, metrics, and ambiguous problem spaces.
Ability to define quality standards, measurement frameworks, evaluation processes, or operational workflows.
Experience working closely with engineering and cross-functional teams.
Strong written and verbal communication skills.
Ability to turn messy, unstructured information into clear product direction.
High ownership mindset and ability to drive both strategy and execution.
Experience with AI products, conversational interfaces, LLMs, machine learning workflows, or agent systems.
Experience with evaluation frameworks, experimentation, quality operations, or human-in-the-loop systems.
Familiarity with retrieval, ranking, personalization, feedback loops, or data labeling workflows.
Experience working with large-scale conversational, support, call, or customer interaction data.
Experience in healthcare, senior care, care operations, or regulated environments.
Experience building 0-to-1 products or internal platforms in a fast-moving startup environment.
Agent quality is clearly defined, measurable, and trusted across teams.
Failures are identified quickly, consistently, and at scale.
Feedback from real conversations is converted into test cases, product improvements, and learning loops.
Product and engineering teams can see whether changes improve agent performance.
Sage Care agents become more accurate, reliable, and effective over time.
Agent Intelligence is a core part of Sage Care’s product advantage. As our agents handle more complex conversations, the ability to measure performance, detect failures, and improve continuously becomes essential to delivering safe, reliable, and high-quality care navigation.
This role is responsible for building the system that helps Sage Care understand and improve every agent interaction.
At Sage Care, our values shape how we build, collaborate, and serve.
Do Good Through Serving People: We serve users, teammates, and communities with integrity, compassion, kindness, and optimism.
Innovate with Safety, Evidence, and Transparency: We move quickly while prioritizing trust, safety, ethical decision-making, and evidence-based approaches.
Lead with Curiosity and Kindness: We ask questions before making assumptions and approach discovery, debate, and problem-solving with humility and care.
We, Not Me: We believe the best work happens through collaboration, mutual respect, and constructive feedback.
Efficiency and AI in All We Do: We use automation and AI thoughtfully to work smarter, create leverage, and build better products.
