SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Sage Care is a fast-growing healthcare startup transforming care navigation with AI. Founded by leaders from Apple, Uber, and Carbon Health, and backed by top-tier investors including General Catalyst, the company works with health systems across the U.S. and internationally in the MENA region.
You will own the Agent Intelligence product—a high-ownership role at the intersection of product, data, evaluation, and AI quality. You will define the roadmap for the intelligence layer that turns agent interactions into structured insights, reliable evaluations, and product improvements.
Key responsibilities include:
• Define agent quality by creating evaluation rubrics for agent calls and conversations (correctness, completeness, workflow adherence, customer experience, outcome quality) and establishing scoring standards across workflows, customers, and use cases.
• Build evaluation systems: own the systems and processes to measure agent performance, develop human-in-the-loop review workflows, automated evaluation pipelines, and scenario-based testing to help Sage Care and customers understand where agents perform well and where they fail.
• Turn conversations into insights by analyzing and clustering large volumes of conversational data, identifying recurring issues, edge cases, workflow gaps, and opportunities for improvement, then translating raw interaction data into clear product insights.
• Close the feedback loop by converting failures into test scenarios, product requirements, and training examples, partnering with product, engineering, and operations teams to ensure insights lead to action, and tracking whether changes improve agent performance.
• Advance learning systems by working on retrieval, ranking, personalization, and feedback systems that make agents more effective, helping build foundations for agents that learn from usage and operational review.
You will partner closely with engineering, design, operations, customer teams, and other product leads to define quality standards, identify failure patterns, and close the loop between real-world conversations and better agent behavior. This role is ideal for a product manager excited to build 0-to-1 systems, work with large-scale conversational data, and create the foundation for agents that become more accurate, reliable, and effective over time.
REQUIREMENTS
Required:
• Experience as a Product Manager, ideally working on technical, data-intensive, AI, automation, or platform products
• Strong analytical skills and comfort working with data, metrics, and ambiguous problem spaces
• Ability to define quality standards, measurement frameworks, evaluation processes, or operational workflows
• Experience working closely with engineering and cross-functional teams
• Strong written and verbal communication skills
• Ability to turn messy, unstructured information into clear product direction
• High ownership mindset and ability to drive both strategy and execution
Even Better:
• Experience with AI products, conversational interfaces, LLMs, machine learning workflows, or agent systems
• Experience with evaluation frameworks, experimentation, quality operations, or human-in-the-loop systems
• Familiarity with retrieval, ranking, personalization, feedback loops, or data labeling workflows
• Experience working with large-scale conversational, support, call, or customer interaction data
• Experience in healthcare, senior care, care operations, or regulated environments
• Experience building 0-to-1 products or internal platforms in a fast-moving startup environment
