SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
ServiceNow is seeking a Staff Technical Product Manager to establish and scale AI Evaluation as a core engineering capability across the organization. This is a dual-responsibility role combining platform strategy with enterprise innovation.
Key Responsibilities:
Platform Eval Strategy & Adoption: Partner with ServiceNow AI platform and product teams to understand, implement, validate, and drive adoption of out-of-the-box evaluations. Influence the platform roadmap based on enterprise needs and ensure evaluation capabilities meet customer requirements.
Enterprise Eval Innovation: Identify gaps in platform evaluation capabilities and drive the definition and development of custom evaluations, metrics, rubrics, datasets, and evaluation strategies for enterprise-specific AI applications and agentic workflows.
Custom Eval Development: Define and drive custom metrics, rubrics, datasets, and evaluation strategies. Develop reusable evaluations for domain-specific behaviors and business outcomes. Establish evaluation approaches for AI agents, task completion, tool usage, and multi-step workflows.
Eval-Driven Development: Embed evaluations into the full AI lifecycle (Define → Measure → Build → Evaluate → Improve → Release → Monitor). Require AI teams to define expected behavior and measurable quality criteria. Establish evaluation coverage and quality thresholds. Integrate trusted evaluations into development, regression, and release workflows. Enable continuous evaluation in production.
The role requires influencing AI specialists, engineers, and platform teams without direct authority, combining deep technical acumen with strategic product thinking.
Requirements:
- 10+ years of experience in Product Management roles with a focus on AI
- Technically strong PM combining: AI/LLM expertise, Evaluation Science, Quality Engineering, Product Management, and Platform Strategy
- Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability, CI/CD, and developer platforms
- Experience leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving
- ServiceNow AI Platform experience is a plus
