SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Judgment Labs is building infrastructure for continual learning in long-horizon AI agents. The company transforms long agent trajectories into clean, structured data for evaluations, labeling, rubric generation, context engineering, and reinforcement learning workflows. Judgment has raised $32M across two rounds led by Lightspeed.
In this role, you will own the end-to-end customer process, from understanding pain points to building evaluations and monitoring in Judgment's platform, then translating learnings into product direction. You'll work directly with customer teams to reason about agent behavior and translate high-level goals into concrete deployments. You'll partner with account executives before customers sign and stay engaged after, then take cross-customer insights to inform product decisions.
Key responsibilities include:
- Partner with AEs on technical sales: run discovery and demos, answer product questions, and show prospects how Judgment fits their AI agents
- Deploy and embed Judgment's platform and AI components into customer codebases and production AI systems, integrating monitoring and evaluation into real workflows
- Guide customers through technical decisions around agent monitoring, evaluation strategy, and integrating capabilities into existing production systems
- Own multiple customer engagements end-to-end, from first technical conversation through successful integration and sustained adoption
- Turn feedback across customers into product direction: deciding what to build, what to fix, and what not to build
- Prototype and demo new features with coding agents, ship PRs when appropriate, and work with engineering to get changes shipped
This role centers on deep technical execution, customer ownership, and product judgment. While you'll ship code and prototypes, your main job is ensuring the company builds the right things. The scope, judgment, and autonomy mirror a training ground for founding or leading a technical company.
Judgment is a 20-person team in San Francisco working in-person Monday–Friday. The company emphasizes shipping velocity and attracts olympiad medalists, debate champions, and competitive athletes. The team is composed of ex-founders and founder-track professionals.
QUALIFICATIONS:
You should identify with at least one of the following:
- Experience deploying AI or LLM-based systems into real production environments
- Ability to quickly learn new tools and systems, and integrate AI infrastructure into existing customer workflows and codebases
- Ability to translate ambiguous customer goals into concrete technical solutions and evaluation strategies
- Strong product sense: hearing what a customer asks for, finding the underlying problem, and explaining clearly what's worth building
- Comfort prototyping and shipping changes quickly with coding agents
- Strong customer-facing skills, including explaining complex technical concepts clearly and building trust with both technical and non-technical stakeholders
- Comfort owning customer engagements end-to-end, from first call through successful production adoption
- Aspiration to be a technical founder in the future
