SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 185,000 - 230,000 / annual
Otter.ai is seeking a Senior AI Agent & LLM Engineer to build and improve AI systems powering Otter's conversational knowledge engine and AI Chat. This is a hands-on role combining strong software engineering with deep focus on AI quality.
Key responsibilities include:
- Building AI-agent experiences for Otter AI Chat that help users reason over conversations, retrieve knowledge, and complete complex tasks
- Advancing the conversational knowledge engine through better knowledge extraction, annotation, and indexing
- Developing robust evaluation datasets, automated graders, regression tests, and release gates for AI quality
- Diagnosing failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows
- Building shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability
- Improving task completion, correctness, groundedness, reliability, latency, and cost
- Turning production traces, customer feedback, and usage signals into measurable product and model improvements
- Collaborating across AI, product, infrastructure, data, security, and application teams
Required qualifications:
- 5+ years of AI Agent engineering, machine learning engineering, or related experience
- Strong backend or distributed-systems engineering skills
- Hands-on experience building and shipping AI-agent or LLM-powered products
- Strong focus on AI quality and experience evaluating nondeterministic systems
- Ability to use data, traces, logs, and qualitative examples to identify and resolve complex failures
- Effective collaboration across services, technical domains, and organizational boundaries
- Strong product judgment combined with rigorous engineering and evaluation practices
- High agency, strong ownership, and bias toward action
- Ability to take ambiguous problems from initial exploration through production launch and continuous improvement
A plus: demonstrated ability to use coding agents effectively while rigorously reviewing and controlling output quality.
Otter.ai has transcribed over 1 billion meetings and is the world's leading tool for meeting transcription, summarization, and collaboration. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.
