SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Dialpad is an AI platform for customer experience that enables AI agents and human agents to work together on a single platform to resolve customer problems in real time across voice and digital channels. The company serves market-leading brands including Netflix, Motorola Solutions, and Randstad, and is backed by top-tier investors including Andreessen Horowitz and GV.
As a Senior Software Development Engineer in Test (SDET) in Agentic QA, you will own the test automation and quality frameworks supporting Dialpad's AI Voice Agent services. This is a high-impact role focused on building robust automated coverage for end-to-end product experiences spanning frontend UI, backend services, APIs, and audio/text interactions.
Key responsibilities include:
- Own end-to-end quality for agentic features and workflows, including strategy, development, execution, and release qualification
- Design and build automation tooling and frameworks specifically for AI/LLM-driven systems, including prompt flows, agent orchestration, and tool integrations
- Develop and maintain evaluation frameworks (evals) to measure response quality, accuracy, and hallucination rates
- Drive automation coverage (80%+ for critical AI workflows) using both deterministic and probabilistic validation approaches
- Integrate AI quality checks into CI/CD pipelines with fast feedback cycles (under 15 minutes for PR validation)
- Build tooling for LLM observability and debugging, including prompt tracing and response analysis
- Partner with Applied AI teams on prompt engineering, model selection, and evaluation strategies
- Develop substantial amounts of automated test infrastructure and partner deeply with development teams to make the platform more testable, stable, and delightful for customers
This position is based at one of Dialpad's Canadian offices and reports to a QA Engineering Manager in the United States. You will work on a fast-growing AI platform where quality and reliability are critical competitive advantages.
