SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Rad AI is transforming healthcare with AI-driven radiology solutions. Founded by a radiologist, the company has secured over $140M in funding (Series C: $68M, valuation $528M) and serves thousands of radiologists daily across major healthcare systems including Cone Health, Jefferson Einstein Health, Geisinger, and Henry Ford Health. The company has been recognized by CB Insights, Deloitte (19th fastest-growing in North America), and named to CNBC's 2025 Disruptor 50 list.
You will lead Rad AI's Quality organization, reporting to the Chief Product Officer. The role focuses on building a consistent, scalable quality system across product teams rather than rebuilding from scratch. Rad AI already has embedded quality teams with strong practices in some areas (PR-level checks, developer-written end-to-end tests, AI-assisted test creation, automated regression triage), but practices and maturity vary by product area. Your mission is to standardize what works and make quality visible from team level to executive leadership.
Key responsibilities include:
- Lead one Quality team while keeping it embedded in product teams, running a shared operating cadence, priorities, standards, and roadmap
- Own the quality system by providing strategy, risk assessment, tooling, environments, coaching, and visibility so developers own quality of their builds
- Integrate quality into planning with Product, Engineering, Design, and Clinical teams
- Establish risk-based release lifecycle with pre-release risk assessment, radiologist persona test cases, common smoke-test baseline, and explicit testing expectations
- Close the gap between green tests and customer experience by defining radiologist personas, representative workflows, and bringing customer-matched environments (Windows workstations, dictation systems, PACS/RIS integrations) into testing
- Own test stability end-to-end: failure triage, flaky test quarantine/fix policies, and stable test environments
- Define and report quality metrics consistently: customer-found vs. internally found defects, escaped defects by product area, change failure rate, test stability, time to detect
- Set quality OKRs tied to company goals and publish company-level quality dashboard
- Partner with incident review owners, Support, and Customer Success to turn incidents and escaped defects into prevention
- Define quality for AI systems, evaluating non-deterministic outputs (speech recognition, generated impressions) with ML and product teams
- Embed clinical risk and compliance into quality practices, partnering with Clinical, Security, and Compliance teams
- Document standards, build Quality community of practice, run Quality Week, office hours, and demos
- Build and develop the team: hire, coach, and grow quality engineers; own Test Automation Engineer career framework; manage quality tooling, vendors, and test infrastructure cost-effectively
Requirements:
- 10+ years in software quality and test engineering, including 5+ years leading quality teams, with track record of building a quality function and staffing it cost-effectively as company grows
- Experience taking over a capable but inconsistent quality organization and raising the bar across teams by spreading what works
- Strong hands-on foundation in test automation (end-to-end, API, desktop or Electron UI automation in CI/CD pipelines, test environments); ability to go deep on test architecture and flaky-test root causes
- Experience shifting quality left: engineers own quality, quality team builds the system, quality never becomes the gate
- Data-driven approach: defined quality metrics (escaped defects, change failure rate, test stability), set OKRs against them, and moved them
- Experience with risk-based testing for integration-heavy products running across many customer configurations and environments
- Ability to build long-term quality roadmap and broker decisions with engineering leaders on architecture and testability
- Excellent communication across technical and non-technical audiences; track record of influencing Engineering, Product, Support, and executives without formal authority
- Expert hiring and people management for distributed teams across time zones: hiring, onboarding, career frameworks, performance management
- Experience managing quality tooling and vendor relationships (test management platforms, outsourced QA, test environment providers)
- Asks great questions, starts with smallest change that adds value, uses AI tools to make quality work faster and broader
Nice to haves:
- Experience in healthtech or regulated environment (HIPAA, PHI, SOC 2); ideally medical device software practices (SaMD, IEC 62304, ISO 14971 risk management)
- Familiarity with radiology workflows and systems: PACS, RIS, EHR, dictation platforms (PowerScribe, Fluency), HL7/FHIR, FHIRcast, DICOM
- Evaluated ML or AI systems in production (speech recognition accuracy, generated-text quality) where outputs aren't deterministic
- Owned performance, load, or reliability testing; partnered closely with incident management
- Led multi-team quality organization including managers or Staff-level engineers
- Built or scaled quality function at high-growth startup
