SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Qualia is a leading B2B real estate technology platform that digitizes the home closing process for millions of consumers annually through its SMB and Enterprise products. The platform connects homebuyers, sellers, lenders, title and escrow agents, and real estate agents on a single shared digital closing platform.
You will own a defined slice of the product roadmap end-to-end for Qualia Clear, an AI-powered system that automates expert judgment work in real estate closings—reading recorded documents, reconciling records, and identifying issues that must be resolved before closing. This role focuses on the hardest part of AI product development: measuring output quality, understanding failure modes, and driving measurable improvements release over release.
Key responsibilities include:
- Own a slice of the roadmap end-to-end: scoping, release, adoption, and iteration
- Define what "correct" means for AI-drafted expert work and build evaluation and scoring approaches that prove quality
- Build an error taxonomy by converting thousands of user corrections into a ranked, quantified list of model failures and their impact
- Design and run statistically rigorous experiments on prompt changes, model changes, and pipeline improvements
- Scope AI behavior with deep, precise requirements that serve as the product specification
- Build rapid prototypes to pressure-test ideas before committing engineering resources
- Partner with Engineering and Design to break ambitious goals into shippable milestones
- Write clear, plain-language PRDs that frame problems, success criteria, and context
- Instrument all shipped work—tracking accuracy, adoption, latency, and cost per run—and drive cost optimization without sacrificing accuracy
- Report to executives on quality trends, roadmap progress, and adoption metrics
- Work directly with GTM, Customer Success, and customers to drive adoption
You should have 5+ years of product management experience shipping exceptional software, with specific expertise in AI/ML features where output quality is the core product. Strong quantitative skills are essential: SQL fluency, Python or notebook comfort, and solid understanding of statistics (sampling, variance, significance, base rates). You've built or owned evaluation approaches (ground-truth sets, scoring rubrics, model-graded evals, regression suites) and have hands-on experience building AI agents. Daily fluency with AI tooling like Claude Code is expected. You understand how models work and can get up to speed on title industry specifics. You're comfortable working in domains where correctness is defined by domain experts, not by you, and you'll spend real time with practitioners learning why answers are wrong. Enterprise SaaS or ERP experience is valuable. Exceptional written communication—tight, plain, and defensible—is required. Real estate, title, or escrow industry knowledge is a plus.
The role is based in Austin, Texas, with openness to remote arrangements for qualified candidates. Qualia also has offices in San Francisco, California, and Concord, New Hampshire.
