SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Workera is a skills intelligence platform that helps organizations understand and develop their workforce in the AI era. The company serves Fortune 500 customers with proprietary AI agents and assessment technology.
You will own the measurement and evaluation system that underpins Workera's scoring infrastructure. This is a high-impact role at the intersection of assessment science, engineering, and product design. Your core accountability is building and maintaining the trust layer that customers, auditors, and internal teams rely on for high-stakes career decisions.
Key responsibilities include:
• Own scoring quality end-to-end: design evaluators, anchor rubrics, calibrate assessments, and validate accuracy against expert benchmarks
• Build and operate the continuous evaluation harness: maintain gold standard datasets, run bias diagnostics, detect drift, and enforce quality gates before any scoring change ships
• Define and publish assessment quality KPIs (human-to-AI agreement, reliability, classification accuracy, bias indicators, latency, cost) on company-wide dashboards
• Lead analytics investigations: conduct performance studies, run impact simulations, and perform root cause analysis when scores deviate from expectations
• Ship measurement improvements end-to-end: write specifications, coordinate implementation with the assessment tech team, and own validation and quality assurance
• Serve as liaison between AI governance and InfoSec: stay current on regulatory frameworks (GDPR, EU AI Act) and prepare evidence for audits, security reviews, and enterprise diligence
• Empower cross-functional partners (Product, Engineering, GTM) by building AI tooling and documentation to enable self-service analytics
You report to the VP of Product and Assessments and work embedded with two core teams: the assessment science team (who define what is measured and create test content) and the assessment tech team (who build and maintain the scoring pipeline). This is a small, senior team where your work has outsized reach and influence on product decisions.
The role exists because Workera is scaling rapidly—more customers, more use cases, higher stakes on every measurement. What was once hand-crafted now requires automated monitoring and fast remediation. You are the data foundation that turns assessment science intent into trustworthy customer outcomes.
