SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Bitwarden is the leading open-source password management solution, protecting individuals, teams, and enterprises with strong security practices. The Autofill Coverage team owns end-to-end measurement of autofill quality, from establishing manual baselines to automating regression and benchmarking suites.
As a Senior SDET on the Benchmarking team, you will own the automated performance monitoring and benchmarking harness for autofill functionality. You'll localize regressions to specific merge commits, detect them on main, and measure worst-case performance under stress. The role extends beyond correctness monitoring (handled by BIT) into three critical areas:
**Experience Impact:** Measuring what autofill costs the page, regardless of fill success.
**Responsiveness:** Tracking how quickly autofill reacts to user actions.
**Predictability:** Ensuring stable behavior across runs and pages.
Key responsibilities include:
- Design and maintain benchmark scenarios exercising autofill against complex, animation-heavy, deeply-nested pages using browser performance-timeline tooling.
- Build and maintain test instrumentation, including in-page signals for long-running work and custom timing marks emitted by the extension.
- Own the statistical model for regression detection and correctly interpret engine counters as paired before/after readings.
- Design join keys and event-record schemas enabling correlation of independent signals (dropped frames, GC pauses) captured by different subsystems.
- Build the harness's read side, consuming scenario lifecycle and event marks from the performance timeline for comparable, re-checkable runs.
- Publish results to Datadog, build alerting on regressions, and help localize regressions to specific commits.
- Maintain the test-the-web scenario library and marking conventions; document monitoring strategy for new autofill code.
- Partner with Dataset engineers and the US Autofill team on defect triage and coordinated releases.
This role is foundational in building Bitwarden's India Engineering Center of Excellence. You'll work with talented global teams on meaningful engineering challenges in security and open-source software, influencing how the organization scales.
**Requirements:**
- 6–10 years in Software Engineering in Test, test automation, or performance engineering.
- Proven track record designing and owning automated test harnesses and benchmarking infrastructure from the ground up, not just writing test cases.
- Working knowledge of browser rendering and performance APIs (Long Tasks, Long Animation Frames, User Timing, main-thread/compositor split) with genuine comfort reasoning about metric validity.
- Experience building test harnesses with Playwright (or equivalent) and working with out-of-page debugging protocols (e.g., Chrome DevTools Protocol).
- Comfort choosing the right summary statistic for a dataset's shape and understanding composition across aggregation boundaries.
- Experience designing schemas/types for time-series or event data where join keys and clock alignment matter to correctness.
- Strong TypeScript; familiarity with browser extension architecture is a plus.
- Experience publishing metrics to and alerting from platforms like Datadog.
- Excellent written communication and passion for open-source software, developer tooling, and modern internet security.
