Senior Software Development Engineer in Test (SDET) - Benchmarking

Bitwarden
Noida
Workplace: OnsiteFull timeFunction: QA, Test & Release EngineeringExperience: 6-10 yearsSkills: ["Written communication","Open-source passion","Statistical literacy","Data modeling","Problem-solving"]

Own automated performance monitoring and benchmarking for autofill quality end-to-end. Design benchmark scenarios and a regression-detection statistical model using browser performance timeline tooling, build test instrumentation and event schemas, and publish results to Datadog with alerting. Localize regressions to specific merge commits, maintain the scenario library and documentation, and partner with dataset and US autofill teams on triage and coordinated releases.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Bitwarden
Bitwarden
3 days ago

Senior Software Development Engineer in Test (SDET) - Benchmarking

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Own automated performance monitoring and benchmarking for autofill quality end-to-end. Design benchmark scenarios and a regression-detection statistical model using browser performance timeline tooling, build test instrumentation and event schemas, and publish results to Datadog with alerting. Localize regressions to specific merge commits, maintain the scenario library and documentation, and partner with dataset and US autofill teams on triage and coordinated releases.
Location: Noida
Workplace: Onsite
Employment Type: Full time
Job Function: QA, Test & Release Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and maintain benchmark scenarios that exercise autofill on busy, mutating, animation-heavy, deeply nested pages using browser performance-timeline tooling.
  • •Build and maintain test instrumentation and the harness data model, including in-page signals, timing marks, join keys, and event-record schemas.
  • •Own the statistical model behind regression detection and correctly interpret browser engine counters and before/after readings.
  • •Publish results to Datadog, build alerting for benchmark regressions, and help localize regressions to the specific merge commit that introduced them.
  • •Partner with Dataset engineers and the US Autofill team on defect triage and coordinated releases.

Key Requirements

  • •6-10 years in Software Engineering in Test, test automation, or performance engineering roles.
  • •Proven experience designing and owning automated test harnesses and benchmarking infrastructure from scratch.
  • •Working knowledge of browser rendering and performance APIs (e.g., Long Tasks, Long Animation Frames, User Timing) and the ability to reason about metrics.
  • •Experience building test harnesses with Playwright (or equivalent) and using browser debugging protocols such as Chrome DevTools Protocol for lab attribution.
  • •Comfort with statistical and data modeling for regression detection, including correct join keys and clock alignment.
Experience:6-10 yearsOpen sourceSecurityDeveloper toolingIdentity and authentication
Skills:Written communicationOpen-source passionStatistical literacyData modelingProblem-solving
Languages:English
Tech Stack:TypeScriptPlaywrightChrome DevTools ProtocolDatadogLong TasksLong Animation FramesUser TimingBrowser performance timelineBrowser renderingUser Timing APIChrome DevToolsPerformance APIsBITClaude

Company Brief

Bitwarden
Develops Bitwarden, an open-source password management platform providing secure vaults, password generation, and cross-device syncing for individuals and businesses, with self-hosting and cloud-hosted deployment options and enterprise access controls.
Industry: Cybersecurity
Headquarters: Santa Barbara, United States
Founded: 2016
WebsiteLinkedIn