Dialpad

1 month ago

Sr. SDET in Agentic QA

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 23 hours agoStatus: Live

Job Summary

Senior SDET responsible for test automation and quality frameworks supporting Dialpad’s AI Voice Agent services. Develop end-to-end automated tests from frontend UI to backend services and APIs, test orchestration flows, and guardian safeguards. Build substantial automated test infrastructure, partner with development teams, and ensure robust coverage, performance, and reliability for agentic workflows.

Location: Kitchener

Workplace: Onsite

Employment Type: Full time

Job Function: QA, Test & Release Engineering

Key Responsibilities

•Own end-to-end quality for agentic features and workflows, including strategy, development, execution, and release qualification.
•Design and build automation tooling and frameworks for AI/LLM-driven systems, including prompt flows, agent orchestration, and tool integrations.
•Develop and maintain evaluation frameworks (evals) to measure response quality, accuracy, and hallucination rates.
•Drive automation coverage (80%+ for critical AI workflows) using deterministic + probabilistic validation approaches.
•Integrate AI quality checks into CI/CD pipelines with fast feedback cycles (<15 minutes for PR validation).

Pay and Benefits

Salary: CAD 135,500 - 158,000 annually

Key Requirements

•5+ years of experience in software engineering or SDET roles with an emphasis on software development.
•Strong programming skills in Python (preferred), Java, or JavaScript.
•Experience testing distributed, cloud-native SaaS systems and APIs.
•Hands-on exposure to LLMs or AI/ML systems (e.g., OpenAI, Claude, Gemini, or similar platforms).
•Experience with CI/CD pipelines (e.g., Jenkins, GitHub Actions).

Experience:5+ yearsAISaaSCloud-native

Education:Bachelor's

Skills:CollaborationCommunicationProblem-solvingTeamwork

Languages:English

Tech Stack:PythonGoGoogle Cloud PlatformCloud RunApp EngineKubernetesDatastoreRedisElasticSearchVue3ReactLLM APIsLiveKitPrompt orchestrationEvaluation toolingCI/CDJenkinsGitHub Actions

Company Brief

Dialpad

Provides cloud-based business communications platform offering voice, video, messaging, contact center, and AI-driven call intelligence to help teams communicate and collaborate across devices and locations.

Industry: SaaS

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: San Francisco, United States

Founded: 2011

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Dialpad

1 month ago

Sr. SDET in Agentic QA

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 23 hours agoStatus: Live

Job Summary

Location: Kitchener

Workplace: Onsite

Employment Type: Full time

Job Function: QA, Test & Release Engineering

Key Responsibilities

•Own end-to-end quality for agentic features and workflows, including strategy, development, execution, and release qualification.
•Design and build automation tooling and frameworks for AI/LLM-driven systems, including prompt flows, agent orchestration, and tool integrations.
•Develop and maintain evaluation frameworks (evals) to measure response quality, accuracy, and hallucination rates.
•Drive automation coverage (80%+ for critical AI workflows) using deterministic + probabilistic validation approaches.
•Integrate AI quality checks into CI/CD pipelines with fast feedback cycles (<15 minutes for PR validation).

Pay and Benefits

Salary: CAD 135,500 - 158,000 annually

Key Requirements

•5+ years of experience in software engineering or SDET roles with an emphasis on software development.
•Strong programming skills in Python (preferred), Java, or JavaScript.
•Experience testing distributed, cloud-native SaaS systems and APIs.
•Hands-on exposure to LLMs or AI/ML systems (e.g., OpenAI, Claude, Gemini, or similar platforms).
•Experience with CI/CD pipelines (e.g., Jenkins, GitHub Actions).

Experience:5+ yearsAISaaSCloud-native

Education:Bachelor's

Skills:CollaborationCommunicationProblem-solvingTeamwork

Languages:English

Tech Stack:PythonGoGoogle Cloud PlatformCloud RunApp EngineKubernetesDatastoreRedisElasticSearchVue3ReactLLM APIsLiveKitPrompt orchestrationEvaluation toolingCI/CDJenkinsGitHub Actions

Company Brief

Dialpad

Industry: SaaS

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: San Francisco, United States

Founded: 2011

Website LinkedIn