Senior QA Engineer

Keyloop
United Kingdom
Workplace: HybridFull timeFunction: QA, Test & Release EngineeringSkills: ["Communication"]

Own quality strategy across the AI agent platform and omnichannel communications. Define and lead testing approaches for non-deterministic, LLM-powered systems, building automated test suites spanning unit, integration, API, and end-to-end scenarios across a TypeScript/Node.js/React/Python stack. Develop evaluation frameworks for agent behavior and reasoned outputs, collaborate on acceptance criteria, and improve “done” standards through PR reviews and testability advocacy.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Keyloop
Keyloop
1 day ago

Senior QA Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live
Reposted: similar role first listed 4 months ago

Job Summary

Own quality strategy across the AI agent platform and omnichannel communications. Define and lead testing approaches for non-deterministic, LLM-powered systems, building automated test suites spanning unit, integration, API, and end-to-end scenarios across a TypeScript/Node.js/React/Python stack. Develop evaluation frameworks for agent behavior and reasoned outputs, collaborate on acceptance criteria, and improve “done” standards through PR reviews and testability advocacy.
Location: United Kingdom
Workplace: Hybrid
Employment Type: Full time
Job Function: QA, Test & Release Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and own the quality strategy for the AI agent platform, including testing approaches for non-deterministic, LLM-powered systems.
  • •Build and maintain automated test suites covering unit, integration, API, and end-to-end scenarios across the TypeScript/Node.js/React/Python stack.
  • •Develop evaluation frameworks for agent behavior, including reasoning quality, tool use, memory, and multi-step interaction flows.
  • •Test and validate the omnichannel communication platform across web, messaging, voice, and other channels.
  • •Collaborate with engineers to define acceptance criteria and champion a culture of quality through PR reviews and advocating for testability.

Key Requirements

  • •Proven experience as a Senior QA Engineer on complex, production software products.
  • •Strong hands-on skills with test frameworks such as Playwright, Cypress, and Jest.
  • •Experience testing APIs, backend services, and databases (PostgreSQL or similar).
  • •A clear understanding of how to approach testing non-deterministic systems.
  • •Experience designing and implementing a QA strategy with clear communication of quality risks.
Experience:Production softwareLLM and agentic systemsB2B SaaSAutomotive dealership techEvent-driven systems
Skills:Communication
Tech Stack:TypeScriptNode.jsReactPythonPlaywrightCypressJestPostgreSQLAPI testingLLMAI agentOmnichannel communicationsWebMessagingVoiceGitHub CopilotCursorClaude Code

Company Brief

Keyloop
Provides dealer management systems and software solutions for automotive retailers and manufacturers, covering sales, service, parts, and connected retail tools to streamline dealership operations and digital customer experiences.
Industry: Automotive
Company Size: Large (251 to 1,000 employees)
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Belfast, United Kingdom
Founded: 2018
WebsiteLinkedIn