Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation | AI/ML Testing | Performance Testing | Security Testing | LLM APIs | Agentic Workflows | LangChain | LangSmith | Contract Testing | Playwright (4 - 8 Years)

Cisco
Bengaluru
Workplace: HybridFull timeFunction: Software EngineeringExperience: 4+ yearsEducation: bachelorsSkills: ["Problem-solving","Technical collaboration","Code review","Validation","Quality mindset"]

Build and scale test infrastructure for an AI-agentic Security Operations Center, translating quality challenges into evaluation frameworks and benchmarking protocols. Collaborate on code/design reviews, execute proof-of-concepts end to end, and maintain a quality ecosystem for reliable, high-performance outcomes. Implement validation using LLM-as-judge methodologies, tenant isolation probes, behavioral regression suites, and contract testing to ensure security compliance across the development lifecycle.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cisco
Cisco
1 day ago

Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation | AI/ML Testing | Performance Testing | Security Testing | LLM APIs | Agentic Workflows | LangChain | LangSmith | Contract Testing | Playwright (4 - 8 Years)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Build and scale test infrastructure for an AI-agentic Security Operations Center, translating quality challenges into evaluation frameworks and benchmarking protocols. Collaborate on code/design reviews, execute proof-of-concepts end to end, and maintain a quality ecosystem for reliable, high-performance outcomes. Implement validation using LLM-as-judge methodologies, tenant isolation probes, behavioral regression suites, and contract testing to ensure security compliance across the development lifecycle.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Contribute to PQ foundations and evaluation frameworks to assess AI agents, workflows, and system processes.
  • •Collaborate with the team via code and design reviews and support validation of technical hypotheses.
  • •Implement the lifecycle of proof-of-concepts (POCs) using defined experimentation and testing validation standards.
  • •Maintain testing processes to deliver reliable, high-quality outcomes aligned to team quality goals.
  • •Implement validation techniques including LLM-as-judge, tenant isolation probes, behavioral regression suites, and contract/audit log validation for security compliance.

Key Requirements

  • •Bachelor’s degree plus 4+ years of experience in software development and test automation, including building large-scale testing ecosystems.
  • •Experience programming in Python and Go to design scalable, maintainable, high-performance testing infrastructure.
  • •Experience with security compliance frameworks.
  • •Experience with modern performance testing methodologies.
  • •Experience using AI to build automation for test automation.
Experience:4+ years
Education:Bachelor's
Skills:Problem-solvingTechnical collaborationCode reviewValidationQuality mindset
Tech Stack:SplunkPythonGoLLM APIsLangChainLangSmithPlaywrightContract testingK6Terra Virtual MachineJMeterAI/MLLLM-as-judge

Company Brief

Cisco
Global technology company that designs, manufactures, and sells networking hardware, telecommunications equipment, and high-technology services and products for enterprises, service providers, and governments worldwide.
Industry: Networking Equipment
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Jose, United States
Founded: 1984
Glassdoor
Glassdoor: 4.0
WebsiteLinkedInGlassdoor