Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation | AI/ML Testing | Performance Testing | Security Testing | LLM APIs | Agentic Workflows | LangChain | LangSmith | Contract Testing | Playwright (8 - 12 Years)

Cisco
Bengaluru
Workplace: HybridFull timeFunction: Software EngineeringExperience: 8-12 yearsEducation: bachelorsSkills: ["Problem-solving","Technical collaboration","Design reviews","Hypothesis validation"]

Build and scale test infrastructure to ensure reliability and performance of an AI-agentic Security Operations Center (SOC). Develop evaluation frameworks and POC lifecycles, implement LLM-as-judge and regression validation, and strengthen quality ecosystems through benchmarking protocols. Partner across engineering to deliver contract testing, audit log validation, tenant isolation probes, and security compliance coverage, while continuously improving testing methodologies using Python/Go and modern performance/security testing tools.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cisco
Cisco
1 day ago

Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation | AI/ML Testing | Performance Testing | Security Testing | LLM APIs | Agentic Workflows | LangChain | LangSmith | Contract Testing | Playwright (8 - 12 Years)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and scale test infrastructure to ensure reliability and performance of an AI-agentic Security Operations Center (SOC). Develop evaluation frameworks and POC lifecycles, implement LLM-as-judge and regression validation, and strengthen quality ecosystems through benchmarking protocols. Partner across engineering to deliver contract testing, audit log validation, tenant isolation probes, and security compliance coverage, while continuously improving testing methodologies using Python/Go and modern performance/security testing tools.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Develop PQ foundations and evaluation frameworks to assess AI agents, workflows, and system processes.
  • •Implement testing methodology enhancements, including AI-based agents/solutions to mitigate risk and improve system integrity.
  • •Collaborate with engineering on code/design reviews and validate technical hypotheses.
  • •Execute the POC lifecycle with standards for experimentation and testing paradigm validation.
  • •Implement validation techniques such as LLM-as-judge, tenant isolation probes, behavioral regression suites, plus contract testing and audit log validation with security compliance integration.

Key Requirements

  • •Bachelor’s degree plus 8+ years in software development and test automation, including building large-scale testing ecosystems.
  • •Demonstrated programming experience in Python and Go for scalable, maintainable, high-performance test infrastructure.
  • •Experience implementing security compliance frameworks.
  • •Demonstrated experience with modern performance testing methodologies.
  • •Experience using AI to build automation for test automation.
Experience:8-12 yearsAI/ML testingSecurityTest automationPerformance testing
Education:Bachelor's
Skills:Problem-solvingTechnical collaborationDesign reviewsHypothesis validation
Tech Stack:PythonGoPlaywrightLangChainLangSmithLLM-as-judgeLLM APIsClaudeCodexContract testingAudit log validationTenant isolation probesBehavioral regression suitesOCSFVacuum linterCalderaK6Terra Virtual MachineJMeter

Company Brief

Cisco
Global technology company that designs, manufactures, and sells networking hardware, telecommunications equipment, and high-technology services and products for enterprises, service providers, and governments worldwide.
Industry: Networking Equipment
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Jose, United States
Founded: 1984
Glassdoor
Glassdoor: 4.0
WebsiteLinkedInGlassdoor