Software Engineer, Test Automation

Cisco
San Jose
Workplace: HybridFull timeUSD 167,700 - 245,200 annuallyFunction: Software EngineeringExperience: 8+ yearsEducation: bachelorsSkills: ["Problem-solving","Collaboration"]

Build test infrastructure to improve the reliability and performance of an AI-agentic Security Operations Center. Translate quality challenges into evaluation strategies, develop AI-assisted testing and benchmarking protocols, and execute POCs from design through validation. Collaborate through code/design reviews and partner cross-functionally on contract testing, audit log validation, security compliance, and techniques like LLM-as-judge, tenant isolation probes, and regression suites.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cisco
Cisco
1 week ago

Software Engineer, Test Automation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build test infrastructure to improve the reliability and performance of an AI-agentic Security Operations Center. Translate quality challenges into evaluation strategies, develop AI-assisted testing and benchmarking protocols, and execute POCs from design through validation. Collaborate through code/design reviews and partner cross-functionally on contract testing, audit log validation, security compliance, and techniques like LLM-as-judge, tenant isolation probes, and regression suites.
Location: San Jose
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Develop PQ foundations and evaluation frameworks to assess AI agents, workflows, and system processes.
  • •Identify opportunities in testing methodologies and build AI-based solutions/agents to mitigate risk and enhance system integrity.
  • •Collaborate on code and design reviews and support validation of testing hypotheses.
  • •Implement the lifecycle of proof-of-concepts (POCs) following experimentation and validation standards.
  • •Execute validation techniques including LLM-as-judge, tenant isolation probes, behavioral regression suites, and support contract testing and audit log validation.

Pay and Benefits

Salary: USD 167,700 - 245,200 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision401kPaid ParentalLong-term DisabilityLife InsuranceEquityAnnual BonusPaid HolidaysPaid LeaveVolunteer Days

Key Requirements

  • •Bachelor’s degree plus 8+ years of software development and test automation experience, including building large-scale testing ecosystems.
  • •Proven ability to design scalable, maintainable, high-performance testing infrastructure using Python and Go.
  • •Demonstrated experience with security compliance frameworks.
  • •Demonstrated experience with modern performance testing methodologies.
  • •Experience using AI to build automation/test automation.
Experience:8+ years
Education:Bachelor's
Skills:Problem-solvingCollaboration
Tech Stack:PythonGoPlaywrightContract testingK6JMeterLLM-as-judgeOCSFCalderaLangChainLangSmithClaudeCodex

Company Brief

Cisco
Global technology company that designs, manufactures, and sells networking hardware, telecommunications equipment, and high-technology services and products for enterprises, service providers, and governments worldwide.
Industry: Networking Equipment
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Jose, United States
Founded: 1984
Glassdoor
Glassdoor: 4.0
WebsiteLinkedInGlassdoor