Software Technical Leader, Test Automation, Splunk

Cisco
San Jose, California
Workplace: HybridFull timeUSD 186,900 - 267,700 annuallyFunction: QA, Test & Release EngineeringExperience: 10+ yearsEducation: bachelorsSkills: ["Technical leadership","Mentorship","Problem-solving","Architectural thinking","Cross-functional collaboration"]

Lead the roadmap for AI-agentic security testing by architecting PQ foundations, evaluation frameworks, and scalable validation strategies. Drive engineering efficiency through advanced benchmarking, experimental governance for POCs, and technical mentorship via architectural reviews. Set standards for LLM-as-judge validation, tenant isolation probes, audit log validation, and behavioral regression suites while partnering with engineering leadership to enforce contract testing and security compliance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cisco
Cisco
2 days ago

Software Technical Leader, Test Automation, Splunk

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Lead the roadmap for AI-agentic security testing by architecting PQ foundations, evaluation frameworks, and scalable validation strategies. Drive engineering efficiency through advanced benchmarking, experimental governance for POCs, and technical mentorship via architectural reviews. Set standards for LLM-as-judge validation, tenant isolation probes, audit log validation, and behavioral regression suites while partnering with engineering leadership to enforce contract testing and security compliance.
Location: San Jose, California
Workplace: Hybrid
Employment Type: Full time
Job Function: QA, Test & Release Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Define and oversee the architectural roadmap for PQ foundations and evaluation frameworks for AI agents, complex workflows, and system processes.
  • •Identify gaps in testing methodologies and lead development of AI-based solutions/agents to mitigate risk and improve system integrity.
  • •Mentor engineering talent through architectural reviews and guidance on validating complex technical hypotheses.
  • •Oversee the lifecycle of proof-of-concepts (POCs) with rigorous experimentation standards and validation of novel testing paradigms.
  • •Set advanced validation strategies, including LLM-as-judge methodologies, tenant isolation probes, behavioral regression suites, and partner on contract testing and audit log validation.

Pay and Benefits

Salary: USD 186,900 - 267,700 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision401kPaid ParentalPaid Holidays

Key Requirements

  • •Bachelor’s degree plus 10+ years of software development and test automation experience, including architecting large-scale testing ecosystems.
  • •Demonstrated programming experience, including Python and Go, with the ability to design scalable, maintainable, high-performance testing infrastructure.
  • •Demonstrated experience with security compliance frameworks.
  • •Demonstrated experience with modern performance testing methodologies.
  • •Demonstrated ability to use AI to build automation and write AI-powered test automation.
Experience:10+ yearsTest automationAI/MLSecurity operationsLLM evaluation
Education:Bachelor's
Skills:Technical leadershipMentorshipProblem-solvingArchitectural thinkingCross-functional collaboration
Tech Stack:SplunkPythonGoPlaywrightK6Terra VMJMeterLangChainLangSmithClaudeCodexLLM APIsLLM-as-judgeTenant isolation probesAudit log validationContract testingOCSF validation librariesVacuum linterCalderaDeep expertise

Company Brief

Cisco
Global technology company that designs, manufactures, and sells networking hardware, telecommunications equipment, and high-technology services and products for enterprises, service providers, and governments worldwide.
Industry: Networking Equipment
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Jose, United States
Founded: 1984
Glassdoor
Glassdoor: 4.0
WebsiteLinkedInGlassdoor