Software Engineering Technical Leader

Cisco
Bengaluru
Workplace: HybridFull timeFunction: Software EngineeringExperience: 15+ yearsEducation: bachelorsSkills: ["Problem-solving","Technical vision","Collaboration"]

Build and evolve test infrastructure for an AI-agentic Security Operations Center, translating quality challenges into scalable evaluation frameworks. Implement benchmarking protocols, proof-of-concept lifecycles, and validation techniques including LLM-as-judge, tenant isolation probes, and behavioral regression suites. Collaborate on code and design reviews while partnering cross-functionally to deliver contract testing, audit log validation, and security compliance coverage that strengthens reliability and performance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cisco
Cisco
14 hours ago

Software Engineering Technical Leader

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Build and evolve test infrastructure for an AI-agentic Security Operations Center, translating quality challenges into scalable evaluation frameworks. Implement benchmarking protocols, proof-of-concept lifecycles, and validation techniques including LLM-as-judge, tenant isolation probes, and behavioral regression suites. Collaborate on code and design reviews while partnering cross-functionally to deliver contract testing, audit log validation, and security compliance coverage that strengthens reliability and performance.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Contribute to PQ foundations and develop evaluation frameworks to assess AI agents, workflows, and system processes.
  • •Improve testing methodologies by developing AI-based solutions/agents to mitigate risk and enhance system integrity.
  • •Collaborate with the team through code and design reviews, supporting validation of technical hypotheses.
  • •Implement proof-of-concept lifecycles with standards for experimentation and validation of testing paradigms.
  • •Execute validation using techniques such as LLM-as-judge methodologies, tenant isolation probes, behavioral regression suites, and contract and audit log testing in partnership with engineering teams.

Key Requirements

  • •Bachelor’s degree and 15+ years of experience in software development and test automation, including building large-scale testing ecosystems.
  • •Proven programming experience in Python and Go to design scalable, maintainable, high-performance testing infrastructure.
  • •Demonstrated experience with security compliance frameworks and modern performance testing methodologies.
  • •Demonstrated experience using AI to build automation for test automation.
  • •Experience building PQ foundations and evaluation frameworks that support assessment capabilities for AI agents and workflows.
Experience:15+ yearsAIMachine learningSecurityTest automationAI/ML testingSOCLLM
Education:Bachelor's
Skills:Problem-solvingTechnical visionCollaboration
Tech Stack:PythonGoPlaywrightK6JMeterLangChainLangSmithClaudeCodexLLM APIsLLM-as-judgeContract testingOCSFVacuum linterCalderaTenant isolation probesAudit log validationTerra Virtual Machine (Security Suite)Prompt engineering

Company Brief

Cisco
Global technology company that designs, manufactures, and sells networking hardware, telecommunications equipment, and high-technology services and products for enterprises, service providers, and governments worldwide.
Industry: Networking Equipment
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Jose, United States
Founded: 1984
Glassdoor
Glassdoor: 4.0
WebsiteLinkedInGlassdoor