AI LLMOps Engineering Technical Leader

Cisco
San Jose
Workplace: HybridFull timeUSD 216,300 - 280,800 annuallyFunction: Data Science & Machine LearningExperience: 8+ yearsEducation: bachelorsSkills: ["Leadership","Mentoring","Communication","Architectural design","Knowledge sharing"]

Lead operationalization of agentic AI and MLOps capabilities for Cisco’s Customer Experience Engineering organization. Establish robust MLOps practices, ML pipelines, model serving architectures, and telemetry to monitor token usage, compute costs, agent reasoning paths, and security/performance. Resolve complex GPU-cluster inference and infrastructure issues, define architectural choices, and mentor peers while deploying scalable agentic AI platforms in hybrid cloud environments.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cisco
Cisco
4 days ago

AI LLMOps Engineering Technical Leader

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Lead operationalization of agentic AI and MLOps capabilities for Cisco’s Customer Experience Engineering organization. Establish robust MLOps practices, ML pipelines, model serving architectures, and telemetry to monitor token usage, compute costs, agent reasoning paths, and security/performance. Resolve complex GPU-cluster inference and infrastructure issues, define architectural choices, and mentor peers while deploying scalable agentic AI platforms in hybrid cloud environments.
Location: San Jose
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Director level

Key Responsibilities

  • •Operationalize agentic AI autonomous agent architectures into secure, scalable, high-performing production environments.
  • •Define and establish MLOps practices, foundational ML pipelines, and model serving architectures.
  • •Implement telemetry monitoring for token usage, compute costs, agent reasoning paths, and model performance/security.
  • •Resolve complex infrastructure challenges, including containerized model management on GPU clusters and inference issues.
  • •Guide architectural decisions and mentor peers to keep agentic AI platforms reliable and ahead of the curve.

Pay and Benefits

Salary: USD 216,300 - 280,800 annually
Perks:Health InsuranceDentalVision401kPaid ParentalRemote Work

Key Requirements

  • •Bachelors degree with 8+ years related experience, or Masters with 6+ years related experience.
  • •Experience in software engineering and DevOps, building scalable infrastructure.
  • •Operationalizing large language models (e.g., OpenAI, Anthropic, Llama) and using LLM frameworks such as LangChain or LangSmith.
  • •Proficiency in Python and/or Java/J2EE.
  • •Experience with CI/CD for machine learning and MLOps frameworks (e.g., ClearML, MLflow, Weights & Biases) plus containerization with Docker and Kubernetes.
Experience:8+ yearsLLMsMLOpsDevOpsHybrid cloudAgentic AI
Education:Bachelor's
Skills:LeadershipMentoringCommunicationArchitectural designKnowledge sharing
Tech Stack:PythonJavaJ2EEOpenAIAnthropicLlamaLangChainLangSmithFastAPIFlaskSpring BootCI/CDClearMLMLflowWeights & BiasesDockerKubernetesGPU clustersApache APISIXLiteLLM

Company Brief

Cisco
Global technology company that designs, manufactures, and sells networking hardware, telecommunications equipment, and high-technology services and products for enterprises, service providers, and governments worldwide.
Industry: Networking Equipment
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Jose, United States
Founded: 1984
Glassdoor
Glassdoor: 4.0
WebsiteLinkedInGlassdoor