Senior Software Engineer, Agent Infrastructure

Cohere
San Francisco
Workplace: OnsiteFull timeFunction: Software EngineeringSkills: ["Problem-solving","Communication","Collaboration"]

Join Cohere’s Agent Infrastructure team to build the next generation of ML-powered agent platforms. You’ll work on secure execution environments, agent state management, model routing, identity and authentication, and resource management for long-running agent workflows, combining systems engineering depth with ML intuition to productionize innovative research.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cohere
Cohere
4 months ago

Senior Software Engineer, Agent Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 7 hours agoStatus: Live

Job Summary

Join Cohere’s Agent Infrastructure team to build the next generation of ML-powered agent platforms. You’ll work on secure execution environments, agent state management, model routing, identity and authentication, and resource management for long-running agent workflows, combining systems engineering depth with ML intuition to productionize innovative research.
Location: San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Turn emerging ML research ideas into production-ready infrastructure for agent workflows
  • •Build core platform capabilities for execution, storage, and state management
  • •Prototype and evaluate new technologies, then help decide what should move into production
  • •Partner with research teams to shape infrastructure based on what future agent systems will need
  • •Secure execution environments and implement identity, authentication, and trust boundaries for agents

Pay and Benefits

Perks:Health InsuranceDentalParental LeaveRemote WorkPaid Leave

Key Requirements

  • •Experience building production ML infrastructure with strong systems fundamentals
  • •Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks
  • •Familiarity with model routing and LLM provider frameworks across different model types and environments
  • •Experience with scalable, fault-tolerant distributed systems and Kubernetes
  • •A track record of moving quickly on prototypes and making good decisions about productionization
Experience:AIML infrastructureDistributed systemsAgentsLLM
Skills:Problem-solvingCommunicationCollaboration
Languages:English
Tech Stack:KubernetesDistributed systemsML infrastructureSecurityIdentityModel routingWASMGVisorFirecrackerKata

Company Brief

Cohere
Builds security-first foundation models and enterprise AI products (LLMs, retrieval, agent platforms) for regulated industries, enabling customizable, private deployments across cloud and on-premises for real-world business applications.
Industry: AI & Machine Learning
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: Toronto, Canada
Founded: 2019
Glassdoor
Glassdoor: 2.9
WebsiteLinkedInGlassdoor