Software Engineer, Data Infrastructure

Cohere
San Francisco, California, New York, Washington
Workplace: OnsiteFull timeFunction: Software EngineeringSkills: ["Systems thinking","Collaboration","Problem-solving","Attention to performance"]

Build and operate Cohere’s unified distributed storage layer for model training and evaluation. Design a system that serves petabyte-scale data movement across multiple Kubernetes clusters, while collaborating with researchers and training-infra teams to meet throughput, latency, and durability goals. Tackle networking, I/O, and consistency challenges for moving large datasets and checkpoints across regions and backends.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cohere
Cohere
9 hours ago

Software Engineer, Data Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Build and operate Cohere’s unified distributed storage layer for model training and evaluation. Design a system that serves petabyte-scale data movement across multiple Kubernetes clusters, while collaborating with researchers and training-infra teams to meet throughput, latency, and durability goals. Tackle networking, I/O, and consistency challenges for moving large datasets and checkpoints across regions and backends.
Location: San Francisco, California, New York, Washington
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design, build, and operate the distributed storage system that feeds model training and evaluation.
  • •Run the storage system across multiple Kubernetes clusters at petabyte scale.
  • •Partner with researchers and training-infra teams to translate data read/write patterns into performance and durability requirements.
  • •Address networking, I/O, and consistency challenges when moving large datasets and checkpoints across regions and backends.
  • •Use GPU idle time and time-to-insight as measures of success for data movement and storage performance.

Pay and Benefits

Perks:Health InsuranceDental401kPension SchemeParental LeavePaid LeaveHome Office

Key Requirements

  • •Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management.
  • •Strong coding ability in Python or Go, with willingness to pick up the other.
  • •Experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets.
  • •Hands-on experience with cloud object storage such as S3 and POSIX-style filesystems.
  • •Ability to turn job read/write patterns into throughput, latency, and durability requirements.
Experience:Distributed systemsCloud infrastructureKubernetesAI infrastructure
Skills:Systems thinkingCollaborationProblem-solvingAttention to performance
Tech Stack:PythonGoKubernetesPersistent VolumesCSI driversStatefulSetsS3POSIX filesystemsReplicationConsistencyCachingData lifecycle managementObject storageNetworkingI/OParallel filesystemsHPC filesystemsWekaVASTLustre

Company Brief

Cohere
Builds security-first foundation models and enterprise AI products (LLMs, retrieval, agent platforms) for regulated industries, enabling customizable, private deployments across cloud and on-premises for real-world business applications.
Industry: AI & Machine Learning
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: Toronto, Canada
Founded: 2019
Glassdoor
Glassdoor: 2.9
WebsiteLinkedInGlassdoor