Research Engineer - Language Model Pre-Training

Zyphra
San Francisco
Workplace: OnsiteFull timeFunction: Education & TrainingEducation: mastersSkills: ["Communication","Collaboration","Problem-solving"]

We are seeking a Research Engineer for Language Model Pre-Training to drive end-to-end pretraining development, work closely with the pretraining team, and translate insights into next-generation models. The role covers large-scale training, performance optimization, data processing, and architecture research, with emphasis on robust systems, collaboration, and rigorous experimentation.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Zyphra
Zyphra
6 months ago

Research Engineer - Language Model Pre-Training

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 16 hours agoStatus: Live

Job Summary

We are seeking a Research Engineer for Language Model Pre-Training to drive end-to-end pretraining development, work closely with the pretraining team, and translate insights into next-generation models. The role covers large-scale training, performance optimization, data processing, and architecture research, with emphasis on robust systems, collaboration, and rigorous experimentation.
Location: San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Education & Training

Key Responsibilities

  • •Large-scale training runs and model parallelization
  • •Performance optimization of our pretraining stack
  • •Dataset collection, processing, and evaluation
  • •Architecture and methodology research, including optimizer ablations
  • •Collaborate with the pretraining team to integrate insights into next-generation models

Pay and Benefits

Perks:Health InsuranceDentalVision401kPaid Leave

Key Requirements

  • •Strong engineering aptitude for rapidly implementing reliable and robust systems
  • •Can rapidly learn new fields and are excited to implement new ideas
  • •Excellent communication and collaboration skills, and can work effectively on both research and engineering implementation at scale
  • •Deep expertise and intuition for solving machine learning problems and training models
  • •Experience with training on large-scale (multi-node) GPU clusters
Experience:Artificial intelligenceMachine learning
Education:Master's
Skills:CommunicationCollaborationProblem-solving
Tech Stack:PyTorchPythonGPUDistributed training

Company Brief

Zyphra
Zyphra is a technology company that provides software solutions and consulting services to help organizations implement digital tools and improve operational workflows. The company focuses on custom development, integration, and support for enterprise technology projects.
Industry: Consulting
Website