4 months ago

Research Engineer - Language Model Pre-Training

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 7 hours agoStatus: Live

Job Summary

We are seeking a Research Engineer for Language Model Pre-Training to drive end-to-end pretraining development, work closely with the pretraining team, and translate insights into next-generation models. The role covers large-scale training, performance optimization, data processing, and architecture research, with emphasis on robust systems, collaboration, and rigorous experimentation.

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Education & Training

Key Responsibilities

•Large-scale training runs and model parallelization
•Performance optimization of our pretraining stack
•Dataset collection, processing, and evaluation
•Architecture and methodology research, including optimizer ablations
•Collaborate with the pretraining team to integrate insights into next-generation models

Pay and Benefits

Perks:Health InsuranceDentalVision401kPaid Leave

Key Requirements

•Strong engineering aptitude for rapidly implementing reliable and robust systems
•Can rapidly learn new fields and are excited to implement new ideas
•Excellent communication and collaboration skills, and can work effectively on both research and engineering implementation at scale
•Deep expertise and intuition for solving machine learning problems and training models
•Experience with training on large-scale (multi-node) GPU clusters

Experience:Artificial intelligenceMachine learning

Education:Master's

Skills:CommunicationCollaborationProblem-solving

Tech Stack:PyTorchPythonGPUDistributed training

Company Brief

Zyphra

Industry: Consulting

Website

Loading job details...

Preparing the role view and application actions.

Zyphra

4 months ago

Research Engineer - Language Model Pre-Training

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 7 hours agoStatus: Live

Job Summary

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Education & Training

Key Responsibilities

•Large-scale training runs and model parallelization
•Performance optimization of our pretraining stack
•Dataset collection, processing, and evaluation
•Architecture and methodology research, including optimizer ablations
•Collaborate with the pretraining team to integrate insights into next-generation models

Pay and Benefits

Perks:Health InsuranceDentalVision401kPaid Leave

Key Requirements

•Strong engineering aptitude for rapidly implementing reliable and robust systems
•Can rapidly learn new fields and are excited to implement new ideas
•Excellent communication and collaboration skills, and can work effectively on both research and engineering implementation at scale
•Deep expertise and intuition for solving machine learning problems and training models
•Experience with training on large-scale (multi-node) GPU clusters

Experience:Artificial intelligenceMachine learning

Education:Master's

Skills:CommunicationCollaborationProblem-solving

Tech Stack:PyTorchPythonGPUDistributed training

Company Brief

Zyphra

Industry: Consulting

Website