Applied Machine Learning Researcher

Phonely
San Francisco, Australia
Workplace: RemoteFull timeUSD 150,000 - 180,000 annuallyFunction: Data Science & Machine LearningExperience: 3+ yearsSkills: ["Analytical thinking","Debugging","Communication"]

Build and improve production voice AI models by fine-tuning and evaluating LLM behavior for real-time phone conversations. Design rigorous experiments across data, model, and evaluation strategies, create quality and reliability eval frameworks, and analyze real-world conversation failures. Partner with engineering, product, QA, and customer-facing teams to deploy research improvements safely, set eval gates, and advance model release criteria based on measurable production outcomes.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Phonely
Phonely
1 month ago

Applied Machine Learning Researcher

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 20 hours agoStatus: Live

Job Summary

Build and improve production voice AI models by fine-tuning and evaluating LLM behavior for real-time phone conversations. Design rigorous experiments across data, model, and evaluation strategies, create quality and reliability eval frameworks, and analyze real-world conversation failures. Partner with engineering, product, QA, and customer-facing teams to deploy research improvements safely, set eval gates, and advance model release criteria based on measurable production outcomes.
Location: San Francisco, Australia
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Research and improve LLM behavior for real-time voice conversations.
  • •Design and run fine-tuning experiments across data, model, and evaluation strategies.
  • •Build evaluation frameworks for model quality, reliability, task completion, and conversation naturalness.
  • •Analyze production conversations to identify failure modes and opportunities for improvement.
  • •Partner with engineering to deploy research improvements safely and help define model release criteria and eval gates.

Pay and Benefits

Salary: USD 150,000 - 180,000 annually

Key Requirements

  • •Strong experience with machine learning and modern language models.
  • •Hands-on experience fine-tuning, evaluating, or adapting language models.
  • •Strong Python skills and comfort working with messy, real-world datasets.
  • •Ability to design rigorous experiments and interpret results clearly.
  • •Experience building or improving evaluation systems for AI models.
Experience:3+ yearsMachine learning
Skills:Analytical thinkingDebuggingCommunication
Tech Stack:PythonLLMsSFTDPORLHFLoRAQLoRAVLLM

Eligibility

Nationality:US National

Company Brief

Phonely
Develops AI-driven voice agents that automate phone conversations for businesses, handling customer support, lead qualification, and sales outreach. Their platform uses natural language understanding and speech synthesis to conduct human-like calls and integrate with CRM systems.
Industry: AI & Machine Learning
Website