Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer

ByteDance
San Jose
InternshipFunction: Data Science & Machine LearningEducation: bachelorsSkills: ["Analytical thinking","Research ability","Engineering problem-solving"]

Build evaluation systems for LLM-based agents, including benchmark and automated judging pipelines that combine rule-based checks, model-based judging, and human review. Analyze agent execution traces and user feedback to identify failure patterns and translate them into system improvements. Support closed-loop learning from experience to capability by partnering with research, platform, and product teams to move methods into production.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
2 days ago

Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Build evaluation systems for LLM-based agents, including benchmark and automated judging pipelines that combine rule-based checks, model-based judging, and human review. Analyze agent execution traces and user feedback to identify failure patterns and translate them into system improvements. Support closed-loop learning from experience to capability by partnering with research, platform, and product teams to move methods into production.
Location: San Jose
Employment Type: Internship
Job Function: Data Science & Machine Learning
Seniority: Intern level

Key Responsibilities

  • •Design evaluation systems for LLM-based agents, covering task success, tool use, reasoning quality, and reliability.
  • •Build benchmarks and automated judging pipelines using rule-based checks, model-based judging, and human review.
  • •Analyze agent execution traces and user feedback to identify failure patterns and translate them into concrete system improvements.
  • •Support closed-loop learning from experience to capability with research, platform, and product teams to bring methods into production.

Key Requirements

  • •Currently pursuing a Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or related fields.
  • •Solid foundation in machine learning and deep learning.
  • •Hands-on experience with LLM-based systems such as agents, tool calling, retrieval, or multi-agent systems via research, internships, or projects.
  • •Strong Python skills and experience with a mainstream ML or agent evaluation framework.
  • •Demonstrated research or engineering ability through publications, substantial projects, internships, or open-source work.
Education:Bachelor's in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or related field
Skills:Analytical thinkingResearch abilityEngineering problem-solving
Tech Stack:PythonMachine learningDeep learningLLMRetrievalTool callingMulti-agent systems

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn