LLM Evaluation Product Operations Specialist – TikTok

Own the end-to-end design and implementation of an evaluation framework for a TikTok in-app AI chatbot experience. Use user research and data analysis to define experience quality standards and guide improvements in model capability and user satisfaction. Partner with strategy and algorithm teams to build scenario-based evaluation metrics, and with international delivery teams to execute evaluation programs using automated evaluation methods that meet time and quality targets.