Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem

TikTok
San Jose
Workplace: OnsiteFull timeFunction: Solutions Engineering & Sales EngineeringEducation: bachelorsSkills: ["Problem-solving","Troubleshooting","System optimization","Learning agility","Independent exploration"]

Build offline and real-time storage and computing infrastructure for the TikTok Recommendation System. You’ll design and implement large-scale architectures using Paimon and Flink, optimize high-performance storage and computing models, and troubleshoot production issues by adding mechanisms for data consistency and exception recovery. Partner on distributed system construction spanning batch and stream processing to support massive recommendation, search, and advertising data at high reliability.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 month ago

Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live

Job Summary

Build offline and real-time storage and computing infrastructure for the TikTok Recommendation System. You’ll design and implement large-scale architectures using Paimon and Flink, optimize high-performance storage and computing models, and troubleshoot production issues by adding mechanisms for data consistency and exception recovery. Partner on distributed system construction spanning batch and stream processing to support massive recommendation, search, and advertising data at high reliability.
Location: San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Design and implement offline and real-time data architectures for large-scale recommendation, search, and advertising systems using Paimon and Flink.
  • •Design and implement flexible, scalable, stable, high-performance storage systems and computing models, using Paimon as storage and Flink for computation.
  • •Troubleshoot production systems and implement mechanisms and tools for data consistency assurance and exception recovery when issues occur in the Paimon-Flink architecture.
  • •Build distributed systems for offline and online storage and for batch and stream processing frameworks based on Flink and Paimon.
  • •Optimize system performance to handle challenges brought by business growth.

Key Requirements

  • •Design and implement offline and real-time data architectures for large-scale recommendation, search, and advertising systems using Paimon and Flink.
  • •Build and optimize flexible, scalable, stable, high-performance storage systems and computing models combining Paimon and Flink.
  • •Troubleshoot production issues in the Paimon-Flink architecture and implement mechanisms for data consistency assurance and exception recovery.
  • •Develop distributed systems for offline/online storage and batch/stream processing frameworks based on Paimon and Flink.
  • •Bachelor’s degree or above in a related field with experience building scalable systems; strong coding/problem-solving in Java, C++, and Scala.
Experience:Big data
Education:Bachelor's in computer science, software engineering, or related fields
Skills:Problem-solvingTroubleshootingSystem optimizationLearning agilityIndependent exploration
Tech Stack:PaimonFlinkJavaC++ScalaHiveHBaseKuduHDFSParquetORC

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn