Software Engineer - Data Storage & Data Lake (ByteDance Singapore)

ByteDance
Singapore
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 3+ yearsEducation: bachelorsSkills: ["Troubleshooting","Willingness to learn","Problem-solving","Strong coding skills"]

Build and evolve ByteDance’s data storage and data lake infrastructure powering offline and real-time recommendation systems for over a billion users. Design and implement distributed storage components (HBase-related) and single-node storage engines (RocksDB/LSM), along with scalable offline/online data architecture. Troubleshoot production systems, and develop batch and stream processing frameworks that deliver reliable, high-performance infrastructure at massive scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Software Engineer - Data Storage & Data Lake (ByteDance Singapore)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 31 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build and evolve ByteDance’s data storage and data lake infrastructure powering offline and real-time recommendation systems for over a billion users. Design and implement distributed storage components (HBase-related) and single-node storage engines (RocksDB/LSM), along with scalable offline/online data architecture. Troubleshoot production systems, and develop batch and stream processing frameworks that deliver reliable, high-performance infrastructure at massive scale.
Location: Singapore
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and develop distributed database (HBase-related) components.
  • •Design and develop single-node LSM engine (RocksDB-related) components.
  • •Design and implement offline/real-time data architecture for large-scale recommendation systems.
  • •Build scalable, high-performance storage systems and computation models for offline and online workloads.
  • •Troubleshoot production systems and implement mechanisms/tools to ensure overall production stability; build distributed processing frameworks for massive data at large scale.

Key Requirements

  • •Bachelor’s degree or above in Computer Science or a related field with 3+ years building scalable systems.
  • •Proficiency in big data processing systems such as Spark and Flink at the source code level, including customizing/extending them.
  • •Strong programming skills in Java, C++, and Scala, with ability to troubleshoot effectively.
  • •Knowledge of HDFS principles and familiarity with columnar storage formats such as Parquet or ORC.
  • •Experience with data warehousing modeling and other big data systems/frameworks such as Hive, HBase, or Kudu is preferred/plus.
Experience:3+ yearsBig dataData lakeRecommendation systemsDistributed systemsStream processing
Education:Bachelor's in Computer Science (or related fields)
Skills:TroubleshootingWillingness to learnProblem-solvingStrong coding skills
Tech Stack:HBaseRocksDBLSMSparkFlinkHudiIcebergDeltaLakeHDFSParquetORCHiveKuduJavaC++Scala

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn