Big Data Engineer, Data Ingestion

ByteDance
Singapore
Workplace: OnsiteFull timeFunction: Data Analytics & Business IntelligenceExperience: 2+ yearsEducation: bachelorsSkills: ["Problem-solving","Collaboration"]

Build and optimize large-scale real-time data ingestion systems for ByteDance’s Data Management Suite. You’ll design ingestion architectures for high throughput, low latency, and fault tolerance, improve pipeline performance and reliability, and create automated monitoring and maintenance. Partner with cross-functional teams to deliver event ingestion, transformation, and storage solutions, and troubleshoot production issues to minimize downtime and maximize performance at massive scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Big Data Engineer, Data Ingestion

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 30 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build and optimize large-scale real-time data ingestion systems for ByteDance’s Data Management Suite. You’ll design ingestion architectures for high throughput, low latency, and fault tolerance, improve pipeline performance and reliability, and create automated monitoring and maintenance. Partner with cross-functional teams to deliver event ingestion, transformation, and storage solutions, and troubleshoot production issues to minimize downtime and maximize performance at massive scale.
Location: Singapore
Workplace: Onsite
Employment Type: Full time
Job Function: Data Analytics & Business Intelligence
Seniority: Mid level

Key Responsibilities

  • •Design, develop, and optimize the architecture of large-scale data ingestion systems for real-time pipelines with high throughput, low latency, and fault tolerance.
  • •Enhance the performance, scalability, and reliability of data ingestion pipelines.
  • •Develop and implement automated and intelligent operation and maintenance systems to monitor, diagnose, and maintain pipeline stability.
  • •Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions meeting diverse requirements.
  • •Troubleshoot and resolve complex production issues to ensure minimal downtime and optimal performance.

Key Requirements

  • •Bachelor’s degree in Computer Science or equivalent practical experience.
  • •2+ years of experience in software development with one or more programming languages such as Java, Scala, Python, or Go.
  • •Strong understanding of data structures, algorithms, and distributed systems principles.
  • •Hands-on experience with big data technologies such as Hadoop, Flink, Kafka, or similar frameworks.
  • •Experience with real-time data processing frameworks like Flink is preferred.
Experience:2+ yearsBig dataReal-time data processingEvent trackingStream processingBatch processingData lakehouse
Education:Bachelor's
Skills:Problem-solvingCollaboration
Tech Stack:JavaScalaPythonGoHadoopFlinkKafka

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn