Staff/Senior Staff Web3 Big Data Engineer

OKX
Hong Kong, Singapore
Workplace: OnsiteFull timeFunction: Solutions Engineering & Sales EngineeringExperience: 7+ yearsEducation: bachelorsSkills: ["Clear logical thinking","Problem decomposition","Troubleshooting","Cross-cultural communication","Team collaboration"]

Own the architecture and optimization of a Web3 big data platform, covering real-time/batch on-chain data pipelines, and building reliable data warehouse/lake standards. Develop AI-driven data applications that combine big data with LLM capabilities (e.g., Text2SQL, anomaly/fraud detection, risk models) and support AI infrastructure such as vector databases and embedding pipelines. Collaborate across AI/Algorithm, Product, Risk, and Growth teams while driving performance, reliability, and technology direction.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OKX
OKX
1 month ago

Staff/Senior Staff Web3 Big Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 11 hours agoStatus: Live

Job Summary

Own the architecture and optimization of a Web3 big data platform, covering real-time/batch on-chain data pipelines, and building reliable data warehouse/lake standards. Develop AI-driven data applications that combine big data with LLM capabilities (e.g., Text2SQL, anomaly/fraud detection, risk models) and support AI infrastructure such as vector databases and embedding pipelines. Collaborate across AI/Algorithm, Product, Risk, and Growth teams while driving performance, reliability, and technology direction.
Location: Hong Kong, Singapore
Workplace: Onsite
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Mid level

Key Responsibilities

  • •Own the architecture, development, and optimization of a big data platform for large-scale on-chain data, trading behavior, and user profile analysis.
  • •Design and build real-time/batch on-chain data pipelines for blockchain transactions, smart contract events, and wallet address behavior.
  • •Build and maintain the data warehouse/lake, defining data-layering standards and ensuring data quality, consistency, and timeliness.
  • •Combine big data with LLM capabilities to build intelligent applications such as on-chain anomaly/fraud detection, smart risk models, user behavior prediction, and Text2SQL.
  • •Build AI data infrastructure for AI use cases, including vector databases, feature platforms, and embedding pipelines supporting RAG retrieval and agent data supply.

Key Requirements

  • •Bachelor's degree or above in Computer Science, Software Engineering, or a related field, with 7+ years of big data development experience.
  • •Proficiency with Hadoop, Spark, and Flink, with experience building batch/real-time data warehouses.
  • •Familiarity with Hive, Kafka, HBase, ClickHouse, and Doris, including large-scale cluster tuning experience.
  • •Strong big data development skills in Java/Scala/Python, with solid SQL tuning ability.
  • •Hands-on experience with LLM fundamentals, prompt engineering, and RAG, plus vector databases/embedding data processing (e.g., Milvus, Pinecone, Weaviate, pgvector).
Experience:7+ yearsWeb3BlockchainOn-chain analyticsCrypto
Education:Bachelor's in Computer Science, Software Engineering, or related field
Skills:Clear logical thinkingProblem decompositionTroubleshootingCross-cultural communicationTeam collaboration
Certifications:AWS big dataGCP big dataAI certifications
Languages:English
Tech Stack:HadoopSparkFlinkHiveKafkaHBaseClickHouseDorisJavaScalaPythonSQLLLMsPrompt engineeringRAGText2SQLVector databasesMilvusPineconeWeaviate

Company Brief

OKX
Global cryptocurrency exchange and Web3 technology provider offering spot and derivatives trading, custody, wallet services, and blockchain infrastructure to retail and institutional users worldwide.
Industry: Trading Platforms
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: Victoria, Seychelles
Founded: 2017
WebsiteLinkedIn