OKX

2 weeks ago

Staff/Senior Staff Web3 Big Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Own the architecture and optimization of a Web3 big data platform, covering real-time/batch on-chain data pipelines, and building reliable data warehouse/lake standards. Develop AI-driven data applications that combine big data with LLM capabilities (e.g., Text2SQL, anomaly/fraud detection, risk models) and support AI infrastructure such as vector databases and embedding pipelines. Collaborate across AI/Algorithm, Product, Risk, and Growth teams while driving performance, reliability, and technology direction.

Location: Hong Kong, Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Solutions Engineering & Sales Engineering

Seniority: Mid level

Key Responsibilities

•Own the architecture, development, and optimization of a big data platform for large-scale on-chain data, trading behavior, and user profile analysis.
•Design and build real-time/batch on-chain data pipelines for blockchain transactions, smart contract events, and wallet address behavior.
•Build and maintain the data warehouse/lake, defining data-layering standards and ensuring data quality, consistency, and timeliness.
•Combine big data with LLM capabilities to build intelligent applications such as on-chain anomaly/fraud detection, smart risk models, user behavior prediction, and Text2SQL.
•Build AI data infrastructure for AI use cases, including vector databases, feature platforms, and embedding pipelines supporting RAG retrieval and agent data supply.

Key Requirements

•Bachelor's degree or above in Computer Science, Software Engineering, or a related field, with 7+ years of big data development experience.
•Proficiency with Hadoop, Spark, and Flink, with experience building batch/real-time data warehouses.
•Familiarity with Hive, Kafka, HBase, ClickHouse, and Doris, including large-scale cluster tuning experience.
•Strong big data development skills in Java/Scala/Python, with solid SQL tuning ability.
•Hands-on experience with LLM fundamentals, prompt engineering, and RAG, plus vector databases/embedding data processing (e.g., Milvus, Pinecone, Weaviate, pgvector).

Experience:7+ yearsWeb3BlockchainOn-chain analyticsCrypto

Education:Bachelor's in Computer Science, Software Engineering, or related field

Skills:Clear logical thinkingProblem decompositionTroubleshootingCross-cultural communicationTeam collaboration

Certifications:AWS big dataGCP big dataAI certifications

Languages:English

Tech Stack:HadoopSparkFlinkHiveKafkaHBaseClickHouseDorisJavaScalaPythonSQLLLMsPrompt engineeringRAGText2SQLVector databasesMilvusPineconeWeaviate

Company Brief

OKX

Global cryptocurrency exchange and Web3 technology provider offering spot and derivatives trading, custody, wallet services, and blockchain infrastructure to retail and institutional users worldwide.

Industry: Trading Platforms

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Headquarters: Victoria, Seychelles

Founded: 2017

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

OKX