Senior Software Engineer, AI Infrastructure - Developer Tooling

ByteDance
San Jose
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 4+ yearsEducation: bachelorsSkills: ["Problem-solving","Analysis","Error recovery"]

Build the AI backbone for developer tools, working across retrieval (RAG) infrastructure, a coding agent, and evaluation frameworks. Design scalable retrieval pipelines with vector search and hybrid strategies, develop embeddings and re-ranking systems, and create agent architectures with tool use and robust context management. Own benchmarking and reproducible testing infrastructure to measure retrieval quality and coding-agent task completion at production scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Senior Software Engineer, AI Infrastructure - Developer Tooling

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 31 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build the AI backbone for developer tools, working across retrieval (RAG) infrastructure, a coding agent, and evaluation frameworks. Design scalable retrieval pipelines with vector search and hybrid strategies, develop embeddings and re-ranking systems, and create agent architectures with tool use and robust context management. Own benchmarking and reproducible testing infrastructure to measure retrieval quality and coding-agent task completion at production scale.
Location: San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and scale retrieval pipelines for RAG infrastructure, including vector search and hybrid retrieval strategies.
  • •Build and optimize embedding, chunking, and re-ranking systems, including query understanding and rewriting components.
  • •Develop coding agent architectures for multi-step code generation, refactoring, debugging, and diagnostics with tool-use patterns.
  • •Implement tool-use mechanisms such as function calling, code execution sandboxing, and file system interaction.
  • •Design and maintain evaluation frameworks, benchmark suites, and reproducible testing infrastructure with automated regression detection.

Key Requirements

  • •Bachelor's degree in CS, EE, or related field (or equivalent experience).
  • •4+ years of software engineering experience.
  • •Strong proficiency in Python (primary) and TypeScript/JavaScript.
  • •Experience with systems-level languages such as C++, Rust, or Go.
  • •Practical experience integrating LLMs into applications and understanding agent patterns (tool use, multi-turn reasoning, error recovery).
Experience:4+ yearsDeveloper toolsLLM applicationsRetrieval systemsCoding assistants
Education:Bachelor's in Computer Science or EE (or related field)
Skills:Problem-solvingAnalysisError recovery
Tech Stack:PythonTypeScriptJavaScriptC++RustGoLLMsVector searchBM25Hybrid retrievalEmbeddingsChunkingRe-rankingFunction callingCode execution sandboxingFile system interactionPrompt engineeringContext managementOutput parsingAST parsing

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn