Software engineer - AI Agent Infra

ByteDance
San Jose
Workplace: OnsiteFull timeFunction: Software EngineeringEducation: bachelorsSkills: ["Problem-solving","Execution","Collaboration"]

Build the AI Agent infrastructure and platform for security use cases, enabling teams to rapidly build, deploy, and scale AI Agents. Own core components like agent runtimes/frameworks, tool and plugin ecosystems, workflow orchestration, memory and RAG systems, evaluation pipelines, observability, and cost governance. Develop backend services and APIs for the full AI Agent application lifecycle, and improve production readiness via experimentation, canary releases, monitoring, fallback mechanisms, and performance optimization.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Software engineer - AI Agent Infra

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 30 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build the AI Agent infrastructure and platform for security use cases, enabling teams to rapidly build, deploy, and scale AI Agents. Own core components like agent runtimes/frameworks, tool and plugin ecosystems, workflow orchestration, memory and RAG systems, evaluation pipelines, observability, and cost governance. Develop backend services and APIs for the full AI Agent application lifecycle, and improve production readiness via experimentation, canary releases, monitoring, fallback mechanisms, and performance optimization.
Location: San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Build foundational AI Agent infrastructure for the Security organization, including runtimes/frameworks, tool/plugin ecosystems, workflow orchestration, memory and knowledge/RAG systems, evaluation pipelines, observability, and cost governance.
  • •Design platform capabilities that help multiple teams build and operate AI Agents with access control, auditing, isolation, governance, and reliability guarantees.
  • •Implement and iterate AI Agent products for security scenarios such as security operations assistance, investigation and triage, risk analysis, policy understanding/generation, automated Q&A, and workflow automation.
  • •Develop robust backend services and APIs supporting the full lifecycle of AI Agent applications, including integration with internal tools, data systems, and business workflows.
  • •Improve AI application production readiness using evaluation, online experimentation, canary release, monitoring, fallback mechanisms, and performance optimization.

Key Requirements

  • •Bachelor’s degree (or above) in Computer Science or a related field.
  • •Proficiency in at least one programming language (Go, Java, Python, C, C++, C#, or JavaScript) with strong backend engineering skills.
  • •Strong computer science fundamentals including data structures, algorithms, operating systems, networking, and databases.
  • •Hands-on system design and engineering experience with distributed systems, service architecture, caching, messaging, and high-availability backend services.
  • •Ability to solve problems and execute effectively while collaborating across engineering, product, and domain teams.
Experience:AI Agent systemsLLM applicationsRAGAI/MLProduction AISecurity
Education:Bachelor's in Computer Science or a related field
Skills:Problem-solvingExecutionCollaboration
Tech Stack:GoJavaPythonCC++C#JavaScriptLLMsAI AgentsRAGWorkflow orchestrationAPIsDistributed systemsCachingMessagingObservabilityEvaluation pipelinesCanary release

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn