Senior Software Engineer

Atlassian
Seattle, San Francisco
Workplace: RemoteFull timeUSD 149,400 - 235,000 annuallyFunction: Software EngineeringSkills: []

Design and optimize large-scale AI inference model serving systems for Atlassian’s Central AI Org. Own distributed infrastructure such as global KV cache, continuous batching, load balancing, and auto-scaling, plus low-level GPU and inference optimizations like kernels, quantization, and speculative decoding. Build high-concurrency, reliable services and benchmarking/tuning workflows, and create CI/CD infrastructure for seamless model and engine updates.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Atlassian
Atlassian
2 days ago

Senior Software Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Design and optimize large-scale AI inference model serving systems for Atlassian’s Central AI Org. Own distributed infrastructure such as global KV cache, continuous batching, load balancing, and auto-scaling, plus low-level GPU and inference optimizations like kernels, quantization, and speculative decoding. Build high-concurrency, reliable services and benchmarking/tuning workflows, and create CI/CD infrastructure for seamless model and engine updates.
Location: Seattle, San Francisco
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Architect and implement scalable distributed infrastructure for model serving, including load balancing, auto-scaling, batch scheduling, and global KV cache.
  • •Optimize latency and throughput of model inference for production workloads.
  • •Build reliable, high-concurrency serving systems capable of serving billions of requests.
  • •Benchmark, fine-tune, and accelerate inference engines.
  • •Create CI/CD infrastructure for seamless model deployment and inference engine updates.

Pay and Benefits

Salary: USD 149,400 - 235,000 annually

Key Requirements

  • •5+ years of software engineering experience and 2+ years of system performance optimization experience.
  • •Deep low-level systems programming (C/C++ or Rust).
  • •Experience with large-scale, high-concurrent production serving.
  • •Experience with GPU inference engines (vLLM, SGLang, Triton, TensorRT-LLM, etc.).
  • •Strong background in system optimizations like batching, caching, and load balancing.
Experience:AIMLLLMsDistributed systemsInferenceHigh-concurrency systems
Tech Stack:CC++RustVLLMSGLangTritonTensorRT-LLMGPUCI/CD

Company Brief

Atlassian
Atlassian develops collaboration and workflow software—Jira, Confluence, Trello, Loom and more—used by teams for project management, software development, and IT service management across enterprises worldwide.
Industry: Developer Tools
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Sydney, Australia
Founded: 2002
Glassdoor
Glassdoor: 3.1
WebsiteLinkedInGlassdoor