Member of Technical Staff - Model Serving / API Backend Engineer

Black Forest Labs
Freiburg, San Francisco
Workplace: HybridFull timeUSD 180,000 - 300,000 annuallyFunction: Software EngineeringSkills: ["Python","FastAPI","Async systems","Docker","Kubernetes","Redis","Postgres","Distributed task queues","AWS","GCP","Azure","Observability","Monitoring"]

Bridge research breakthroughs and production systems by turning research checkpoints into production-ready inference services, designing high-performance APIs that serve millions of requests, and optimizing GPU-based inference latency and throughput within scalable serving architectures.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Black Forest Labs
Black Forest Labs
1 year ago

Member of Technical Staff - Model Serving / API Backend Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 days agoStatus: Live

Job Summary

Bridge research breakthroughs and production systems by turning research checkpoints into production-ready inference services, designing high-performance APIs that serve millions of requests, and optimizing GPU-based inference latency and throughput within scalable serving architectures.
Location: Freiburg, San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Turn research checkpoints into production-ready inference services
  • •Design and maintain high-performance APIs serving millions of requests
  • •Optimize inference latency and throughput across GPU infrastructure
  • •Build scalable serving architectures that handle unpredictable traffic
  • •Improve reliability, monitoring, and observability across model-serving systems
Travel: Low travel

Pay and Benefits

Salary: USD 180,000 - 300,000 annually
Perks:Health Insurance401kRemote WorkPaid LeavePensionRsusEquity

Key Requirements

  • •Experience building and operating systems at meaningful scale with production-ready APIs and services
  • •Ability to navigate ambiguity and balance performance, reliability, and cost in real-world constraints
  • •Proven track record scaling APIs or ML systems under load and improving system throughput
  • •Experience with Python and API frameworks (e.g., FastAPI) and async processing
  • •Experience with containerization and orchestration (Docker, Kubernetes) and distributed data stores (Redis, Postgres)
Experience:AIMLGPUModel servingProduction APIs
Skills:PythonFastAPIAsync systemsDockerKubernetesRedisPostgresDistributed task queuesAWSGCPAzureObservabilityMonitoring
Languages:English
Tech Stack:PythonFastAPIDockerKubernetesRedisPostgreSQLPostgresAWSGCPAzureGPUCUDAObservabilityMonitoring

Company Brief

Black Forest Labs
Develops AI-driven solutions and provides machine learning consultancy to help businesses integrate advanced models and data-driven workflows. Focuses on prototyping, model deployment, and bespoke AI services to address industry-specific problems.
Industry: Consulting
Website