Senior Software Engineer, GenAI Platform

Deliveroo
London
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 5+ yearsEducation: bachelorsSkills: ["Technical leadership","Mentoring","Problem-solving","Ownership","Collaboration","Operational excellence"]

Join the GenAI Platform team to design and build production infrastructure for open-weights model serving and fine-tuning. Own the architecture across real-time GPU endpoints, high-throughput batch inference, autoscaling and GPU utilization, and supporting platform services like LLM/Agent gateways, evals, guardrails, and cost attribution. Lead ambiguous, high-impact systems, mentor engineers, and help push the cost/latency frontier for generative AI.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Deliveroo
Deliveroo
2 days ago

Senior Software Engineer, GenAI Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Join the GenAI Platform team to design and build production infrastructure for open-weights model serving and fine-tuning. Own the architecture across real-time GPU endpoints, high-throughput batch inference, autoscaling and GPU utilization, and supporting platform services like LLM/Agent gateways, evals, guardrails, and cost attribution. Lead ambiguous, high-impact systems, mentor engineers, and help push the cost/latency frontier for generative AI.
Location: London
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Lead the design and architecture of the open-weights model platform spanning inference and fine-tuning, including real-time GPU serving and high-throughput batch inference.
  • •Evolve the open-weights serving stack, including fine-tuning approaches (SFT/DPO/LoRA) and platform components like the LLM Gateway, Agent Gateway, evals infrastructure, guardrails, and cost attribution.
  • •Architect scalable, high-performance systems for model serving, batch inference, GPU autoscaling/utilization, and fine-tuning powering customer and internal automation use cases.
  • •Drive improvements to the cost and latency frontier of GPU inference and enable reliable model selection with fallback, observability, and cost controls.
  • •Partner with and raise the technical bar for ML engineers, product engineers, data scientists, and platform teams; mentor engineers and set technical direction for the centralized GenAI platform.

Key Requirements

  • •BSc, MSc or PhD in Computer Science (or equivalent).
  • •5+ years of industry experience in software engineering.
  • •Strong backend engineering fundamentals, especially in Python and distributed systems.
  • •Hands-on experience operating production systems with observability, debugging, reliability, incident response, and performance/cost optimization.
  • •Deep hands-on experience with LLM inference and/or fine-tuning of open-weight models in production (serving: latency/throughput/batching/autoscaling/GPU utilization; fine-tuning: SFT/DPO/LoRA).
Experience:5+ yearsGenerative AILLM inferenceGPU infrastructureML platformDistributed systemsProduction systems
Education:Bachelor's in Computer Science
Skills:Technical leadershipMentoringProblem-solvingOwnershipCollaborationOperational excellence
Tech Stack:PythonDistributed systemsLLM inferenceFine-tuningSFTDPOLoRAReal-time GPU servingBatch inferenceGPU autoscalingGPU utilizationLLM GatewayAgent GatewayEvals infrastructureGuardrailsCost attributionObservabilityAPIsData pipelinesLLM inference engines

Company Brief

Deliveroo
Deliveroo is a multinational online food and grocery delivery marketplace connecting consumers, restaurants, retailers and riders via its app and platform, operating across multiple countries with fast local delivery and logistics services.
Industry: Online Marketplaces
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Unicorn (USD 1B+)
Funding: IPO / Publicly Listed
Headquarters: London, United Kingdom
Founded: 2013
Glassdoor
Glassdoor: 3.4
WebsiteLinkedInGlassdoor