Member of Engineering (Evaluations / Engineering)

Poolside
United States, United Kingdom
Workplace: RemoteFull timeFunction: Software EngineeringSkills: ["Collaboration","Communication","Problem-solving"]

Design and build a scalable, self-serve evaluation platform to support research and development. Implement a Python-based framework for centralized internal and public benchmarks, and run distributed evaluations at scale while collaborating with modeling and product teams to improve experimentation tooling and ML workflows.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Poolside
Poolside
3 months ago

Member of Engineering (Evaluations / Engineering)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Design and build a scalable, self-serve evaluation platform to support research and development. Implement a Python-based framework for centralized internal and public benchmarks, and run distributed evaluations at scale while collaborating with modeling and product teams to improve experimentation tooling and ML workflows.
Location: United States, United Kingdom
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design a Python framework that makes it easy for poolsiders to implement both internal and public benchmarks in a centralized way
  • •Build and maintain the pipeline that runs distributed evaluations at scale
  • •Collaborate with modeling and product teams to identify opportunities to improve our experimentation and evaluation tooling

Pay and Benefits

Perks:Remote Work

Key Requirements

  • •Strong engineering background. Experience leading software projects cross functionally.
  • •Experience building highly reliable and well tested services.
  • •Experience with distributed systems and data pipelines, distributed processing.
  • •Experience with message queues, event-driven architectures (e.g., Kafka, Google Pub/Sub).
  • •Cloud experience with managed services/storage (GCP, AWS, Azure) and monitoring/alerting (Grafana, Prometheus, Datadog).
Skills:CollaborationCommunicationProblem-solving
Tech Stack:PythonKafkaGoogle Pub/SubGCPAWSAzureGrafanaPrometheusDatadog

Company Brief

Poolside
Builds foundation models, coding agents, and enterprise systems to automate and accelerate software development; offers on-prem/VPC deployments, developer tooling, and forward-deployed engineering for high‑security environments.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series B
Headquarters: San Francisco, United States
Founded: 2023
WebsiteLinkedIn