Staff MLOps Engineer, LLMOps

TRM Labs
North America, United States
Workplace: RemoteFull timeFunction: OtherSkills: ["Communication","Collaboration","Ownership","Problem-solving","Bias towards quality"]

Join TRM Labs as a Staff MLOps Engineer focused on LLMOps to build and scale AI/ML infrastructure. You’ll design reusable CI/CD workflows for model training and deployment, automate versioning and compliance, implement scalable AI infrastructure (vector DBs, registries, observability), and integrate cutting-edge tools while ensuring security, uptime, and governance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TRM Labs
TRM Labs
7 months ago

Staff MLOps Engineer, LLMOps

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Join TRM Labs as a Staff MLOps Engineer focused on LLMOps to build and scale AI/ML infrastructure. You’ll design reusable CI/CD workflows for model training and deployment, automate versioning and compliance, implement scalable AI infrastructure (vector DBs, registries, observability), and integrate cutting-edge tools while ensuring security, uptime, and governance.
Location: North America, United States
Workplace: Remote
Employment Type: Full time

Key Responsibilities

  • •Build reusable CI/CD workflows for model training, evaluation, and deployment, integrating Langfuse, GitHub Actions, and experiment tracking.
  • •Automate model versioning, approval workflows, and compliance checks across environments.
  • •Build out a modular and scalable AI infrastructure stack — including vector databases, feature stores, model registries, and observability tooling.
  • •Partner with engineering and data science to embed AI models and agents into real-time applications and workflows.
  • •Continuously evaluate and integrate state-of-the-art AI tools (e.g. LangChain, LlamaIndex, vLLM, MLflow, BentoML).

Key Requirements

  • •Must have strong software development ability, primarily in Python
  • •Experience building scalable infrastructure (Docker, Kubernetes) and container orchestration
  • •Proficient with infrastructure-as-code (Terraform) and CI/CD pipelines
  • •Familiar with monitoring/logging (Datadog, Prometheus, OpenTelemetry)
  • •Understanding ML Ops best practices (model versioning, drift detection, evaluation)
Experience:AIML OpsLLMsLLMOps
Skills:CommunicationCollaborationOwnershipProblem-solvingBias towards quality
Tech Stack:PythonDockerKubernetesTerraformCI/CDGitHub ActionsLangfuseLangChainLlamaIndexVLLMMLflowBentoMLDatadogPrometheusOpenTelemetryTritonObservability

Company Brief

TRM Labs
Provides blockchain intelligence and crypto risk management solutions to help financial institutions, governments, and crypto firms detect fraud, trace illicit activity, and comply with regulatory requirements across digital asset ecosystems.
Industry: RegTech
Company Size: Large (251 to 1,000 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
Founded: 2018
WebsiteLinkedIn