Senior MLOps Engineer, LLMOps

TRM Labs
United States
Workplace: RemoteFull timeFunction: Solutions Engineering & Sales EngineeringSkills: ["Ownership","Collaboration","Communication","Problem-solving","Attention to detail"]

Senior MLOps Engineer focusing on LLMOps will build and scale AI/ML infrastructure for real-time AI applications, integrating CI/CD for model training and deployment, automating model versioning and compliance, and evaluating cutting-edge tools to advance AI reliability, governance, and performance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TRM Labs
TRM Labs
8 months ago

Senior MLOps Engineer, LLMOps

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Senior MLOps Engineer focusing on LLMOps will build and scale AI/ML infrastructure for real-time AI applications, integrating CI/CD for model training and deployment, automating model versioning and compliance, and evaluating cutting-edge tools to advance AI reliability, governance, and performance.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Build reusable CI/CD workflows for model training, evaluation, and deployment — integrating Langfuse, GitHub Actions, and experiment tracking.
  • •Automate model versioning, approval workflows, and compliance checks across environments.
  • •Build out a modular and scalable AI infrastructure stack — including vector databases, feature stores, model registries, and observability tooling.
  • •Partner with engineering and data science to embed AI models and agents into real-time applications and workflows.
  • •Continuously evaluate and integrate state-of-the-art AI tools (e.g. LangChain, LlamaIndex, vLLM, MLflow, BentoML).

Key Requirements

  • •Must have strong Python software development skills and hands-on experience with scalable infrastructure (Docker, Kubernetes)
  • •Experience with infrastructure-as-code tools (Terraform) and CI/CD pipelines
  • •Proficiency in monitoring/logging frameworks (Datadog, Prometheus, OpenTelemetry)
  • •Knowledge of ML Ops practices: model versioning, rollback, automated evaluation, drift detection
  • •Experience with AI tools for LLM/agent workflows (e.g., LangChain, LlamaIndex, vLLM, MLflow, BentoML)
Experience:AIML OpsLLMsSRECloud
Skills:OwnershipCollaborationCommunicationProblem-solvingAttention to detail
Tech Stack:PythonDockerKubernetesTerraformGitHub ActionsLangfuseLangChainLlamaIndexVLLMMLflowBentoMLDatadogPrometheusOpenTelemetryTriton

Company Brief

TRM Labs
Provides blockchain intelligence and crypto risk management solutions to help financial institutions, governments, and crypto firms detect fraud, trace illicit activity, and comply with regulatory requirements across digital asset ecosystems.
Industry: RegTech
Company Size: Large (251 to 1,000 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
Founded: 2018
WebsiteLinkedIn