Senior or Staff ML Systems Engineer, LLMs

TRM Labs
United States
Workplace: RemoteFull timeUSD 200,000 - 275,000 annuallyFunction: IT Operations (Systems/Network Admin)Skills: ["Communication","Collaboration","Problem-solving","Ownership","Team-oriented"]

Senior or Staff ML Systems Engineer focused on building and scaling AI/ML infrastructure for LLMs and agentic systems. You’ll develop modular AI infrastructure, CI/CD workflows for model training and deployment, manage model versioning and compliance, evaluate cutting-edge AI tooling, and collaborate with data science and engineering to deploy AI in real-time applications with reliability and governance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TRM Labs
TRM Labs
5 months ago

Senior or Staff ML Systems Engineer, LLMs

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Senior or Staff ML Systems Engineer focused on building and scaling AI/ML infrastructure for LLMs and agentic systems. You’ll develop modular AI infrastructure, CI/CD workflows for model training and deployment, manage model versioning and compliance, evaluate cutting-edge AI tooling, and collaborate with data science and engineering to deploy AI in real-time applications with reliability and governance.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: IT Operations (Systems/Network Admin)

Key Responsibilities

  • •Build reusable CI/CD workflows for model training, evaluation, and deployment, integrating Langfuse, GitHub Actions, and experiment tracking.
  • •Automate model versioning, approval workflows, and compliance checks across environments.
  • •Build out a modular and scalable AI infrastructure stack, including vector databases, feature stores, model registries, and observability tooling.
  • •Partner with engineering and data science to embed AI models and agents into real-time applications and workflows.
  • •Continuously evaluate and integrate state-of-the-art AI tools (e.g. LangChain, LlamaIndex, vLLM, MLflow, BentoML).

Pay and Benefits

Salary: USD 200,000 - 275,000 annually
Equity and Bonus:Equity

Key Requirements

  • •Proficient in Python with strong software engineering practices
  • •Experience building scalable infrastructure (Docker, Kubernetes) and container orchestration
  • •Experience with infrastructure-as-code (Terraform) and CI/CD pipelines
  • •Familiarity with monitoring/logging tooling (Datadog, Prometheus, OpenTelemetry)
  • •Understanding of ML Ops practices (model versioning, drift detection, evaluation)
Experience:AIMLLLMsLLM tooling
Skills:CommunicationCollaborationProblem-solvingOwnershipTeam-oriented
Tech Stack:PythonDockerKubernetesTerraformCI/CDLangfuseGitHub ActionsDatadogPrometheusOpenTelemetryLangChainLlamaIndexVLLMMLflowBentoML

Company Brief

TRM Labs
Provides blockchain intelligence and crypto risk management solutions to help financial institutions, governments, and crypto firms detect fraud, trace illicit activity, and comply with regulatory requirements across digital asset ecosystems.
Industry: RegTech
Company Size: Large (251 to 1,000 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
Founded: 2018
WebsiteLinkedIn