Senior or Staff AI Infrastructure Engineer

TRM Labs
United States
Workplace: RemoteFull timeUSD 200,000 - 275,000 annuallyFunction: DevOps, Cloud & InfrastructureSkills: ["Ownership","Problem-solving","Collaboration","Communication","Mentorship"]

Senior or Staff AI Infrastructure Engineer responsible for building and scaling the AI/ML infrastructure stack, automating model workflows, and integrating cutting-edge tools. You’ll own CI/CD for model training and deployment, manage scalable infrastructure with vector databases and model registries, and collaborate with data science to deploy agents in real‑time applications while ensuring reliability and governance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TRM Labs
TRM Labs
5 months ago

Senior or Staff AI Infrastructure Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Senior or Staff AI Infrastructure Engineer responsible for building and scaling the AI/ML infrastructure stack, automating model workflows, and integrating cutting-edge tools. You’ll own CI/CD for model training and deployment, manage scalable infrastructure with vector databases and model registries, and collaborate with data science to deploy agents in real‑time applications while ensuring reliability and governance.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Sr. Manager level

Key Responsibilities

  • •Build reusable CI/CD workflows for model training, evaluation, and deployment — integrating Langfuse, GitHub Actions, and experiment tracking, etc.
  • •Automate model versioning, approval workflows, and compliance checks across environments.
  • •Build out a modular and scalable AI infrastructure stack — including vector databases, feature stores, model registries, and observability tooling.
  • •Partner with engineering and data science to embed AI models and agents into real-time applications and workflows.
  • •Continuously evaluate and integrate state-of-the-art AI tools (e.g. LangChain, LlamaIndex, vLLM, MLflow, BentoML, etc.).

Pay and Benefits

Salary: USD 200,000 - 275,000 annually
Equity and Bonus:Equity

Key Requirements

  • •Proficiency in Python with a strong ability to write high-quality, maintainable software.
  • •Strong background in scalable infrastructure: Docker, Kubernetes, Terraform, and CI/CD pipelines.
  • •Experience with ML Ops practices: model versioning, rollback strategies, automated evaluation, and drift detection.
  • •Experience deploying and maintaining LLM/agent workflows in production, including monitoring costs, latency, and traces.
  • •Ability to build reusable CI/CD workflows for model training, evaluation, and deployment (e.g., Langfuse, GitHub Actions, experiment tracking).
Experience:AI/MLInfrastructureLLMsMLOps
Skills:OwnershipProblem-solvingCollaborationCommunicationMentorship
Languages:English
Tech Stack:PythonDockerKubernetesTerraformCI/CDGitHub ActionsLangfuseLangChainLlamaIndexVLLMMLflowBentoMLDatadogPrometheusOpenTelemetryTritonVector databasesModel registriesObservability

Company Brief

TRM Labs
Provides blockchain intelligence and crypto risk management solutions to help financial institutions, governments, and crypto firms detect fraud, trace illicit activity, and comply with regulatory requirements across digital asset ecosystems.
Industry: RegTech
Company Size: Large (251 to 1,000 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
Founded: 2018
WebsiteLinkedIn