Senior AI Engineer

Ruby Labs
Albania, North Macedonia, Slovakia, Malta, Croatia, Czech Republic, Slovenia, Spain, Bulgaria, Poland, Montenegro, Estonia, Cyprus, Greece, Serbia, Georgia
Workplace: RemoteFull timeFunction: Data Science & Machine LearningSkills: ["Ownership","Responsibility","Engineering quality","Data-driven experimentation","Collaboration"]

Own end-to-end delivery of major AI features while ensuring production stability and predictable, high-quality AI outputs. Build and orchestrate agentic, tool-using workflows using MCP-based tool contracts and multi-provider LLM routing via OpenRouter. Drive prompt engineering, LLM experimentation and evaluation with Langfuse, run A/B tests, monitor reliability and performance, and write maintainable TypeScript across the Next.js/Node.js stack with strong testing and release practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Ruby Labs
Ruby Labs
1 month ago

Senior AI Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Own end-to-end delivery of major AI features while ensuring production stability and predictable, high-quality AI outputs. Build and orchestrate agentic, tool-using workflows using MCP-based tool contracts and multi-provider LLM routing via OpenRouter. Drive prompt engineering, LLM experimentation and evaluation with Langfuse, run A/B tests, monitor reliability and performance, and write maintainable TypeScript across the Next.js/Node.js stack with strong testing and release practices.
Location: Albania, North Macedonia, Slovakia, Malta, Croatia, Czech Republic, Slovenia, Spain, Bulgaria, Poland, Montenegro, Estonia, Cyprus, Greece, Serbia, Georgia
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Take complete ownership and deliver major AI engineering features within agreed timelines.
  • •Own AI output quality, structure, and predictability across user-facing AI interactions, including output-type-based systems (segmentation, routing, enforcement).
  • •Integrate and orchestrate multiple LLM providers via OpenRouter, managing model selection, fallback strategies, and cost optimization.
  • •Design and orchestrate tool-using/agentic AI workflows (including MCP-based tool contracts and reliable AI-to-system integrations) and build multi-step LLM workflows with orchestration frameworks like LangChain or LlamaIndex.
  • •Design and manage production prompt systems, run and analyze A/B tests across models, monitor quality/latency/release health with Langfuse, and drive debugging and reliability through testing, code reviews, and disciplined release practices.

Pay and Benefits

Perks:Remote WorkPaid LeavePaid HolidaysMacbook

Key Requirements

  • •6+ years of backend/full-stack software engineering experience, including production-grade TypeScript/Node.js; Next.js and/or Python experience is a plus.
  • •2+ years building AI/LLM systems in production.
  • •Deep hands-on experience with LLM APIs (OpenAI, Anthropic, or similar) in production environments.
  • •Experience with agentic AI, multi-agent orchestration, tool-based workflows (function calling/tool execution), and/or RAG pipelines (indexing, retrieval, re-ranking).
  • •Experience with LLM observability and evaluation tools such as Langfuse/LangSmith, and AI gateway/model routing solutions like OpenRouter; solid Redis and relational database (e.g., PostgreSQL) knowledge.
Experience:AI/LLM systemsAgentic AIRAG
Skills:OwnershipResponsibilityEngineering qualityData-driven experimentationCollaboration
Tech Stack:Next.jsTypeScriptNode.jsRedisLangfuseMixpanelOpenRouterMCPLangChainLlamaIndexOpenAIAnthropicPostgreSQLA/B testingRAGFunction callingTool executionLLM observabilityLLM-as-a-judgeRAGAS

Company Brief

Ruby Labs
Builds custom software products, platforms, and digital solutions for businesses, focusing on modern web and mobile development, UX design, and engineering consultancy to accelerate product delivery and technical strategy.
Industry: Professional Services
Website