Sr AI Architect - Conversational AI

Twilio
United States
Workplace: RemoteFull timeUSD 275,840 - 405,600 annuallyFunction: Data Science & Machine LearningExperience: 15+ yearsEducation: mastersSkills: ["Communication","Collaboration","Mentorship","Strategic influence"]

Lead Twilio’s conversational AI technical direction by defining a long-term AI/ML architectural vision and setting guardrails for responsible systems. Own the ML/AI Ops platform roadmap and unify model development, deployment, and lifecycle management. Evaluate modern LLM architectures, RAG, and agentic AI systems while driving inference optimization, monitoring, and evaluation. Partner with Product Management and work hands-on through deep code reviews and pair programming.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Twilio
Twilio
1 month ago

Sr AI Architect - Conversational AI

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live

Job Summary

Lead Twilio’s conversational AI technical direction by defining a long-term AI/ML architectural vision and setting guardrails for responsible systems. Own the ML/AI Ops platform roadmap and unify model development, deployment, and lifecycle management. Evaluate modern LLM architectures, RAG, and agentic AI systems while driving inference optimization, monitoring, and evaluation. Partner with Product Management and work hands-on through deep code reviews and pair programming.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Define and drive a long-term AI/ML architectural vision aligned to business goals, focusing on how data and memory power next-generation customer engagement.
  • •Own the strategic roadmap for the ML/AI Ops platform and tooling, ensuring unified model development, deployment, and lifecycle management.
  • •Evaluate and implement modern LLM architectures, RAG systems, MCP/tooling frameworks, and inference optimization techniques.
  • •Lead architecture for agentic AI systems, including orchestration, reasoning, tool usage, and contextual grounding.
  • •Transition between executive-level technical communication and deep-dive engineering through code reviews, pair programming, and mentorship, while partnering with Product Management to deliver customer value.
Travel: Low travel

Pay and Benefits

Salary: USD 275,840 - 405,600 annually
Equity and Bonus:Equity
Perks:Health Insurance401kPaid SickPaid PersonalPaid Parental

Key Requirements

  • •15+ years of software engineering experience, including at least 6+ years building and scaling production-grade ML systems at a platform level.
  • •Extensive experience with ML Ops and LLM Ops, including evaluation metrics, automated retraining loops, and monitoring for non-deterministic AI at scale.
  • •Deep expertise designing, architecting, and deploying production-grade ML/AI systems (transformer models, LLM orchestration, embedding models, inference optimization, and vector stores).
  • •Deep understanding of the Context Engineering lifecycle (semantic retrieval, contextual compression, and state management across multi-turn conversations).
  • •Strong background building cloud-based services using AWS, GCP, or Azure with experience managing high-volume data and data stores.
Experience:15+ yearsMLLLM Ops
Education:Master's in Computer Science, Machine Learning, Data Science, Statistics, or a closely related quantitative field
Skills:CommunicationCollaborationMentorshipStrategic influence
Languages:English
Tech Stack:AWSGCPAzureLLMRAGMCPTransformer modelsLLM orchestrationEmbedding modelsInference optimizationVector storesAgentic AISemantic retrievalContextual compressionMulti-turn conversations

Company Brief

Twilio
Provides cloud communications platforms and APIs enabling developers to add voice, messaging, video, and authentication features to applications. Serves enterprises and developers with programmable communications, engagement, and customer interaction tools.
Industry: API Platforms
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Francisco, United States
Founded: 2008
Glassdoor
Glassdoor: 4.0
WebsiteLinkedIn