AI Engineer 5 (LLM Gateway, FM Hosting)

Discover Financial
San Jose, Virginia, Cambridge, New York
Workplace: OnsiteFull timeUSD 250,800 - 286,200 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Mentoring","Problem-solving"]

Build and deploy AI software components for foundation models, LLM inference, agents, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with cross-functional engineers and research scientists to deliver AI-powered products. Optimize performance for large-scale production through foundation model optimization, orchestration pipelines, and cost-performance governance. Lead design reviews and mentor senior engineers while advancing the long-term roadmap for foundational AI systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
14 hours ago

AI Engineer 5 (LLM Gateway, FM Hosting)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Build and deploy AI software components for foundation models, LLM inference, agents, similarity search, guardrails, evaluation, experimentation, governance, and observability. Partner with cross-functional engineers and research scientists to deliver AI-powered products. Optimize performance for large-scale production through foundation model optimization, orchestration pipelines, and cost-performance governance. Lead design reviews and mentor senior engineers while advancing the long-term roadmap for foundational AI systems.
Location: San Jose, Virginia, Cambridge, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional teams to deliver AI-powered products that improve how associates work and how customers interact.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents/multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
  • •Use Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, VectorDBs, PyTorch) to build and integrate AI solutions.
  • •Invent and introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • •Lead technical design councils/review boards to ensure consistency and compliance with AI engineering standards, and mentor Principal/Manager-level AI engineers.

Pay and Benefits

Salary: USD 250,800 - 286,200 annually

Key Requirements

  • •Bachelor’s degree in Computer Science/AI/Engineering (or related) plus 6+ years building AI/ML algorithms/technologies, or a Master’s plus 4+ years.
  • •6+ years programming with Python, Go, Scala, CUDA, or Java.
  • •Experience leading development of AI systems with tradeoffs across cost, latency, throughput, and accuracy (preferred).
  • •7+ years deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, or Azure (preferred).
  • •Experience designing, developing, delivering, and supporting complex AI systems, including LLM inference, similarity search/vector databases, guardrails, memory (preferred).
Experience:6+ years
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationPresentationMentoringProblem-solving
Tech Stack:PythonGoScalaCUDAJavaC++C#GolangAWSGoogle CloudAzureHuggingfacePyTorchVectorDBsLLMsLLM inferenceSimilarity searchGuardrailsAgentsMulti-agent workflows

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn