AI Engineer 5 (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning)

Discover Financial
New York, San Francisco, Cambridge, San Jose
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Presentation","Collaboration","Mentorship","Problem-solving"]

Build responsible, scalable AI systems for banking on the Intelligent Foundations and Experiences team. Design, develop, deploy, and support AI software components across foundation model training, LLM inference, agents and multi-agent workflows, vector search, guardrails, evaluation, governance, and observability. Use Open Source and SaaS AI stacks (including AWS, Hugging Face, vector databases, and PyTorch) to optimize training and inference for cost, latency, and throughput.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Discover Financial
Discover Financial
14 hours ago

AI Engineer 5 (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Build responsible, scalable AI systems for banking on the Intelligent Foundations and Experiences team. Design, develop, deploy, and support AI software components across foundation model training, LLM inference, agents and multi-agent workflows, vector search, guardrails, evaluation, governance, and observability. Use Open Source and SaaS AI stacks (including AWS, Hugging Face, vector databases, and PyTorch) to optimize training and inference for cost, latency, and throughput.
Location: New York, San Francisco, Cambridge, San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Partner with cross-functional engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • •Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • •Develop state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
  • •Design and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models into unified systems.
  • •Establish cost-performance governance reviews and lead technical design councils/design review boards; mentor principal and manager-level AI engineers.

Key Requirements

  • •Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree plus at least 4 years.
  • •At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • •Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, CUDA, or Golang.
  • •Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
  • •Experience leading development AI systems with tradeoff decisions around cost, latency, throughput, and accuracy.
Experience:6+ yearsBankingMachine learningLLMCloud
Education:Bachelor's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Skills:CommunicationPresentationCollaborationMentorshipProblem-solving
Tech Stack:PythonGoScalaCUDAJavaC++C#GolangAWSGoogle CloudAzureHuggingfaceVectorDBsPyTorchOpen SourceLLMLarge language model inferenceVector searchGuardrailsObservability

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Discover Financial
Provides consumer banking products, credit cards, personal loans, and payment services through the Discover brand. It operates a major U.S. financial network and serves individuals and merchants with lending and digital payment solutions.
Industry: Retail Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 10M to 25M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Riverwoods, United States
Founded: 1985
WebsiteLinkedIn