SoFi Technologies

6 months ago

Senior Staff AI Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 3 hours agoStatus: Live

Job Summary

Shape and deliver production-level AI capabilities for SoFi’s independent risk organization. Lead technical architecture and strategy for an agentic, LLM-based AI platform, standardizing LangGraph orchestration, agent memory/state, model optimization (PEFT/LoRA), and unified model serving for low-latency inference. Define AI observability and testing standards for compliance and reliability, mentor engineers, and partner cross-functionally to ship advanced GenAI solutions in banking risk use cases.

Location: Seattle, San Francisco, New York

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Define long-term technical architecture and strategy for a next-generation agentic AI platform, including robust scalable frameworks and LLM deployment patterns.
•Architect and standardize graph-based LLM orchestration using LangGraph to solve complex multi-stage reasoning problems at scale.
•Develop persistent infrastructure for distributed agent memory/state to maintain context and reliability across nodes and regional failovers.
•Institutionalize advanced model optimization techniques (PEFT, compression) and support unified model serving for high-throughput, low-latency inference.
•Mentor AI engineers and drive AI operational excellence by designing AI observability, tracing/testing frameworks, and ensuring compliant production quality.

Pay and Benefits

Salary: USD 172,800 - 297,000 annually

Key Requirements

•Bachelor’s or Master’s degree in Computer Science, Data Science, AI, Machine Learning, or a related field (PhD is a plus).
•8+ years software development experience, including 3+ years deploying production-level AI applications used by customers or internal stakeholders.
•Expert-level experience with LangGraph for complex, stateful, multi-step reasoning and control flow in LLM applications.
•Deep understanding of LLM architectures, prompt engineering, and retrieval-augmented generation (RAG), including advanced text generation techniques.
•Expert-level proficiency with Python and experience building/integrating agentic solutions (including PEFT like LoRA and inference engines such as vLLM/Triton/TGI).

Experience:8+ yearsBankingFinancial servicesRisk managementGenAILLMAgentic AI

Education:Bachelor's in Computer Science, Data Science, AI, Machine Learning (or related field)

Skills:CommunicationConsensus-buildingAnalytical problem-solvingCollaborationAgile teamwork

Languages:English

Tech Stack:LangGraphLLMsNLPRAGPEFTLoRAVLLMNVIDIA TritonTGIKubernetesDockerAWSAzureGCPPythonReactSnowflakeDynamoDBElasticsearchPinecone

Company Brief

SoFi Technologies

Industry: Neobanking

Website

Loading job details...

Preparing the role view and application actions.

SoFi Technologies

6 months ago

Senior Staff AI Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 3 hours agoStatus: Live

Job Summary

Location: Seattle, San Francisco, New York

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Define long-term technical architecture and strategy for a next-generation agentic AI platform, including robust scalable frameworks and LLM deployment patterns.
•Architect and standardize graph-based LLM orchestration using LangGraph to solve complex multi-stage reasoning problems at scale.
•Develop persistent infrastructure for distributed agent memory/state to maintain context and reliability across nodes and regional failovers.
•Institutionalize advanced model optimization techniques (PEFT, compression) and support unified model serving for high-throughput, low-latency inference.
•Mentor AI engineers and drive AI operational excellence by designing AI observability, tracing/testing frameworks, and ensuring compliant production quality.

Pay and Benefits

Salary: USD 172,800 - 297,000 annually

Key Requirements

•Bachelor’s or Master’s degree in Computer Science, Data Science, AI, Machine Learning, or a related field (PhD is a plus).
•8+ years software development experience, including 3+ years deploying production-level AI applications used by customers or internal stakeholders.
•Expert-level experience with LangGraph for complex, stateful, multi-step reasoning and control flow in LLM applications.
•Deep understanding of LLM architectures, prompt engineering, and retrieval-augmented generation (RAG), including advanced text generation techniques.
•Expert-level proficiency with Python and experience building/integrating agentic solutions (including PEFT like LoRA and inference engines such as vLLM/Triton/TGI).

Experience:8+ yearsBankingFinancial servicesRisk managementGenAILLMAgentic AI

Education:Bachelor's in Computer Science, Data Science, AI, Machine Learning (or related field)

Skills:CommunicationConsensus-buildingAnalytical problem-solvingCollaborationAgile teamwork

Languages:English

Tech Stack:LangGraphLLMsNLPRAGPEFTLoRAVLLMNVIDIA TritonTGIKubernetesDockerAWSAzureGCPPythonReactSnowflakeDynamoDBElasticsearchPinecone

Company Brief

SoFi Technologies

Industry: Neobanking

Website