Salesforce

3 weeks ago

Senior Software Engineer - AI Tooling & Automation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 14 hours agoStatus: Live

Job Summary

Build and maintain AI-first validation and testing for Product Led Growth initiatives, ensuring Salesforce’s agentic features and LLM integrations are enterprise-quality and production-ready. You’ll design scalable testing frameworks, translate quality strategy into automation plans, perform white-box testing, and help reduce test flakiness. Collaborate across product development and AI teams to evaluate subjective quality dimensions like response relevance, user safety, and contextual accuracy.

Location: San Francisco, Palo Alto

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Sr. Manager level

Key Responsibilities

•Design, build, and maintain scalable AI-first testing frameworks and automation suites to validate PLG workflows and agentic capabilities.
•Translate quality strategies into actionable automation plans, including validating LLM integrations, prompt accuracy, and deterministic system behaviors.
•Perform hands-on code quality work and white-box testing to identify quality gaps, fix code, and address test flakiness.
•Implement human-in-the-loop evaluation processes for subjective AI feature quality dimensions such as response relevance, user safety, and contextual accuracy.
•Collaborate with developers, product managers, and engineers to integrate quality early and continuously throughout the agile delivery lifecycle.

Pay and Benefits

Salary: USD 148,500 - 223,900 annually

Perks:MedicalDentalVisionHealth InsurancePaid ParentalLife InsuranceDisability Insurance401kEquity

Key Requirements

•Strong technical fundamentals of Java, especially data structures and algorithms.
•Hands-on experience evaluating Large Language Models (LLMs) for quality responses, including familiarity with GPT-like models and AI evaluation frameworks.
•Proven ability to deliver automation solutions in fast-paced CI/CD environments without compromising quality.
•Excellent collaboration and communication skills working cross-functionally with product managers, engineers, AI/ML engineers, and data scientists.
•Strong analytical and problem-solving abilities to identify quality gaps and drive improvement.

Experience:AIAgentic productsGenerative AILLM evaluation

Skills:CollaborationCommunicationProblem-solvingAnalytical skills

Tech Stack:JavaLLMsGPT-like modelsAI evaluation frameworksCI/CDWhite-box testingAWSAzureGCPSalesforceLLM integrationsPrompt accuracy

Company Brief

Salesforce

Provides a leading cloud-based customer relationship management (CRM) platform with sales, service, marketing, analytics, and integration tools that empower businesses to manage customer relationships and digital transformation at scale.

Industry: SaaS

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: San Francisco, United States

Founded: 1999

Glassdoor: 4.1

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

Salesforce

3 weeks ago

Senior Software Engineer - AI Tooling & Automation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 14 hours agoStatus: Live

Job Summary

Location: San Francisco, Palo Alto

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Sr. Manager level

Key Responsibilities

•Design, build, and maintain scalable AI-first testing frameworks and automation suites to validate PLG workflows and agentic capabilities.
•Translate quality strategies into actionable automation plans, including validating LLM integrations, prompt accuracy, and deterministic system behaviors.
•Perform hands-on code quality work and white-box testing to identify quality gaps, fix code, and address test flakiness.
•Implement human-in-the-loop evaluation processes for subjective AI feature quality dimensions such as response relevance, user safety, and contextual accuracy.
•Collaborate with developers, product managers, and engineers to integrate quality early and continuously throughout the agile delivery lifecycle.

Pay and Benefits

Salary: USD 148,500 - 223,900 annually

Perks:MedicalDentalVisionHealth InsurancePaid ParentalLife InsuranceDisability Insurance401kEquity

Key Requirements

•Strong technical fundamentals of Java, especially data structures and algorithms.
•Hands-on experience evaluating Large Language Models (LLMs) for quality responses, including familiarity with GPT-like models and AI evaluation frameworks.
•Proven ability to deliver automation solutions in fast-paced CI/CD environments without compromising quality.
•Excellent collaboration and communication skills working cross-functionally with product managers, engineers, AI/ML engineers, and data scientists.
•Strong analytical and problem-solving abilities to identify quality gaps and drive improvement.

Experience:AIAgentic productsGenerative AILLM evaluation

Skills:CollaborationCommunicationProblem-solvingAnalytical skills

Tech Stack:JavaLLMsGPT-like modelsAI evaluation frameworksCI/CDWhite-box testingAWSAzureGCPSalesforceLLM integrationsPrompt accuracy

Company Brief

Salesforce

Industry: SaaS

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: San Francisco, United States

Founded: 1999

Glassdoor: 4.1

Website LinkedIn Glassdoor