Salesforce

2 weeks ago

Senior Software Engineer - AI Tooling & Automation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 20 hours agoStatus: Live

Job Summary

Build and evolve AI-first testing and automation for Revenue Action Orchestration (RAO), validating complex workflows and agentic capabilities for Sales Agent and Forecasting. You’ll translate quality strategies into CI/CD automation, perform white-box testing and fix code and flaky tests, and support human-in-the-loop model evaluation for LLM integrations. Collaborate across product, data science, and AI teams to deliver reliable, scalable enterprise AI experiences.

Location: San Francisco

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design, build, and maintain scalable AI-first testing frameworks and automation suites for RAO workflows and agentic capabilities.
•Translate quality strategies into actionable automation plans, validating LLM integrations, prompt accuracy, and deterministic system behaviors.
•Perform hands-on white-box testing by analyzing application code to identify quality gaps and address code and test flakiness.
•Implement and support evaluation processes for subjective AI feature quality dimensions such as response relevance, user safety, and contextual accuracy.
•Partner with developers and product managers to integrate quality early and continuously throughout the agile delivery lifecycle.

Pay and Benefits

Salary: USD 148,500 - 223,900 annually

Perks:MedicalDentalVisionHealth InsurancePaid ParentalLife InsuranceDisability Insurance401kEquity

Key Requirements

•Strong fundamentals in Java, especially data structures and algorithms.
•Hands-on experience evaluating large language models (LLMs) for response quality, including familiarity with GPT-like models and AI evaluation frameworks.
•Proven ability to deliver automation in a fast-paced CI/CD environment without compromising quality.
•Excellent collaboration and communication skills working cross-functionally with product managers, engineers, AI/ML engineers, and data scientists.
•Track record focused on identifying quality gaps and driving improvements.

Experience:AILLMCI/CDEnterprise softwareAgentic workflows

Skills:CommunicationCollaborationProblem-solvingAnalytical thinkingAttention to detail

Tech Stack:JavaLLMsGPT-like modelsCI/CDWhite-box testingAWSAzureGCPSalesforce platformSales AgentForecastingLLM integrationsDeterministic system behaviorsPrompt accuracy

Company Brief

Salesforce

Provides a leading cloud-based customer relationship management (CRM) platform with sales, service, marketing, analytics, and integration tools that empower businesses to manage customer relationships and digital transformation at scale.

Industry: SaaS

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: San Francisco, United States

Founded: 1999

Glassdoor: 4.1

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

Salesforce

2 weeks ago

Senior Software Engineer - AI Tooling & Automation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 20 hours agoStatus: Live

Job Summary

Location: San Francisco

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design, build, and maintain scalable AI-first testing frameworks and automation suites for RAO workflows and agentic capabilities.
•Translate quality strategies into actionable automation plans, validating LLM integrations, prompt accuracy, and deterministic system behaviors.
•Perform hands-on white-box testing by analyzing application code to identify quality gaps and address code and test flakiness.
•Implement and support evaluation processes for subjective AI feature quality dimensions such as response relevance, user safety, and contextual accuracy.
•Partner with developers and product managers to integrate quality early and continuously throughout the agile delivery lifecycle.

Pay and Benefits

Salary: USD 148,500 - 223,900 annually

Perks:MedicalDentalVisionHealth InsurancePaid ParentalLife InsuranceDisability Insurance401kEquity

Key Requirements

•Strong fundamentals in Java, especially data structures and algorithms.
•Hands-on experience evaluating large language models (LLMs) for response quality, including familiarity with GPT-like models and AI evaluation frameworks.
•Proven ability to deliver automation in a fast-paced CI/CD environment without compromising quality.
•Excellent collaboration and communication skills working cross-functionally with product managers, engineers, AI/ML engineers, and data scientists.
•Track record focused on identifying quality gaps and driving improvements.

Experience:AILLMCI/CDEnterprise softwareAgentic workflows

Skills:CommunicationCollaborationProblem-solvingAnalytical thinkingAttention to detail

Tech Stack:JavaLLMsGPT-like modelsCI/CDWhite-box testingAWSAzureGCPSalesforce platformSales AgentForecastingLLM integrationsDeterministic system behaviorsPrompt accuracy

Company Brief

Salesforce

Industry: SaaS

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: San Francisco, United States

Founded: 1999

Glassdoor: 4.1

Website LinkedIn Glassdoor