Associate Evaluations Manager

Salesforce
Irvine, Seattle, Bellevue
Workplace: HybridFull timeUSD 94,000 - 142,300 annuallyFunction: Program & Project Management (PMO)Experience: 1+ yearsSkills: ["Analytical thinking","Root cause analysis","Operational rigor","Attention to detail","Clear communication","Learning agility","Execution reliability","Ownership","Curiosity"]

Own and advance Agentforce performance evaluation on Salesforce Help by running ongoing synthetic evaluations across answer quality, latency, and instruction adherence. Build repeatable processes and scalable evaluation frameworks, analyze results to find root causes, and deliver executive-ready reporting that drives product and operational decisions. Partner cross-functionally to refine LLM judge prompts, golden datasets, metrics, and automation to strengthen the evaluation feedback loop for new features and urgent initiatives.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Salesforce
Salesforce
1 day ago

Associate Evaluations Manager

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Own and advance Agentforce performance evaluation on Salesforce Help by running ongoing synthetic evaluations across answer quality, latency, and instruction adherence. Build repeatable processes and scalable evaluation frameworks, analyze results to find root causes, and deliver executive-ready reporting that drives product and operational decisions. Partner cross-functionally to refine LLM judge prompts, golden datasets, metrics, and automation to strengthen the evaluation feedback loop for new features and urgent initiatives.
Location: Irvine, Seattle, Bellevue
Workplace: Hybrid
Employment Type: Full time
Job Function: Program & Project Management (PMO)
Seniority: Entry level

Key Responsibilities

  • •Support the Agentforce baselining program using synthetic and automated tooling to continuously measure and improve performance.
  • •Analyze evaluation results to identify root causes, surface trends, and translate insights into actionable recommendations for models, implementations, and processes.
  • •Maintain and evolve evaluation frameworks, scoring rubrics, and guidelines to ensure consistent, defensible, scalable assessments.
  • •Deliver executive-ready reporting and business reviews that inform stakeholders and drive product and operational decisions.
  • •Evolve the evaluation ecosystem by refining LLM judge prompts and golden datasets, enabling automation, reliability, and efficiency while auditing the utterance repository.

Pay and Benefits

Salary: USD 94,000 - 142,300 annually
Perks:Health InsuranceDentalVisionPaid ParentalLife InsuranceDisability Insurance401kEquity

Key Requirements

  • •1+ years of professional experience working in Salesforce environments (program, analyst, operations, or product context) with ownership and independent task execution.
  • •Strong analytical mindset for reviewing conversational AI outputs, identifying failure patterns, conducting root cause analysis, and recommending actions.
  • •Operational rigor and attention to detail to execute repeatable evaluation workflows accurately and consistently in a fast-paced, ambiguous environment.
  • •Clear written communication skills to document findings and communicate insights concisely across cross-functional audiences.
  • •Data comfort using spreadsheets (e.g., Google Sheets), reporting, and basic dashboard interpretation to derive insights and track trends.
Experience:1+ yearsConversational AIGenerative AI
Skills:Analytical thinkingRoot cause analysisOperational rigorAttention to detailClear communicationLearning agilityExecution reliabilityOwnershipCuriosity
Tech Stack:SalesforceAgentforceSalesforce HelpGoogle SheetsTableauTesting CenterObservabilityLLMLLM judge promptsGolden datasetsPrompt engineering

Company Brief

Salesforce
Provides a leading cloud-based customer relationship management (CRM) platform with sales, service, marketing, analytics, and integration tools that empower businesses to manage customer relationships and digital transformation at scale.
Industry: SaaS
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Francisco, United States
Founded: 1999
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor