Staff AI Scientist

Fiddler AI
Palo Alto
Workplace: HybridFull timeFunction: Research & Scientific (R&D)Skills: ["Communication","Leadership","Problem-solving"]

Lead applied research and development for models and datasets at the core of a Trust Service, building guardrail classifiers and evaluators to keep LLMs and agentic apps safe, accurate, and compliant in production. Collaborate with engineering, Product, and Customer Success to deliver measurable value and scalable AI observability.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Fiddler AI
Fiddler AI
4 months ago

Staff AI Scientist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 11 hours agoStatus: Live

Job Summary

Lead applied research and development for models and datasets at the core of a Trust Service, building guardrail classifiers and evaluators to keep LLMs and agentic apps safe, accurate, and compliant in production. Collaborate with engineering, Product, and Customer Success to deliver measurable value and scalable AI observability.
Location: Palo Alto
Workplace: Hybrid
Employment Type: Full time
Job Function: Research & Scientific (R&D)

Key Responsibilities

  • •Lead applied research and development for the models and datasets at the core of Fiddler's Trust Service and guardrail classifiers and evaluators for production use
  • •Partner closely with other engineering teams, Product, and Customer Success to support AI observability journeys and deliver measurable value
  • •Design, train, and ship production classifiers for safety, security, and quality detection under latency and cost constraints
  • •Lead development of synthetic and adversarial dataset pipelines, including methods for generating, filtering, and validating data to reveal failure modes
  • •Drive the technical direction of generative insights and the LLM/agent-powered analysis layer that helps customers diagnose issues in AI applications and why they occur

Pay and Benefits

Perks:Paid LeaveHealth InsuranceDentalVision401kGym Membership

Key Requirements

  • •7+ years of applied AI experience with a track record of taking models from research to production
  • •Deep expertise in training and fine-tuning classifier models and encoder architectures (e.g., BERT-family)
  • •Hands-on experience with dataset development: sourcing, labeling, synthetic generation, adversarial augmentation, quality control
  • •Strong experience with LLMs and agentic systems: prompting, fine-tuning, evaluation
  • •Proficiency in Python and the modern ML stack (PyTorch, Hugging Face, common training/serving frameworks)
Experience:AILLMsObservability
Skills:CommunicationLeadershipProblem-solving
Languages:English
Tech Stack:PythonPyTorchHugging FaceLLMsDataset developmentAdversarial training

Company Brief

Fiddler AI
Provides an ML observability and explainability platform that helps enterprises monitor, explain, and debug machine learning models in production to ensure model performance, fairness, and regulatory compliance.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Funding: Series B
Headquarters: Palo Alto, United States
Founded: 2018
WebsiteLinkedIn