Staff Machine Learning Engineer

SurveyMonkey
Italy
Workplace: HybridFull timeFunction: Data Science & Machine LearningExperience: 10+ yearsSkills: ["Mentorship","Technical leadership","Cross-functional collaboration","Continuous improvement","Stakeholder partnership"]

Join the Product Data Science team as a Staff Machine Learning Engineer and technical leader for AI/ML growth at scale. Architect reusable NLP/ML/AI components, define standards for model and platform decisions, and build end-to-end solutions from deployment through continuous improvement. Own monitoring and telemetry, create evaluation frameworks (including LLM-as-Judge), and deliver in-product integrations using modern LLM, RAG, and prompt engineering—while mentoring engineers across teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
SurveyMonkey
SurveyMonkey
4 weeks ago

Staff Machine Learning Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Join the Product Data Science team as a Staff Machine Learning Engineer and technical leader for AI/ML growth at scale. Architect reusable NLP/ML/AI components, define standards for model and platform decisions, and build end-to-end solutions from deployment through continuous improvement. Own monitoring and telemetry, create evaluation frameworks (including LLM-as-Judge), and deliver in-product integrations using modern LLM, RAG, and prompt engineering—while mentoring engineers across teams.
Location: Italy
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Sr. Manager level

Key Responsibilities

  • •Serve as a technical leader for ML/AI product initiatives, authoring and guiding architectural decisions and establishing standards for adoption across teams.
  • •Delegate effectively and mentor engineers across teams, handling complex deliverables and end-to-end ownership from deployment through iterative enhancements.
  • •Architect scalable ML platforms and production data pipelines, integrating new data sources through cross-functional collaboration.
  • •Build monitoring and telemetry to detect complex failure modes, predictive accuracy deterioration, and usage pattern changes.
  • •Deliver tailored AI solutions by training, fine-tuning, and deploying models across statistical methods to cutting-edge LLMs, collaborating with product and engineering to iterate on in-product experiences.

Key Requirements

  • •10+ years of experience building and maintaining machine learning models in production environments.
  • •Strong expertise in Natural Language Processing, statistical modelling and analysis, and modern ML methods, including hands-on work designing novel architectures.
  • •Experience working with data at scale, including Human-In-The-Loop labelling and training/scaling usable data, with foundational exploratory data analysis.
  • •Proven expertise creating evaluations and evaluation platforms for non-deterministic systems, including LLM-as-Judge and traditional model evaluation.
  • •Experience building production monitoring and feedback loops using active feedback, passive signals, and user behaviors to improve user-journey performance.
Experience:10+ years
Skills:MentorshipTechnical leadershipCross-functional collaborationContinuous improvementStakeholder partnership
Tech Stack:NLPMachine LearningAILLMsLLM-as-JudgeRAGPrompt engineeringCI/CDAWSKafkaEKSSageMakerAthena

Company Brief

SurveyMonkey
Provides an online survey platform and experience management tools that help organizations collect, analyze, and act on feedback from customers, employees, and markets through surveys, forms, and analytics.
Industry: Enterprise Software
Company Size: Enterprise (1,001+ employees)
Revenue: USD 250M to 500M
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Mateo, United States
Founded: 1999
Glassdoor
Glassdoor: 3.8
WebsiteLinkedInGlassdoor