Sr Machine Learning Engineering Manager - AI Quality and Governance

Workiva
United States
Workplace: RemoteFull timeUSD 193,000 - 308,000 annuallyFunction: Data Science & Machine LearningExperience: 10+ yearsEducation: bachelorsSkills: ["Leadership","Mentorship","Cross-functional communication","Continuous improvement","Technical excellence"]

Lead a multidisciplinary team building trustworthy AI quality and governance across Workiva’s AI platform and generative/agentic products. Own end-to-end quality strategy, release readiness, and automated quality gates for nondeterministic systems like RAG pipelines and agents. Architect a scalable evaluation platform for datasets, metrics, graders, and continuous evaluation, while embedding auditable governance and assurance controls across the AI lifecycle. Partner across Product, Engineering, Data Science, Security, Legal, and Risk to drive measurable, production-ready AI for enterprise use.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Workiva
Workiva
1 month ago

Sr Machine Learning Engineering Manager - AI Quality and Governance

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Lead a multidisciplinary team building trustworthy AI quality and governance across Workiva’s AI platform and generative/agentic products. Own end-to-end quality strategy, release readiness, and automated quality gates for nondeterministic systems like RAG pipelines and agents. Architect a scalable evaluation platform for datasets, metrics, graders, and continuous evaluation, while embedding auditable governance and assurance controls across the AI lifecycle. Partner across Product, Engineering, Data Science, Security, Legal, and Risk to drive measurable, production-ready AI for enterprise use.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Manager level

Key Responsibilities

  • •Lead, mentor, and develop a multidisciplinary team of software, ML, and quality engineers.
  • •Define and drive comprehensive AI product quality strategy and automated quality gates across unit, integration, end-to-end, performance, resilience, security, and production testing.
  • •Architect and deliver a scalable self-service AI evaluation platform with datasets, golden test sets, metrics, graders, benchmarks, and offline/online continuous evaluation.
  • •Build AI governance and assurance capabilities including traceability, lineage, versioning, approval workflows, and auditable evidence; partner with Security, Legal, Privacy, Compliance, and Risk.
  • •Collaborate across Product, Program Management, UX/UXR, Data Science, Security, Legal, Risk, and engineering leadership to define quality roadmaps and communicate quality signals and risks clearly.
Travel: Medium travel

Pay and Benefits

Salary: USD 193,000 - 308,000 annually
Equity and Bonus:Equity
Perks:401k

Key Requirements

  • •Bachelor’s degree in Computer Science, Engineering, Data Science, or related field (or equivalent experience).
  • •10+ years in software engineering, ML engineering, quality engineering, or related roles, including 4+ years leading an engineering team.
  • •Strong software engineering and systems-design fundamentals delivering and operating production SaaS/platform capabilities.
  • •Demonstrated experience establishing automated quality practices for distributed, cloud-based products.
  • •Practical understanding of the generative AI development lifecycle and challenges of evaluating nondeterministic systems (LLMs, RAG, embeddings, agents, tool use, prompt orchestration).
Experience:10+ yearsGenerative AIAgentic productsRAGSaaSPlatform engineeringDistributed cloudEnterprise risk
Education:Bachelor's in Computer Science, Engineering, Data Science, or related field
Skills:LeadershipMentorshipCross-functional communicationContinuous improvementTechnical excellence
Tech Stack:LLMsRAGEmbeddingsVector/hybrid searchAgentsPrompt orchestrationAWSAzureGCPCI/CD pipelinesOperational dashboardsKubernetesMicroservicesInfrastructure as codeDevOpsMLOpsObservabilityA/B testingDrift/regression detectionAdversarial testing

Company Brief

Workiva
Provides a cloud-based platform for connected reporting, compliance, and financial data collaboration. Workiva streamlines SEC reporting, ESG disclosures, and enterprise risk and compliance workflows for large organizations across industries.
Industry: RegTech
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Ames, United States
Founded: 2008
WebsiteLinkedIn