Drata

1 month ago

Senior Applied Research Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 4 hours agoStatus: Live

Job Summary

Seeking a Senior Applied Research Engineer to drive AI system quality through rigorous experimentation, evaluation, and applied research. You’ll own the science behind how AI products retrieve, reason, and respond, collaborating with AI and software engineers to turn validated approaches into production-ready, compliant solutions in a fast-paced, hybrid Bay Area team.

Location: San Francisco

Workplace: Hybrid

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Sr. Manager level

Key Responsibilities

•Design and evaluate information access + reasoning strategies across RAG, agents, and classic ML: chunking, embedding models, hybrid search, metadata filtering, semantic routing
•Prototype GenAI workflows (including agentic systems) that map and reason over compliance objects (controls ↔ risks ↔ requirements ↔ evidence)
•Explore ML + probabilistic approaches where GenAI is not the best fit: classifiers, ranking models, graph/link prediction, calibration, and structured prediction
•Build and maintain evaluation frameworks: golden datasets, automated quality metrics, regression detection
•Collaborate with AI and Software Engineers to hand off validated approaches for productionization

Pay and Benefits

Perks:RsusHealth Insurance401kParental Leave

Key Requirements

•5+ years of experience in applied research, data science, or ML with a focus on NLP, information retrieval, or knowledge systems
•2+ years of hands-on experience building or contributing to production AI/ML systems
•Strong foundation in information retrieval: dense and sparse retrieval, embedding models, search relevance
•Experience with RAG systems: chunking strategies, vector databases, retrieval optimization
•Proficiency in evaluation methodology: metrics design, golden dataset creation, A/B testing, statistical significance

Experience:5+ yearsAiNlpInformation retrieval

Skills:PythonLLMInformation retrievalEmbeddingsVector databasesA/B testing

Languages:English

Tech Stack:PythonLLMRAGEmbeddingsVector databasesCross-encodersLearning-to-rank

Company Brief

Drata

Provides a continuous security and compliance automation platform to help companies achieve and maintain frameworks such as SOC 2, ISO 27001, HIPAA, and GDPR through automated evidence collection and monitoring. ([drata.com](https://drata.com/blog/fy25-momentum?utm_source=openai))

Industry: RegTech

Company Size: Large (251 to 1,000 employees)

Revenue: USD 100M to 250M

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series C

Headquarters: San Diego, United States

Founded: 2020

Glassdoor: 3.3

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

Drata

1 month ago

Senior Applied Research Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 4 hours agoStatus: Live

Job Summary

Location: San Francisco

Workplace: Hybrid

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Sr. Manager level

Key Responsibilities

•Design and evaluate information access + reasoning strategies across RAG, agents, and classic ML: chunking, embedding models, hybrid search, metadata filtering, semantic routing
•Prototype GenAI workflows (including agentic systems) that map and reason over compliance objects (controls ↔ risks ↔ requirements ↔ evidence)
•Explore ML + probabilistic approaches where GenAI is not the best fit: classifiers, ranking models, graph/link prediction, calibration, and structured prediction
•Build and maintain evaluation frameworks: golden datasets, automated quality metrics, regression detection
•Collaborate with AI and Software Engineers to hand off validated approaches for productionization

Pay and Benefits

Perks:RsusHealth Insurance401kParental Leave

Key Requirements

•5+ years of experience in applied research, data science, or ML with a focus on NLP, information retrieval, or knowledge systems
•2+ years of hands-on experience building or contributing to production AI/ML systems
•Strong foundation in information retrieval: dense and sparse retrieval, embedding models, search relevance
•Experience with RAG systems: chunking strategies, vector databases, retrieval optimization
•Proficiency in evaluation methodology: metrics design, golden dataset creation, A/B testing, statistical significance

Experience:5+ yearsAiNlpInformation retrieval

Skills:PythonLLMInformation retrievalEmbeddingsVector databasesA/B testing

Languages:English

Tech Stack:PythonLLMRAGEmbeddingsVector databasesCross-encodersLearning-to-rank

Company Brief

Drata

Industry: RegTech

Company Size: Large (251 to 1,000 employees)

Revenue: USD 100M to 250M

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series C

Headquarters: San Diego, United States

Founded: 2020

Glassdoor: 3.3

Website LinkedIn Glassdoor