Replit

1 month ago

Staff Software Engineer, Trust & Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 2 hours agoStatus: Live

Job Summary

Defend Replit's platform from exploitation by designing guardrails for AI-generated code, building AI-powered detection systems, and owning end-to-end abuse response—from detection to enforcement—across millions of daily user actions in a security-focused, AI-native environment.

Location: United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions.
•Build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions.
•Build and operate abuse detection systems that identify phishing, cryptomining, account takeover, and financial fraud across millions of daily user actions.
•Design automated response mechanisms that enforce platform policies without manual intervention.
•Own the full abuse response lifecycle: detection, investigation, enforcement, and handling appeals alongside Support and Legal.

Pay and Benefits

Salary: USD 250,000 - 315,000 annually

Equity and Bonus:Equity

Perks:Health Insurance401kEquityRemote WorkWellness StipendCommuter BenefitsPaid ParentalLife Insurance

Key Requirements

•8+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection.
•Strong programming skills in Python and/or TypeScript for building detection systems and automation.
•Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar).
•Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection.
•Familiarity with prompt injection, jailbreaking, and other LLM-specific attack vectors.

Experience:8+ yearsSecurityTrust & safetyFraud detectionAI security

Skills:CommunicationProblem-solvingCollaborationAnalytical thinking

Tech Stack:PythonTypeScriptGoSQLBigQuerySnowflakeKubernetesGCPHexSlurperNetwatchSASTSCADependabotSnyk

Company Brief

Replit

Provides a browser-based integrated development environment (IDE) and collaborative coding platform that lets developers write, run, and deploy code instantly across many languages and frameworks.

Industry: Developer Tools

Company Size: Large (251 to 1,000 employees)

Growth: Scaleup

Headquarters: San Francisco, United States

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Replit

1 month ago

Staff Software Engineer, Trust & Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 2 hours agoStatus: Live

Job Summary

Location: United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions.
•Build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions.
•Build and operate abuse detection systems that identify phishing, cryptomining, account takeover, and financial fraud across millions of daily user actions.
•Design automated response mechanisms that enforce platform policies without manual intervention.
•Own the full abuse response lifecycle: detection, investigation, enforcement, and handling appeals alongside Support and Legal.

Pay and Benefits

Salary: USD 250,000 - 315,000 annually

Equity and Bonus:Equity

Perks:Health Insurance401kEquityRemote WorkWellness StipendCommuter BenefitsPaid ParentalLife Insurance

Key Requirements

•8+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection.
•Strong programming skills in Python and/or TypeScript for building detection systems and automation.
•Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar).
•Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection.
•Familiarity with prompt injection, jailbreaking, and other LLM-specific attack vectors.

Experience:8+ yearsSecurityTrust & safetyFraud detectionAI security

Skills:CommunicationProblem-solvingCollaborationAnalytical thinking

Tech Stack:PythonTypeScriptGoSQLBigQuerySnowflakeKubernetesGCPHexSlurperNetwatchSASTSCADependabotSnyk

Company Brief

Replit

Provides a browser-based integrated development environment (IDE) and collaborative coding platform that lets developers write, run, and deploy code instantly across many languages and frameworks.

Industry: Developer Tools

Company Size: Large (251 to 1,000 employees)

Growth: Scaleup

Headquarters: San Francisco, United States

Founded: 2016

Website LinkedIn