Replit

1 month ago

Senior Software Engineer, Trust & Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 2 hours agoStatus: Live

Job Summary

Join Replit’s Trust & Safety team to design and implement AI-native guardrails for AI-generated code, build scalable detection and automation systems, and lead end-to-end abuse response across millions of user actions. You’ll work on phishing, cryptomining, and fraud prevention, using ML/LLMs and BigQuery to defend a platform with real attackers.

Location: United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions
•Build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions
•Build and operate abuse detection systems that identify phishing, cryptomining, account takeover, and financial fraud across millions of daily user actions
•Design automated response mechanisms that enforce platform policies without manual intervention
•Own the full abuse response lifecycle: detection, investigation, enforcement, and handling appeals alongside Support and Legal

Pay and Benefits

Salary: USD 210,000 - 265,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceDentalVisionEquity401kRemote WorkPaid LeaveDisabilityWellness StipendCommuter Benefits

Key Requirements

•4+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection
•Strong programming skills in Python and/or TypeScript for building detection systems and automation
•Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar)
•Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection
•Familiarity with prompt injection, jailbreaking, and other LLM-specific attack vectors

Experience:4+ yearsSecurityTrust & safetyAbuse detection

Skills:CommunicationProblem-solvingTeamwork

Tech Stack:PythonTypeScriptGoSQLBigQueryHexSlurperNetwatchStytchClearOutDependabotSnykSASTSCAGCPKubernetesSlackLinearZendesk

Company Brief

Replit

Provides a browser-based integrated development environment (IDE) and collaborative coding platform that lets developers write, run, and deploy code instantly across many languages and frameworks.

Industry: Developer Tools

Company Size: Large (251 to 1,000 employees)

Growth: Scaleup

Headquarters: San Francisco, United States

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Replit

1 month ago

Senior Software Engineer, Trust & Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 2 hours agoStatus: Live

Job Summary

Location: United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions
•Build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions
•Build and operate abuse detection systems that identify phishing, cryptomining, account takeover, and financial fraud across millions of daily user actions
•Design automated response mechanisms that enforce platform policies without manual intervention
•Own the full abuse response lifecycle: detection, investigation, enforcement, and handling appeals alongside Support and Legal

Pay and Benefits

Salary: USD 210,000 - 265,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceDentalVisionEquity401kRemote WorkPaid LeaveDisabilityWellness StipendCommuter Benefits

Key Requirements

•4+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection
•Strong programming skills in Python and/or TypeScript for building detection systems and automation
•Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar)
•Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection
•Familiarity with prompt injection, jailbreaking, and other LLM-specific attack vectors

Experience:4+ yearsSecurityTrust & safetyAbuse detection

Skills:CommunicationProblem-solvingTeamwork

Tech Stack:PythonTypeScriptGoSQLBigQueryHexSlurperNetwatchStytchClearOutDependabotSnykSASTSCAGCPKubernetesSlackLinearZendesk

Company Brief

Replit

Provides a browser-based integrated development environment (IDE) and collaborative coding platform that lets developers write, run, and deploy code instantly across many languages and frameworks.

Industry: Developer Tools

Company Size: Large (251 to 1,000 employees)

Growth: Scaleup

Headquarters: San Francisco, United States

Founded: 2016

Website LinkedIn