Senior Software Engineer, Python + AI Platform

Smarsh
United States
Workplace: RemoteFull timeUSD 195,000 - 260,000 annuallyFunction: Software EngineeringSkills: ["Shipping","Reliability focus","Observability mindset","Security/compliance mindset","Collaboration"]

Build and scale agentic AI backend systems by developing fast, early-stage Python services for workflow execution and platform capabilities. Own end-to-end design and productionization of LLM-driven workflows, including tool-calling, state machines, reliability/observability, and secure multi-tenant architecture. Collaborate with a small cross-functional team to harden integrations (Bedrock/OpenAI/Anthropic), optimize for performance at massive scale, and deliver typed, schema-driven API contracts.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Smarsh
Smarsh
4 days ago

Senior Software Engineer, Python + AI Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and scale agentic AI backend systems by developing fast, early-stage Python services for workflow execution and platform capabilities. Own end-to-end design and productionization of LLM-driven workflows, including tool-calling, state machines, reliability/observability, and secure multi-tenant architecture. Collaborate with a small cross-functional team to harden integrations (Bedrock/OpenAI/Anthropic), optimize for performance at massive scale, and deliver typed, schema-driven API contracts.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Drive backend development for agentic AI workflows by building and evolving Python/FastAPI services powering core workflow execution and platform capabilities.
  • •Productionize LLM integrations (e.g., Bedrock usage) with reliability controls such as quotas, retries, failover, cost controls, and approval constraints.
  • •Design for security and compliance in multi-tenant, role-based, and auditable systems to ensure traceable, reproducible AI outputs.
  • •Improve platform reliability and operations for LLM pipelines and workflow execution using monitoring, tracing, alerting, and operational tooling.
  • •Build for scale and real-time capabilities using async job orchestration, performance tuning, and event delivery/pub-sub patterns to support live workflow state and notifications.

Pay and Benefits

Salary: USD 195,000 - 260,000 annually

Key Requirements

  • •7+ years of professional software development with 5+ years building Python services in production.
  • •Strong backend experience with APIs, async processing, background jobs, and workflow orchestration.
  • •Experience designing data-intensive systems using PostgreSQL, indexing/query tuning, and batch/stream tradeoffs; RAG, vector search, and embedding-based systems are required.
  • •Experience building secure, multi-tenant systems with RBAC, audit logging, and secure data handling for regulated environments.
  • •Hands-on experience building LLM-driven workflows (tool-calling, state machines, human-in-the-loop approvals, checkpoint/resume) and LLM cost optimization (caching, token efficiency, model selection).
Skills:ShippingReliability focusObservability mindsetSecurity/compliance mindsetCollaboration
Tech Stack:PythonFastAPIAWSPostgreSQLOpenTelemetryTerraformOpenAIAnthropicLangChainLangGraphBedrockRAGVector searchEmbeddingsSSOSAMLOIDCPub/sub

Company Brief

Smarsh
Provides cloud-based archiving, compliance, and e-discovery solutions that capture, retain, and monitor electronic communications across email, social media, mobile, and collaboration platforms for regulated industries.
Industry: RegTech
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Portland, United States
Founded: 2001
WebsiteLinkedIn