AI Agent Engineer

CollectWise
New York
Workplace: OnsiteFull timeUSD 200,000 - 300,000 annuallyFunction: Data Science & Machine LearningExperience: 2+ yearsSkills: ["Analytical","Communication","High ownership","Strong work ethic"]

Build and own the architecture behind real-time voice AI agents, including orchestration, state management, prompting, and reliability. Develop end-to-end prompting strategies and conversational flows with guardrails and edge-case handling. Create testing and evaluation frameworks for voice agent performance (A/B, regression, QA, benchmarking, KPI reporting). Optimize ASR/STT/TTS and interaction handling, scale systems for millions of calls, and migrate legacy voice implementations while preserving custom workflows.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
CollectWise
CollectWise
1 day ago

AI Agent Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Build and own the architecture behind real-time voice AI agents, including orchestration, state management, prompting, and reliability. Develop end-to-end prompting strategies and conversational flows with guardrails and edge-case handling. Create testing and evaluation frameworks for voice agent performance (A/B, regression, QA, benchmarking, KPI reporting). Optimize ASR/STT/TTS and interaction handling, scale systems for millions of calls, and migrate legacy voice implementations while preserving custom workflows.
Location: New York
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Build voice AI infrastructure in LiveKit.
  • •Design and own real-time voice agent architecture (orchestration, state management, latency optimization, prompting, reliability).
  • •Own end-to-end prompting strategy for voice agents, including conversation flows, tone, compliance-safe phrasing, guardrails, and edge-case handling.
  • •Build and maintain testing/evaluation frameworks (A/B testing, regression testing, conversation QA, benchmarking, KPI reporting).
  • •Optimize ASR/STT/TTS, turn-taking, interruption handling, and state transitions; scale systems and migrate legacy implementations while preserving custom workflows.

Pay and Benefits

Salary: USD 200,000 - 300,000 annually
Equity and Bonus:Equity

Key Requirements

  • •2+ years of experience in voice AI, conversational AI, prompt engineering, speech systems, or related agentic workflows.
  • •3+ years of experience in platform, infrastructure, or backend engineering.
  • •Strong experience with Node.js, AWS, and SQL.
  • •Experience building and shipping production systems in a startup or similarly fast-paced environment.
  • •Experience with voice orchestration platforms or agent frameworks such as LiveKit.
Experience:2+ yearsVoice AIConversational AIPrompt engineeringSpeech systemsAgentic workflowsStartups
Skills:AnalyticalCommunicationHigh ownershipStrong work ethic
Tech Stack:LiveKitNode.jsAWSSQLASRSTTTTSA/B testingRegression testingBenchmarking

Eligibility

Nationality:US National
Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

CollectWise
Provides a debt collection and payments platform that automates receivables recovery through digital communications and self-service payment options, helping businesses streamline collections, reduce outstanding receivables, and improve cash flow.
Industry: Fintech Infrastructure
Website