Real-Time Inference Engineering Lead (FTE / Hybrid)

NTT
Charlotte
Workplace: HybridFull timeUSD 83,520 - 125,280 annuallyFunction: Administration & Executive AssistanceSkills: ["Technical leadership","Mentorship","Collaboration","Reliability engineering","Performance engineering"]

Design, build, and industrialize low-latency, resilient model-serving services for real-time predictive AI use cases. Lead technical architecture and engineering standards for online inference across cloud and on-premises, including synchronous/asynchronous APIs, deployment lifecycle, autoscaling, observability, CI/CD, and production reliability. Establish reusable patterns for safe, efficient model deployment and operations, partnering with ML, platform, security, and operations teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
6 days ago

Real-Time Inference Engineering Lead (FTE / Hybrid)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Design, build, and industrialize low-latency, resilient model-serving services for real-time predictive AI use cases. Lead technical architecture and engineering standards for online inference across cloud and on-premises, including synchronous/asynchronous APIs, deployment lifecycle, autoscaling, observability, CI/CD, and production reliability. Establish reusable patterns for safe, efficient model deployment and operations, partnering with ML, platform, security, and operations teams.
Location: Charlotte
Workplace: Hybrid
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Define target architecture and engineering standards for real-time predictive model-serving services across cloud and on-premises.
  • •Design, build, test, deploy, and operate scalable online inference services meeting latency, throughput, availability, resiliency, and security requirements.
  • •Establish reusable model-serving patterns and deployment lifecycle practices (versioning, release promotion, canary, rollback, retirement).
  • •Engineer Kubernetes-based serving platforms and implement autoscaling, capacity controls, and performance engineering (load/stress/failure testing).
  • •Set up monitoring and incident-response practices, CI/CD automation for release readiness, and mentor engineers with technical documentation and runbooks.

Pay and Benefits

Salary: USD 83,520 - 125,280 annually
Perks:Health InsuranceDentalVision401kPaid Leave

Key Requirements

  • •8+ years of software engineering, platform engineering, cloud engineering, SRE, or infrastructure engineering experience.
  • •4+ years designing, building, or operating production APIs, distributed systems, platform services, or real-time data/ML workloads.
  • •Demonstrated technical leadership delivering highly available, performance-sensitive production services.
  • •Strong experience with online inference architecture and predictive model deployment patterns.
  • •Hands-on Kubernetes experience in production (GKE, OpenShift, or comparable) plus observability, CI/CD, and performance/reliability practices.
Experience:Real-time dataMachine learningSREDistributed systems
Skills:Technical leadershipMentorshipCollaborationReliability engineeringPerformance engineering
Tech Stack:KubernetesGKEOpenShiftRESTGRPCAPI gatewaysAuthenticationAuthorizationTraffic managementAPI observabilityService meshesIngressAutoscalingObservabilitySLIsSLOsDashboardsAlertsCI/CDGit-based development

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn