Palantir Technologies

1 month ago

Software Engineer - Hosted Model Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Build and operate high-performance hosted model infrastructure for production ML deployments across air-gapped and on-prem environments. Own end-to-end services—from inference engines to deployment pipelines—while focusing on security, observability, multi-tenant reliability, and collaborating with product teams and customers to deliver new models and capabilities.

Location: United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Build and maintain high-performance model serving infrastructure that integrates with security models, hardware constraints, and different inference engines.
•Design intelligent request handling including authentication, rate limiting, concurrency control, and audit logging for multi-tenant model access.
•Build and maintain packaging and deployment pipelines enabling fast, secure, and reliable model rollouts across on-premises and air-gapped environments.
•Develop observability for production AI systems to enable easy service monitoring and fast incident triage and resolution.
•Debug complex issues across the stack, including open source inference engines, container runtimes, and GPU drivers, in environments with limited direct access.

Pay and Benefits

Salary: USD 145,000 - 200,000 annually

Equity and Bonus:Equity

Perks:MedicalDentalVision401kRelocationPaid LeaveHolidaysParental LeaveRsus

Key Requirements

•4+ years of professional software engineering experience building and operating production systems.
•Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or similar field.
•Strong proficiency in programming languages such as Java, C++, Python, Rust, or similar; familiarity with the Python ML ecosystem is valuable.
•Experience with containers, Kubernetes, and deploying backend services in production environments.
•Strong written and verbal communication skills with the ability to iterate quickly with teammates while maintaining a high quality bar.

Experience:4+ yearsAI/MLInfrastructureProduction systemsCloudOn-premMulti-tenant

Skills:JavaRustPythonGoDockerKubernetesGradleGitHubGPUInference engines

Languages:English

Tech Stack:JavaRustPythonGoDockerKubernetesGradleGitHub

Company Brief

Palantir Technologies

Builds enterprise-scale data integration and analytics platforms (including Gotham and Foundry) that help government agencies and commercial organizations integrate, analyze, and operationalize large-scale data for intelligence, defense, healthcare, finance, and industrial use cases.

Industry: Data Infrastructure

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Denver, United States

Founded: 2003

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Palantir Technologies

1 month ago

Software Engineer - Hosted Model Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Location: United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Build and maintain high-performance model serving infrastructure that integrates with security models, hardware constraints, and different inference engines.
•Design intelligent request handling including authentication, rate limiting, concurrency control, and audit logging for multi-tenant model access.
•Build and maintain packaging and deployment pipelines enabling fast, secure, and reliable model rollouts across on-premises and air-gapped environments.
•Develop observability for production AI systems to enable easy service monitoring and fast incident triage and resolution.
•Debug complex issues across the stack, including open source inference engines, container runtimes, and GPU drivers, in environments with limited direct access.

Pay and Benefits

Salary: USD 145,000 - 200,000 annually

Equity and Bonus:Equity

Perks:MedicalDentalVision401kRelocationPaid LeaveHolidaysParental LeaveRsus

Key Requirements

•4+ years of professional software engineering experience building and operating production systems.
•Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or similar field.
•Strong proficiency in programming languages such as Java, C++, Python, Rust, or similar; familiarity with the Python ML ecosystem is valuable.
•Experience with containers, Kubernetes, and deploying backend services in production environments.
•Strong written and verbal communication skills with the ability to iterate quickly with teammates while maintaining a high quality bar.

Experience:4+ yearsAI/MLInfrastructureProduction systemsCloudOn-premMulti-tenant

Skills:JavaRustPythonGoDockerKubernetesGradleGitHubGPUInference engines

Languages:English

Tech Stack:JavaRustPythonGoDockerKubernetesGradleGitHub

Company Brief

Palantir Technologies

Industry: Data Infrastructure

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Denver, United States

Founded: 2003

Glassdoor: 3.9

Website LinkedIn