Palantir Technologies

1 month ago

Software Engineer - Hosted Model Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Engineer high-performance, hosted model infrastructure for AI deployments across diverse environments. Own end-to-end services from inference engines to deployment pipelines, ensuring secure, scalable, multi-tenant access with strong observability and cross-team collaboration to deliver new models quickly.

Location: Palo Alto

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Build high-performance model serving infrastructure that integrates with security models, hardware constraints, and various inference engines.
•Design intelligent request handling including authentication, rate limiting, concurrency control, and audit logging for multi-tenant model access.
•Build and maintain packaging and deployment pipelines enabling fast, secure, and reliable model rollouts across on-premises and air-gapped environments.
•Develop observability for production AI systems to enable monitoring and rapid incident triage and resolution.
•Debug complex issues across the stack, including open source inference engines, container runtimes, and GPU drivers, in restricted environments.

Pay and Benefits

Salary: 145,000 - 200,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceDentalVision401kRelocationRemote WorkHybrid Options

Key Requirements

•4+ years of professional software engineering experience building and operating production systems.
•Bachelor’s or higher in Computer Science, Mathematics, Software Engineering, Physics, or a related field.
•Strong programming skills in Java, C++, Python, Rust, or similar languages (Python ML ecosystem valuable).
•Experience with containers, Kubernetes, and deploying backend services in production environments.
•Excellent written and verbal communication, ability to iterate quickly with teammates and maintain high-quality standards.

Experience:4+ yearsAISoftware engineeringCloud

Education:Bachelor's

Skills:JavaRustPythonGoDockerKubernetesGradleGitHub

Tech Stack:JavaRustPythonGoDockerKubernetesGradleGitHub

Eligibility

Security Clearance:US Security clearance or eligibility

Company Brief

Palantir Technologies

Builds enterprise-scale data integration and analytics platforms (including Gotham and Foundry) that help government agencies and commercial organizations integrate, analyze, and operationalize large-scale data for intelligence, defense, healthcare, finance, and industrial use cases.

Industry: Data Infrastructure

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Denver, United States

Founded: 2003

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Palantir Technologies

1 month ago

Software Engineer - Hosted Model Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Location: Palo Alto

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Build high-performance model serving infrastructure that integrates with security models, hardware constraints, and various inference engines.
•Design intelligent request handling including authentication, rate limiting, concurrency control, and audit logging for multi-tenant model access.
•Build and maintain packaging and deployment pipelines enabling fast, secure, and reliable model rollouts across on-premises and air-gapped environments.
•Develop observability for production AI systems to enable monitoring and rapid incident triage and resolution.
•Debug complex issues across the stack, including open source inference engines, container runtimes, and GPU drivers, in restricted environments.

Pay and Benefits

Salary: 145,000 - 200,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceDentalVision401kRelocationRemote WorkHybrid Options

Key Requirements

•4+ years of professional software engineering experience building and operating production systems.
•Bachelor’s or higher in Computer Science, Mathematics, Software Engineering, Physics, or a related field.
•Strong programming skills in Java, C++, Python, Rust, or similar languages (Python ML ecosystem valuable).
•Experience with containers, Kubernetes, and deploying backend services in production environments.
•Excellent written and verbal communication, ability to iterate quickly with teammates and maintain high-quality standards.

Experience:4+ yearsAISoftware engineeringCloud

Education:Bachelor's

Skills:JavaRustPythonGoDockerKubernetesGradleGitHub

Tech Stack:JavaRustPythonGoDockerKubernetesGradleGitHub

Eligibility

Security Clearance:US Security clearance or eligibility

Company Brief

Palantir Technologies

Industry: Data Infrastructure

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Denver, United States

Founded: 2003

Glassdoor: 3.9

Website LinkedIn