Development Architect (f/m/d) - AI Foundation Model Training and Serving (Potsdam, DE, 14469)

SAP
Potsdam
Workplace: HybridFull timeFunction: Software EngineeringExperience: 8+ yearsSkills: ["Communication","Documentation","Technical alignment","Stakeholder collaboration","Scalability thinking"]

Design and guide the AI architecture for an open data platform enabling distributed and federated foundation model training on structured business data. Own technical design across the AI training stack (orchestration, checkpointing, secure aggregation), model lifecycle (fine-tuning, evaluation, registries), and industrial-scale inference/serving (multi-tenant deployment, dynamic batching, KV caching, quantization). Ensure secure, policy-compliant handling of proprietary datasets while aligning cross-team stakeholders.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
SAP
SAP
2 hours ago

Development Architect (f/m/d) - AI Foundation Model Training and Serving (Potsdam, DE, 14469)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Design and guide the AI architecture for an open data platform enabling distributed and federated foundation model training on structured business data. Own technical design across the AI training stack (orchestration, checkpointing, secure aggregation), model lifecycle (fine-tuning, evaluation, registries), and industrial-scale inference/serving (multi-tenant deployment, dynamic batching, KV caching, quantization). Ensure secure, policy-compliant handling of proprietary datasets while aligning cross-team stakeholders.
Location: Potsdam
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Drive technical architecture and design for AI training, evaluation, and serving stack in the open platform.
  • •Architect distributed and federated training infrastructure including secure aggregation across customer data sites.
  • •Design the model lifecycle: fine-tuning, post-training, evaluation/benchmarking pipelines, and model registries.
  • •Architect inference and serving for industrial scale, optimizing latency/cost trade-offs across cloud and on-prem.
  • •Ensure secure, policy-compliant handling of proprietary datasets and models (authentication, lineage, provenance, licensing metadata, data residency) and coordinate with stakeholders for alignment.
Travel: Low travel

Key Requirements

  • •8+ years of experience architecting AI/foundation-model ML/AI solutions.
  • •Hands-on design of distributed training systems for large models, including cluster orchestration, parallelism, checkpointing, and fault tolerance.
  • •Experience with federated training across organizational boundaries.
  • •Hands-on foundation model fine-tuning (e.g., RLHF/DPO/distillation), evaluation pipelines, and serving at scale.
  • •Strong software engineering skills with proficiency in Python and at least one other programming language.
Experience:8+ yearsAIMachine learningFoundation models
Skills:CommunicationDocumentationTechnical alignmentStakeholder collaborationScalability thinking
Tech Stack:AIFoundation modelsGraphsTablesStructured dataDistributed trainingFederated trainingCluster orchestrationParallelismDDPFSDPTPPPCheckpointingFault toleranceFine-tuningRLHFDPODistillationEvaluation pipelines

Company Brief

SAP
Global enterprise software company best known for ERP systems and business applications covering finance, supply chain, procurement, HR, analytics, and customer management for large organizations.
Industry: Enterprise Software
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Walldorf, Germany
Founded: 1972
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor