Data Engineer for AI (f/m/d)

Allianz
Frankfurt
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningExperience: 3+ yearsEducation: bachelorsSkills: ["Analytical","Planning","Organizational","Communication","Collaboration"]

Design, build, and operate AI-ready data products and reusable data preparation pipelines on Allianz Global Investors’ Data and AI Platform. Work with Databricks and Microsoft Foundry to enable secure self-service data sourcing, ingestion, transformation, validation, and serving for analytics, ML, and GenAI/RAG. Define governance-by-design patterns, enforce data quality and reliability, optimize Spark performance and cost, and provide L3 support to delivery teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Allianz
Allianz
1 week ago

Data Engineer for AI (f/m/d)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 15 minutes agoStatus: Live

Job Summary

Design, build, and operate AI-ready data products and reusable data preparation pipelines on Allianz Global Investors’ Data and AI Platform. Work with Databricks and Microsoft Foundry to enable secure self-service data sourcing, ingestion, transformation, validation, and serving for analytics, ML, and GenAI/RAG. Define governance-by-design patterns, enforce data quality and reliability, optimize Spark performance and cost, and provide L3 support to delivery teams.
Location: Frankfurt
Workplace: Onsite
Employment Type: Full time · Permanent
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Develop and maintain standardized pipeline patterns, templates, and utilities to deliver AI/ML-ready datasets for structured and unstructured data.
  • •Build and operate reliable batch and streaming pipelines to ingest data, curate datasets, and publish trusted data products for AI, ML, and analytics.
  • •Establish and evolve curated Bronze/Silver/Gold data products with controlled dataset evolution, data quality, freshness enforcement, and governed access.
  • •Design and run feature engineering and feature store pipelines with versioning and lightweight documentation, including ownership, purpose, inputs/outputs, and SLAs.
  • •Provide governance-by-design via Unity Catalog (access control, lineage, retention, encryption, auditing), implement automated data quality checks and monitoring, and deliver L3 support with root-cause analysis.

Pay and Benefits

Perks:PensionRelocationChildcareEquityHealth InsuranceLearning Budget

Key Requirements

  • •Minimum 3 years of practical experience building and operating data pipelines and data products at scale on Databricks (batch and/or streaming) in governed environments.
  • •Strong understanding of data engineering concepts for AI/ML, including data modeling, data quality, data contracts, and feature engineering collaboration with reproducibility in mind.
  • •Expert-level technology skills in Databricks, Spark, Python, and SQL, plus engineering practices like CI/CD and infrastructure-as-code (e.g., Terraform) on Azure.
  • •Degree in computer science or a similar field.
  • •Excellent English communication skills and the ability to document and share knowledge effectively.
Experience:3+ yearsAsset managementFinancial industryGenAIRAG
Education:Bachelor's
Skills:AnalyticalPlanningOrganizationalCommunicationCollaboration
Certifications:Databricks Certified Data Engineer ProfessionalDatabricks Certified Data Engineer AssociateDatabricks Certified Generative AI Engineer Associate
Languages:English
Tech Stack:DatabricksMicrosoft FoundryAzureAzure AI FoundrySparkPythonSQLUnity CatalogDeltaLakehouseMedallion approachCI/CDTerraformDatabricks LakeflowSpark workloadsDelta/Unity Catalog patternsOrchestrationMonitoringEncryptionLineage

Company Brief

Allianz
Global insurance and financial services group offering property-casualty insurance, life and health insurance, asset management, and corporate risk solutions to individuals, businesses, and institutions across more than 70 countries.
Industry: Insurance
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Munich, Germany
Founded: 1890
WebsiteLinkedIn