Lead Data Engineer (Cross Domain)

DSM
Barcelona
Workplace: OnsiteFull timeFunction: Administration & Executive AssistanceExperience: 5+ yearsSkills: ["Leadership","Collaboration","Technical leadership","Continuous improvement","Accountability"]

Own end-to-end data engineering for the Procurement domain, building robust pipelines from Bronze to Gold layers (raw vault/business vault to data marts/semantic layer). Develop dbt, PySpark, and SQL transformation frameworks, design ingestion via ETL and API-based extraction, and establish CI/CD and DevOps automation with Azure DevOps and GitHub Actions. Drive data quality, governance, monitoring, and provide technical leadership by mentoring teams and setting engineering standards.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
DSM
DSM
1 month ago

Lead Data Engineer (Cross Domain)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Own end-to-end data engineering for the Procurement domain, building robust pipelines from Bronze to Gold layers (raw vault/business vault to data marts/semantic layer). Develop dbt, PySpark, and SQL transformation frameworks, design ingestion via ETL and API-based extraction, and establish CI/CD and DevOps automation with Azure DevOps and GitHub Actions. Drive data quality, governance, monitoring, and provide technical leadership by mentoring teams and setting engineering standards.
Location: Barcelona
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Sr. Manager level

Key Responsibilities

  • •Design and implement end-to-end data pipelines for ingestion, transformation, and storage across Bronze, Silver (Raw Vault/Business Vault), and Gold (data marts/semantic layer).
  • •Develop ingestion processes using ETL and API-based extraction when platform tables are unavailable to integrate enterprise source systems.
  • •Build transformation frameworks with dbt, PySpark, and SQL, including staging models with hash keys/diffs and load metadata aligned to Data Vault 2.0.
  • •Create and maintain CI/CD and DevOps processes in Azure DevOps and GitHub Actions, including automated testing, deployment gates, and standardized branching/PR workflows.
  • •Drive data quality, governance, compliance, monitoring/observability, and provide technical leadership by mentoring teams and setting engineering standards.

Pay and Benefits

Perks:Learning Budget

Key Requirements

  • •5+ years designing, building, and maintaining production-grade data pipelines using dbt, SQL, Python, Spark (PySpark), Databricks, Git, Azure DevOps, and GitHub.
  • •Strong CI/CD and automation experience using Azure DevOps Pipelines and GitHub Actions, with Infrastructure-as-Code knowledge (Terraform, Bicep) as an advantage.
  • •Advanced Git and repository management skills, including branching strategies, pull request standards, code review best practices, and governance across Azure DevOps and GitHub.
  • •Hands-on cloud data engineering experience (Azure preferred) deploying and operating Databricks jobs, clusters, and workflows in production.
  • •Extensive knowledge of Data Vault 2.0 architecture and data ingestion/integration patterns (batch ETL, incremental processing, CDC, and API-based ingestion).
Experience:5+ yearsData engineering
Skills:LeadershipCollaborationTechnical leadershipContinuous improvementAccountability
Tech Stack:DbtSQLPythonPySparkSparkDatabricksGitAzure DevOpsGitHubAzure DevOps PipelinesGitHub ActionsTerraformBicepInfrastructure-as-CodeCI/CDETLAPIChange Data Capture (CDC)Data Vault 2.0Raw Vault

Company Brief

DSM
DSM-Firmenich is a global leader in food ingredients, nutrition, fragrances and beauty solutions, formed by the merger of DSM and Firmenich to provide sustainable, science-driven products and services across food, health and personal care industries.
Industry: Chemical Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Geneva, Switzerland
Founded: 2023
WebsiteLinkedIn