DSM

1 day ago

Lead Data Engineer (Cross Domain)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 17 hours agoStatus: Live

Job Summary

Own end-to-end data engineering for the Procurement domain, building robust pipelines from Bronze to Gold layers (raw vault/business vault to data marts/semantic layer). Develop dbt, PySpark, and SQL transformation frameworks, design ingestion via ETL and API-based extraction, and establish CI/CD and DevOps automation with Azure DevOps and GitHub Actions. Drive data quality, governance, monitoring, and provide technical leadership by mentoring teams and setting engineering standards.

Location: Barcelona

Workplace: Onsite

Employment Type: Full time

Job Function: Administration & Executive Assistance

Seniority: Sr. Manager level

Key Responsibilities

•Design and implement end-to-end data pipelines for ingestion, transformation, and storage across Bronze, Silver (Raw Vault/Business Vault), and Gold (data marts/semantic layer).
•Develop ingestion processes using ETL and API-based extraction when platform tables are unavailable to integrate enterprise source systems.
•Build transformation frameworks with dbt, PySpark, and SQL, including staging models with hash keys/diffs and load metadata aligned to Data Vault 2.0.
•Create and maintain CI/CD and DevOps processes in Azure DevOps and GitHub Actions, including automated testing, deployment gates, and standardized branching/PR workflows.
•Drive data quality, governance, compliance, monitoring/observability, and provide technical leadership by mentoring teams and setting engineering standards.

Pay and Benefits

Perks:Learning Budget

Key Requirements

•5+ years designing, building, and maintaining production-grade data pipelines using dbt, SQL, Python, Spark (PySpark), Databricks, Git, Azure DevOps, and GitHub.
•Strong CI/CD and automation experience using Azure DevOps Pipelines and GitHub Actions, with Infrastructure-as-Code knowledge (Terraform, Bicep) as an advantage.
•Advanced Git and repository management skills, including branching strategies, pull request standards, code review best practices, and governance across Azure DevOps and GitHub.
•Hands-on cloud data engineering experience (Azure preferred) deploying and operating Databricks jobs, clusters, and workflows in production.
•Extensive knowledge of Data Vault 2.0 architecture and data ingestion/integration patterns (batch ETL, incremental processing, CDC, and API-based ingestion).

Experience:5+ yearsData engineering

Skills:LeadershipCollaborationTechnical leadershipContinuous improvementAccountability

Tech Stack:DbtSQLPythonPySparkSparkDatabricksGitAzure DevOpsGitHubAzure DevOps PipelinesGitHub ActionsTerraformBicepInfrastructure-as-CodeCI/CDETLAPIChange Data Capture (CDC)Data Vault 2.0Raw Vault

Company Brief

DSM

DSM-Firmenich is a global leader in food ingredients, nutrition, fragrances and beauty solutions, formed by the merger of DSM and Firmenich to provide sustainable, science-driven products and services across food, health and personal care industries.

Industry: Chemical Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Headquarters: Geneva, Switzerland

Founded: 2023

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

DSM