Lead Expert Data Engineer- Procurement

DSM
Hyderabad
Workplace: OnsiteFull timeFunction: Procurement & SourcingSkills: ["Collaboration","Data quality mindset","Curiosity","Growth mindset"]

Design and maintain robust data pipelines while managing team projects and initiatives focused on seamless data integration and transformation. Lead technical recommendations and feasibility assessments, build pipeline architectures for ingestion, transformation, and storage, and develop modular data transformation code. Own ETL-style ingestion when tables are unavailable, ensure ongoing pipeline maintenance, and implement automated data quality testing, validation, monitoring, and troubleshooting in collaboration with data engineers and business partners.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
DSM
DSM
3 days ago

Lead Expert Data Engineer- Procurement

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Design and maintain robust data pipelines while managing team projects and initiatives focused on seamless data integration and transformation. Lead technical recommendations and feasibility assessments, build pipeline architectures for ingestion, transformation, and storage, and develop modular data transformation code. Own ETL-style ingestion when tables are unavailable, ensure ongoing pipeline maintenance, and implement automated data quality testing, validation, monitoring, and troubleshooting in collaboration with data engineers and business partners.
Location: Hyderabad
Workplace: Onsite
Employment Type: Full time
Job Function: Procurement & Sourcing
Seniority: Sr. Manager level

Key Responsibilities

  • •Provide technical recommendations and evaluate project feasibility and workloads.
  • •Design and implement pipeline architectures for data ingestion, transformation, and storage.
  • •Develop modular, efficient code for data transformation and integration aligned to modern development practices.
  • •Perform data ingestion from source systems, including ETL, when tables are not available on the data platform.
  • •Conduct pipeline maintenance and upgrades, troubleshooting issues, and implement automated data quality testing and validation.

Pay and Benefits

Perks:Learning Budget

Key Requirements

  • •Expert knowledge in dbt, SQL, Python, Spark (PySpark), Git, Azure DevOps and Databricks.
  • •Expertise in cloud engineering (e.g., AWS, Azure) and experience deploying CI/CD pipelines.
  • •5 years of experience creating and maintaining data pipelines.
  • •Experience handling scientific datasets for cheminformatics or bioinformatics (e.g., microbiome).
  • •Experience with FAIR data principles, data governance, and data standards in scientific domains.
Experience:Scientific datasetsCheminformaticsBioinformaticsMicrobiome
Skills:CollaborationData quality mindsetCuriosityGrowth mindset
Tech Stack:DbtSQLPythonSpark (PySpark)PySparkGitAzure DevOpsDatabricksAWSAzureCI/CDInfrastructure-as-codeETL

Company Brief

DSM
DSM-Firmenich is a global leader in food ingredients, nutrition, fragrances and beauty solutions, formed by the merger of DSM and Firmenich to provide sustainable, science-driven products and services across food, health and personal care industries.
Industry: Chemical Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Geneva, Switzerland
Founded: 2023
WebsiteLinkedIn