Capco

5 months ago

Principal Azure Data Engineer (Databricks)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Lead the architecture and delivery of enterprise-grade Databricks-based data solutions on Azure for financial services. Design streaming and batch pipelines, guide client strategies and governance, mentor cross-functional teams, and enforce engineering best practices across the data lifecycle to modernise data capabilities.

Location: United Kingdom

Workplace: Hybrid

Employment Type: Full time

Job Function: DevOps, Cloud & Infrastructure

Seniority: Sr. Manager level

Key Responsibilities

•Lead the end-to-end delivery of Databricks-based solutions across Azure environments.
•Architect secure and scalable pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog.
•Develop and enforce engineering best practices across the data lifecycle.
•Engage with clients to define solution strategies and data governance frameworks.
•Mentor engineering teams and contribute to internal capability development initiatives.

Pay and Benefits

Perks:Health InsurancePensionAnnual BonusLife InsuranceCritical Illness

Key Requirements

•Proven experience with the Databricks platform, including Unity Catalog, DeltaLake, and orchestration
•Expertise in Python and PySpark for distributed data processing
•CI/CD pipeline development with Azure DevOps, Jenkins, or GitHub Actions
•In-depth understanding of data lakehouse principles, data modelling, and GDPR-compliant design
•Experience building robust, production-grade data pipelines from ingestion through to serving

Skills:LeadershipMentoringCommunicationProblem-solvingData pipelines

Languages:English

Tech Stack:DatabricksPythonPySparkDeltaLakeUnity CatalogSpark Structured StreamingAzure DevOpsJenkinsGitHub ActionsScalaJavaAzure

Company Brief

Capco

Global management and technology consultancy specializing in financial services. Capco advises banks, insurers, and capital markets firms on digital transformation, risk and compliance, technology implementation, and operational improvement, combining industry expertise with advisory and engineering capabilities.

Industry: Management Consulting

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Headquarters: London, United Kingdom

Founded: 1998

Glassdoor: 3.7

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Capco

5 months ago

Principal Azure Data Engineer (Databricks)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Location: United Kingdom

Workplace: Hybrid

Employment Type: Full time

Job Function: DevOps, Cloud & Infrastructure

Seniority: Sr. Manager level

Key Responsibilities

•Lead the end-to-end delivery of Databricks-based solutions across Azure environments.
•Architect secure and scalable pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog.
•Develop and enforce engineering best practices across the data lifecycle.
•Engage with clients to define solution strategies and data governance frameworks.
•Mentor engineering teams and contribute to internal capability development initiatives.

Pay and Benefits

Perks:Health InsurancePensionAnnual BonusLife InsuranceCritical Illness

Key Requirements

•Proven experience with the Databricks platform, including Unity Catalog, DeltaLake, and orchestration
•Expertise in Python and PySpark for distributed data processing
•CI/CD pipeline development with Azure DevOps, Jenkins, or GitHub Actions
•In-depth understanding of data lakehouse principles, data modelling, and GDPR-compliant design
•Experience building robust, production-grade data pipelines from ingestion through to serving

Skills:LeadershipMentoringCommunicationProblem-solvingData pipelines

Languages:English

Tech Stack:DatabricksPythonPySparkDeltaLakeUnity CatalogSpark Structured StreamingAzure DevOpsJenkinsGitHub ActionsScalaJavaAzure

Company Brief

Capco

Industry: Management Consulting

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Headquarters: London, United Kingdom

Founded: 1998

Glassdoor: 3.7

Website LinkedIn