Databricks Lead Engineer

NTT
London
Full timeFunction: Administration & Executive AssistanceExperience: 5-8 yearsEducation: bachelorsSkills: ["Consulting","Collaboration","Problem-solving","Analytical thinking","Communication"]

Lead end-to-end data engineering delivery for clients using Databricks and cloud-native platforms. Own batch and streaming pipeline development, lakehouse architecture, data modeling, and performance optimization with Delta Lake and medallion patterns. Collaborate with architects and data engineers/ML teams to ensure governance, security, and quality across ingestion to consumption, while mentoring engineers and driving reusable assets and best practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
2 days ago

Databricks Lead Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live

Job Summary

Lead end-to-end data engineering delivery for clients using Databricks and cloud-native platforms. Own batch and streaming pipeline development, lakehouse architecture, data modeling, and performance optimization with Delta Lake and medallion patterns. Collaborate with architects and data engineers/ML teams to ensure governance, security, and quality across ingestion to consumption, while mentoring engineers and driving reusable assets and best practices.
Location: London
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Sr. Manager level

Key Responsibilities

  • •Engage with clients and deliver Databricks-based solutions aligned to requirements.
  • •Develop batch and streaming data pipelines and architect lakehouse solutions.
  • •Model and optimize data using Delta Lake and medallion architecture approaches.
  • •Apply data governance, security, and compliance practices across ingestion, transformation, and consumption.
  • •Collaborate with architects and data teams, mentor engineers, and drive best practices using reusable assets and accelerators.

Key Requirements

  • •Minimum 5–8 years in data engineering, data warehousing, or data architecture roles, including at least 3+ years with Databricks.
  • •Deep expertise in Databricks (Spark, PySpark/Scala), Delta Lake, Unity Catalog, and MLflow.
  • •Hands-on capability across the data lifecycle including ingestion, transformation, data modeling, governance, and consumption.
  • •Strong SQL and Python (or equivalent) for data manipulation and automation, plus ETL/ELT tool experience (DBT, Matillion, Talend, or equivalent).
  • •Ability to lead or mentor engineers and deliver scalable, high-quality solutions in client-facing environments.
Experience:5-8 yearsData engineeringData warehousingData architectureDatabricks
Education:Bachelor's in Computer Science, Data Engineering, or related field
Skills:ConsultingCollaborationProblem-solvingAnalytical thinkingCommunication
Certifications:Databricks Data Engineer Professional
Tech Stack:DatabricksApache SparkPySparkScalaDelta LakeUnity CatalogMLflowDBTMatillionTalendSQLPythonAWSAzureGCPGitHubBitbucketCI/CDDatabricks WorkflowsETL

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn