NTT

2 weeks ago

Databricks - Principal Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Design and optimize end-to-end data pipelines using Databricks technologies such as Spark, Delta Lake, and Unity Catalog. Build scalable ETL/ELT ingestion and transformation frameworks, and modernize data warehouses by migrating legacy systems to lakehouse architectures. Implement solutions on Azure, AWS, and GCP, lead performance tuning and data modeling, and mentor engineers through design reviews and delivery excellence.

Location: Bengaluru

Workplace: Hybrid

Employment Type: Full time

Job Function: Communications, PR & Community

Seniority: Mid level

Key Responsibilities

•Design, optimize, and manage end-to-end data pipelines using Databricks technologies.
•Build scalable ingestion and transformation frameworks for structured and semi-structured data.
•Implement cloud-based solutions on Azure, AWS, or GCP, covering compute, storage, and networking.
•Lead data warehouse modernization by migrating legacy systems to lakehouse architectures.
•Mentor engineers, conduct design reviews, and lead delivery excellence while engaging stakeholders on technical discussions.

Key Requirements

•Deep expertise in Unity Catalog, Photon engine, Databricks SQL, and Databricks optimization.
•Proven experience architecting scalable data solutions on Azure, AWS, or GCP.
•Advanced mastery of ETL/ELT pipeline design, data modeling, and performance tuning.
•Strong command of Spark, Delta Lake, Python/Scala, SQL, CI/CD, and DevOps.
•Experience leading multi-team delivery in enterprise data engineering environments.

Experience:12+ yearsData engineeringData warehousingCloud data platformsLakehouse

Skills:Analytical thinkingStakeholder managementTechnical articulationMentoringDelivery excellence

Tech Stack:DatabricksSparkDelta LakeUnity CatalogPhoton engineDatabricks SQLAzureAWSGCPETLELTPythonScalaSQLCI/CDDevOpsLakehouse

Company Brief

NTT

Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.

Industry: Professional Services

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Valuation: Public Company (Market Cap in USD)

Headquarters: London, United Kingdom

Founded: 1983

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

NTT