Databricks - Principal Data Engineer

NTT
Hyderabad
Workplace: HybridFull timeFunction: Communications, PR & CommunityExperience: 12+ yearsSkills: ["Analytical thinking","Stakeholder management","Technical articulation","Mentoring","Delivery excellence"]

Design and optimize end-to-end data pipelines using Databricks technologies such as Spark, Delta Lake, and Unity Catalog. Build scalable ETL/ELT ingestion and transformation frameworks, and modernize data warehouses by migrating legacy systems to lakehouse architectures. Implement solutions on Azure, AWS, and GCP, lead performance tuning and data modeling, and mentor engineers through design reviews and delivery excellence.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
1 week ago

Databricks - Principal Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live
Reposted: first listed 2 weeks ago

Job Summary

Design and optimize end-to-end data pipelines using Databricks technologies such as Spark, Delta Lake, and Unity Catalog. Build scalable ETL/ELT ingestion and transformation frameworks, and modernize data warehouses by migrating legacy systems to lakehouse architectures. Implement solutions on Azure, AWS, and GCP, lead performance tuning and data modeling, and mentor engineers through design reviews and delivery excellence.
Location: Hyderabad
Workplace: Hybrid
Employment Type: Full time
Job Function: Communications, PR & Community
Seniority: Mid level

Key Responsibilities

  • •Design, optimize, and manage end-to-end data pipelines using Databricks technologies.
  • •Build scalable ingestion and transformation frameworks for structured and semi-structured data.
  • •Implement cloud-based solutions on Azure, AWS, or GCP, covering compute, storage, and networking.
  • •Lead data warehouse modernization by migrating legacy systems to lakehouse architectures.
  • •Mentor engineers, conduct design reviews, and lead delivery excellence while engaging stakeholders on technical discussions.

Key Requirements

  • •Deep expertise in Unity Catalog, Photon engine, Databricks SQL, and Databricks optimization.
  • •Proven experience architecting scalable data solutions on Azure, AWS, or GCP.
  • •Advanced mastery of ETL/ELT pipeline design, data modeling, and performance tuning.
  • •Strong command of Spark, Delta Lake, Python/Scala, SQL, CI/CD, and DevOps.
  • •Experience leading multi-team delivery in enterprise data engineering environments.
Experience:12+ yearsData engineeringData warehousingCloud data platformsLakehouse
Skills:Analytical thinkingStakeholder managementTechnical articulationMentoringDelivery excellence
Tech Stack:DatabricksSparkDelta LakeUnity CatalogPhoton engineDatabricks SQLAzureAWSGCPETLELTPythonScalaSQLCI/CDDevOpsLakehouse

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn