Data Platform Modernization Engineer - Junior (Databricks)

NTT
Bengaluru, Karnataka
Full timeFunction: Healthcare (Clinical, Medical, Wellness)Experience: 3-6 yearsEducation: bachelorsSkills: ["Analytical","Problem-solving","Communication"]

Modernize and migrate existing ETL workloads to a Databricks lakehouse. Analyze current Informatica and AWS Glue workflows, then build Databricks notebooks, data pipelines, and Bronze/Silver/Gold processing using PySpark and Spark SQL. Implement batch and incremental Delta Lake pipelines, develop Databricks Jobs/Workflows, and support unit/reconciliation, integration testing, and production cutover activities.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
1 week ago

Data Platform Modernization Engineer - Junior (Databricks)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 16 hours agoStatus: Live

Job Summary

Modernize and migrate existing ETL workloads to a Databricks lakehouse. Analyze current Informatica and AWS Glue workflows, then build Databricks notebooks, data pipelines, and Bronze/Silver/Gold processing using PySpark and Spark SQL. Implement batch and incremental Delta Lake pipelines, develop Databricks Jobs/Workflows, and support unit/reconciliation, integration testing, and production cutover activities.
Location: Bengaluru, Karnataka
Employment Type: Full time
Job Function: Healthcare (Clinical, Medical, Wellness)
Seniority: Entry level

Key Responsibilities

  • •Analyze existing Informatica workflows/mappings and AWS Glue jobs to understand source-to-target mappings and transformation logic.
  • •Develop Databricks notebooks and data pipelines to migrate ETL workloads to the Databricks Lakehouse.
  • •Implement Bronze/Silver/Gold processing and build batch/incremental pipelines using Delta Lake with watermark/control mechanisms.
  • •Convert Informatica transformations, mappings, lookups, and business rules into Databricks equivalents while preserving logic.
  • •Perform unit testing and source-to-target data reconciliation, and support integration/regression testing, UAT, and production validation.

Key Requirements

  • •3–6 years of experience in data engineering, ETL development, or application/data platform development.
  • •Hands-on experience with Databricks and Apache Spark, including building batch or incremental ETL/ELT pipelines.
  • •Strong development skills in Python/PySpark and SQL (including Spark SQL / Databricks SQL).
  • •Experience with Databricks notebooks and Delta Lake.
  • •Experience with unit testing, data validation, and troubleshooting, plus basic understanding of Bronze/Silver/Gold layered data architectures.
Experience:3-6 yearsData engineeringETLData platform
Education:Bachelor's
Skills:AnalyticalProblem-solvingCommunication
Certifications:Databricks certification
Tech Stack:DatabricksApache SparkPythonPySparkSpark SQLDatabricks SQLDelta LakeDatabricks Jobs/WorkflowsLakeflow Declarative PipelinesDelta Live TablesUnity CatalogDatabricks Asset BundlesCI/CDAWS S3AWS GlueRedshiftInformatica PowerCenterSSISAuto LoaderCDC

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn