Data Platform Modernization Engineer - Junior (Databricks)

NTT
Bengaluru
Full timeFunction: Healthcare (Clinical, Medical, Wellness)Experience: 3-6 yearsEducation: bachelorsSkills: ["Analytical thinking","Problem-solving","Communication","Attention to detail"]

Support an enterprise data platform modernization initiative by migrating legacy Informatica PowerCenter and AWS Glue workloads to Databricks. Build Databricks notebooks and data pipelines to create Lakehouse Bronze/Silver/Gold layers, implement batch and incremental processing with Delta Lake, and convert existing transformations while preserving business logic. Perform unit and integration testing, troubleshoot data/SQL/PySpark pipeline issues, and collaborate on deployment, monitoring, and cutover activities.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
1 week ago

Data Platform Modernization Engineer - Junior (Databricks)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 19 hours agoStatus: Live

Job Summary

Support an enterprise data platform modernization initiative by migrating legacy Informatica PowerCenter and AWS Glue workloads to Databricks. Build Databricks notebooks and data pipelines to create Lakehouse Bronze/Silver/Gold layers, implement batch and incremental processing with Delta Lake, and convert existing transformations while preserving business logic. Perform unit and integration testing, troubleshoot data/SQL/PySpark pipeline issues, and collaborate on deployment, monitoring, and cutover activities.
Location: Bengaluru
Employment Type: Full time
Job Function: Healthcare (Clinical, Medical, Wellness)
Seniority: Entry level

Key Responsibilities

  • •Analyze existing Informatica workflows/mappings and AWS Glue jobs to understand source-to-target mappings and transformation logic.
  • •Develop Databricks notebooks and data pipelines to migrate ETL workloads into the Databricks Lakehouse, including Bronze/Silver/Gold processing layers.
  • •Implement batch and incremental pipelines using Delta Lake with watermark/control mechanisms, and reuse common frameworks for logging, auditing, data quality, error handling, and notifications.
  • •Convert Informatica transformations, mappings, lookups, and business rules into equivalent Databricks implementations while preserving existing business logic.
  • •Perform unit testing and source-to-target reconciliation, investigate data/SQL/PySpark/pipeline execution issues, and support integration testing, regression testing, UAT, and production validation.

Key Requirements

  • •3–6 years of experience in data engineering, ETL development, or application/data platform development.
  • •Hands-on experience with Databricks and Apache Spark, including Databricks notebooks and Spark/Databricks SQL.
  • •Strong development skills in Python/PySpark and SQL with experience building batch or incremental ETL/ELT pipelines.
  • •Experience with Delta Lake and Databricks Jobs/Workflows, plus designing layered (e.g., Bronze/Silver/Gold) data architectures.
  • •Hands-on experience with one or more ETL technologies such as Informatica PowerCenter or AWS Glue, including unit testing and data validation/troubleshooting.
Experience:3-6 yearsData engineeringETL
Education:Bachelor's
Skills:Analytical thinkingProblem-solvingCommunicationAttention to detail
Certifications:Databricks certification
Tech Stack:DatabricksApache SparkPySparkPythonSQLSpark SQLDatabricks SQLDelta LakeDatabricks Jobs/WorkflowsLakeflow Declarative PipelinesDelta Live TablesUnity CatalogDatabricks Asset BundlesCI/CDInformatica PowerCenterAWS GlueInformatica transformationsSSISDelta Lake processingAWS S3

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn