NTT

1 month ago

Lead Data Migration Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 7 hours agoStatus: Live

Job Summary

Lead end-to-end data migration engineering across legacy data warehouses into AWS-based data lakehouse platforms. Design, build, and optimize ETL/ELT pipelines using AWS Glue, Python/PySpark, SQL, and YAML orchestration, including bulk loads and incremental/delta migrations. Own core testing and validation—executing reconciliations, data quality checks, and automated validation frameworks—while collaborating with architects, engineers, analysts, and QA in a client-facing delivery environment.

Location: London

Workplace: Onsite

Employment Type: Full time

Job Function: Administration & Executive Assistance

Seniority: Mid level

Key Responsibilities

•Design, build, and optimize data migration pipelines from legacy warehouses to AWS-based data lakehouse platforms.
•Develop and maintain ETL/ELT pipelines using AWS Glue, Python/PySpark, SQL, and YAML-driven configurations, including bulk and incremental/delta loads.
•Test end-to-end ETL solutions on AWS services and validate migrations to new AWS data lakehouse architectures.
•Execute SQL-based validation and reconciliation queries to ensure data completeness, accuracy, and transformation correctness.
•Collaborate with architects, engineers, analysts, and QA teams; mentor junior engineers and promote reusable components and automation.

Key Requirements

•Proven data engineering and data migration delivery experience, particularly in cloud environments.
•Strong focus on data pipeline testing, validation, and quality assurance for migration workflows.
•Ability to work across the full data lifecycle with emphasis on migration and transformation.
•Hands-on technical expertise with AWS cloud services (especially AWS Glue), Python/PySpark, SQL, and YAML-driven pipeline orchestration.
•Experience with Lakehouse concepts, including Apache Iceberg and distributed processing frameworks such as Apache Spark.

Skills:CollaborationCommunicationAnalytical thinkingProblem-solvingMentoring

Tech Stack:AWS GlueApache IcebergPythonPySparkSQLYAMLAWS S3Apache SparkETLELT

Company Brief

NTT

Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.

Industry: Professional Services

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Valuation: Public Company (Market Cap in USD)

Headquarters: London, United Kingdom

Founded: 1983

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

NTT