NTT

3 weeks ago

Data Engineer Senior Consultant

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 21 hours agoStatus: Live

Reposted: first listed 21 hours ago

Job Summary

Engineer within the datastore-migration Factory team, delivering end-to-end migration from an on-prem DataLake to an AWS-hosted Lakehouse for a high-visibility client. Refactor and migrate pipeline logic and scheduling, execute dataset transfers with integrity, and translate legacy SQL/Spark consumption patterns for compatibility with Snowflake and Iceberg. Support reconciliation and data validation by partnering with data owners through handoff and sign-off.

Location: Bengaluru

Workplace: Onsite

Employment Type: Full time

Job Function: Consulting & Advisory

Seniority: Mid level

Key Responsibilities

•Perform end-to-end datastore migration from on-prem DataLake to an AWS-hosted Lakehouse with a focus on data integrity.
•Refactor and migrate extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment.
•Translate and optimize legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg.
•Execute data transfer by migrating underlying datasets and ensuring migrated assets meet business requirements.
•Lead data reconciliation and validation by working with reconciliation frameworks to confirm functional equivalence to production flows.

Key Requirements

•Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field.
•3-5 years of hands-on coding experience in a collaborative team environment.
•Ability to troubleshoot SQL and have basic scripting experience.
•Professional proficiency in Python or Java.
•Deep familiarity with SDLC and CI/CD best practices, including K8s deployment experience.

Experience:3-5 yearsData engineeringData migrationData lakehouseCloudETLSDLCCI/CD

Education:Bachelor's in Computer Science, Applied Mathematics, Engineering, or a related quantitative field

Skills:IntegrityCollaborationClear communicationStakeholder managementOwnership

Tech Stack:PythonJavaSQLApache SparkKafkaFTPANSI SQLJSONAvroParquetHadoopHDFSHiveSnowflakeApache IcebergSybase IQKubernetesCI/CDAWSIceberg

Company Brief

NTT

Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.

Industry: Professional Services

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Valuation: Public Company (Market Cap in USD)

Headquarters: London, United Kingdom

Founded: 1983

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

NTT