Data Engineer Senior Consultant

NTT
Hyderabad
Workplace: OnsiteFull timeFunction: Consulting & AdvisoryExperience: 3-5 yearsEducation: bachelorsSkills: ["Integrity","Collaboration","Clear communication","Stakeholder management","Ownership"]

Engineer within the datastore-migration Factory team, delivering end-to-end migration from an on-prem DataLake to an AWS-hosted Lakehouse for a high-visibility client. Refactor and migrate pipeline logic and scheduling, execute dataset transfers with integrity, and translate legacy SQL/Spark consumption patterns for compatibility with Snowflake and Iceberg. Support reconciliation and data validation by partnering with data owners through handoff and sign-off.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
4 months ago

Data Engineer Senior Consultant

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live
Reposted: first listed 2 weeks ago

Job Summary

Engineer within the datastore-migration Factory team, delivering end-to-end migration from an on-prem DataLake to an AWS-hosted Lakehouse for a high-visibility client. Refactor and migrate pipeline logic and scheduling, execute dataset transfers with integrity, and translate legacy SQL/Spark consumption patterns for compatibility with Snowflake and Iceberg. Support reconciliation and data validation by partnering with data owners through handoff and sign-off.
Location: Hyderabad
Workplace: Onsite
Employment Type: Full time
Job Function: Consulting & Advisory
Seniority: Mid level

Key Responsibilities

  • •Perform end-to-end datastore migration from on-prem DataLake to an AWS-hosted Lakehouse with a focus on data integrity.
  • •Refactor and migrate extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment.
  • •Translate and optimize legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg.
  • •Execute data transfer by migrating underlying datasets and ensuring migrated assets meet business requirements.
  • •Lead data reconciliation and validation by working with reconciliation frameworks to confirm functional equivalence to production flows.

Key Requirements

  • •Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field.
  • •3-5 years of hands-on coding experience in a collaborative team environment.
  • •Ability to troubleshoot SQL and have basic scripting experience.
  • •Professional proficiency in Python or Java.
  • •Deep familiarity with SDLC and CI/CD best practices, including K8s deployment experience.
Experience:3-5 yearsData engineeringData migrationData lakehouseCloudETLSDLCCI/CD
Education:Bachelor's in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
Skills:IntegrityCollaborationClear communicationStakeholder managementOwnership
Tech Stack:PythonJavaSQLApache SparkKafkaFTPANSI SQLJSONAvroParquetHadoopHDFSHiveSnowflakeApache IcebergSybase IQKubernetesCI/CDAWSIceberg

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn