NTT

2 months ago

Data Engineer with AI Skills

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 17 hours agoStatus: Live

Job Summary

Lead the migration of an existing data lake to a lakehouse architecture, modernizing large-scale data platforms in AWS. You’ll refactor and migrate legacy Java/ETL pipelines, optimize performance, and ensure robust distributed processing best practices. Apply AI-assisted engineering (e.g., Copilot/ChatGPT) and prompt engineering to accelerate development, automate documentation, and streamline transformations. Build automated testing frameworks and validate data integrity with strong CI/CD practices.

Location: Bengaluru

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Design and execute migration from traditional data lake architecture to lakehouse architecture.
•Modernize data platforms using Apache Spark, Apache Iceberg/Open Table formats, and Snowflake/Cloud Data Warehouse.
•Refactor and migrate legacy codebases (Java/ETL pipelines) to cloud-native architectures and optimize workflows for performance, scalability, and cost.
•Use AI-assisted engineering tools and prompt engineering to accelerate code migration/transformation, automate repetitive tasks and documentation, and streamline pipeline transformations.
•Design automated testing frameworks for migrated pipelines and ensure high-quality delivery using robust CI/CD and testing practices. Build and manage AWS cloud-native data architectures and apply DevOps and IaC methodologies.

Key Requirements

•Strong programming expertise in Java.
•Hands-on experience migrating and modernizing data pipelines/legacy codebases (Java / ETL) to cloud-native architectures.
•Experience with lakehouse/data platform modernization technologies including Apache Spark and Apache Iceberg/Open Table formats.
•Experience with cloud data warehousing platforms such as Snowflake.
•Hands-on use of AI tools (e.g., Copilot, ChatGPT) and prompt engineering to accelerate migration, development, and testing processes.

Tech Stack:JavaAWSApache SparkApache IcebergOpen Table formatsSnowflakeData LakeLakehouse architectureETLAI toolsCopilotChatGPTPrompt engineeringCI/CDDevOpsInfrastructure as Code (IaC)Distributed data processing

Company Brief

NTT

Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.

Industry: Professional Services

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Valuation: Public Company (Market Cap in USD)

Headquarters: London, United Kingdom

Founded: 1983

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

NTT