Data & Analytics Principal Consultant

NTT
Pune
Workplace: RemoteFull timeFunction: Software EngineeringSkills: ["Peer code review","Technical documentation"]

Translate Informatica workflows into Python EL scripts and dbt transformation models to migrate high-volume data into the target warehouse. Build and test ETL pipelines, including dbt-native and Python unit tests, and orchestrate end-to-end runs with Airflow DAGs. Contribute to GitLab CI/CD with linting, automated testing, and deployments, and support performance and data-quality troubleshooting across SIT and UAT with accurate reconciliation.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NTT
NTT
1 week ago

Data & Analytics Principal Consultant

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Translate Informatica workflows into Python EL scripts and dbt transformation models to migrate high-volume data into the target warehouse. Build and test ETL pipelines, including dbt-native and Python unit tests, and orchestrate end-to-end runs with Airflow DAGs. Contribute to GitLab CI/CD with linting, automated testing, and deployments, and support performance and data-quality troubleshooting across SIT and UAT with accurate reconciliation.
Location: Pune
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Assess Informatica workflows and translate them into equivalent Python EL scripts and dbt transformation models.
  • •Build and maintain Python EL pipelines for high-volume data landing into the target warehouse using specified connectivity and bulk tools.
  • •Develop dbt models from Informatica mapping logic using best practices (macros, incremental, snapshots) and create dbt/native tests.
  • •Orchestrate execution end-to-end using Airflow DAGs and ensure outputs match source workflow behavior.
  • •Contribute to GitLab CI/CD, perform peer code reviews, and troubleshoot performance/data discrepancies during SIT and UAT.

Key Requirements

  • •Assess complex Informatica workflows (sessions, mappings, parameterizations) and translate them into equivalent Python EL scripts and dbt models.
  • •Develop Python EL pipelines to land high-volume data into a target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools.
  • •Design dbt transformation models aligned to Informatica mapping logic, following dbt best practices (layering, macros, incremental strategies, snapshot patterns).
  • •Implement validation using dbt-native tests and custom Python unit tests to ensure transformation correctness and data quality.
  • •Create and operate Airflow DAGs to orchestrate end-to-end execution producing outputs functionally equivalent to the source workflows.
Skills:Peer code reviewTechnical documentation
Tech Stack:InformaticaPythonDbtELSQLAlchemyCx_OraclePyodbcOracle Data PumpSQL Server BCPAirflowGitLab CI/CDSQLOracleSQL ServerNASGitLabUnit testing

Company Brief

NTT
Dimension Data, operating under NTT Ltd, provides managed IT services, cloud and data center solutions, networking, cybersecurity, and digital transformation services to enterprise customers worldwide.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Valuation: Public Company (Market Cap in USD)
Headquarters: London, United Kingdom
Founded: 1983
WebsiteLinkedIn