Data Engineer _ ALM - MTCR

Capco
Pune
Workplace: HybridFull timeFunction: DevOps, Cloud & InfrastructureExperience: 6-9 yearsSkills: ["Troubleshooting","Problem-solving","Governance","Code quality"]

Manage and optimize Cloudera CDP/CDH data platforms (HDFS, Hive, Spark, YARN, Hue, and CDE) for enterprise-scale workloads. Build and deploy Python/PySpark data processing solutions, design CI/CD pipelines with Jenkins and GitHub/Bitbucket, and integrate SAST tools like Checkmarx. Write and tune SQL for Hive/Impala, monitor health, troubleshoot and upgrade environments, and implement security, access management, and governance best practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Capco
Capco
6 hours ago

Data Engineer _ ALM - MTCR

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Manage and optimize Cloudera CDP/CDH data platforms (HDFS, Hive, Spark, YARN, Hue, and CDE) for enterprise-scale workloads. Build and deploy Python/PySpark data processing solutions, design CI/CD pipelines with Jenkins and GitHub/Bitbucket, and integrate SAST tools like Checkmarx. Write and tune SQL for Hive/Impala, monitor health, troubleshoot and upgrade environments, and implement security, access management, and governance best practices.
Location: Pune
Workplace: Hybrid
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure

Key Responsibilities

  • •Administer and support Cloudera CDP/CDH platforms including HDFS, Hive, Spark, YARN, Hue, and CDE.
  • •Develop, deploy, and optimize PySpark and Python-based data processing solutions.
  • •Build and maintain CI/CD pipelines using Jenkins and GitHub/Bitbucket.
  • •Integrate security and code quality tools such as Checkmarx into delivery pipelines.
  • •Monitor platform health, perform upgrades, troubleshoot issues, and ensure high availability while implementing security controls, access management, and governance best practices.

Key Requirements

  • •Hands-on experience with Cloudera Hadoop/CDP platforms, including HDFS, Hive, Spark/PySpark, Python, YARN, Hue, and CDE.
  • •Experience administering and supporting Cloudera environments and ensuring high availability, health monitoring, upgrades, and troubleshooting.
  • •Build and maintain CI/CD pipelines using Jenkins and GitHub/Bitbucket.
  • •Strong SQL skills with performance tuning for Hive and Impala environments.
  • •Experience integrating security/code quality tools such as Checkmarx, plus strong Linux administration and scripting skills.
Experience:6-9 years
Skills:TroubleshootingProblem-solvingGovernanceCode quality
Tech Stack:Cloudera CDPCloudera CDHHDFSHiveSparkPySparkYARNHueCDEPythonJenkinsGitHubBitbucketSQLImpalaCheckmarxLinuxCI/CD

Company Brief

Capco
Global management and technology consultancy specializing in financial services. Capco advises banks, insurers, and capital markets firms on digital transformation, risk and compliance, technology implementation, and operational improvement, combining industry expertise with advisory and engineering capabilities.
Industry: Management Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: London, United Kingdom
Founded: 1998
Glassdoor
Glassdoor: 3.7
WebsiteLinkedIn