Data Engineer _DEPS_ MTCR

Capco
Bengaluru, Pune
Workplace: HybridFull timeFunction: DevOps, Cloud & InfrastructureExperience: 3-5 yearsSkills: ["Troubleshooting","Problem-solving"]

Build and run enterprise-scale data processing platforms by administering and optimizing Cloudera CDP/CDH environments. Develop and deploy PySpark/Python data solutions, create CI/CD pipelines with Jenkins and GitHub/Bitbucket, and integrate security/code-quality tooling into delivery workflows. Ensure reliability by monitoring platform health, troubleshooting issues, performing upgrades, and maintaining high availability, while applying security controls, access management, and governance best practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Capco
Capco
18 hours ago

Data Engineer _DEPS_ MTCR

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build and run enterprise-scale data processing platforms by administering and optimizing Cloudera CDP/CDH environments. Develop and deploy PySpark/Python data solutions, create CI/CD pipelines with Jenkins and GitHub/Bitbucket, and integrate security/code-quality tooling into delivery workflows. Ensure reliability by monitoring platform health, troubleshooting issues, performing upgrades, and maintaining high availability, while applying security controls, access management, and governance best practices.
Location: Bengaluru, Pune
Workplace: Hybrid
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Administer and support Cloudera CDP/CDH platforms including HDFS, Hive, Spark, YARN, Hue, and CDE.
  • •Develop, deploy, and optimize PySpark and Python-based data processing solutions.
  • •Build and maintain CI/CD pipelines using Jenkins and GitHub/Bitbucket.
  • •Integrate security and code-quality tools (e.g., Checkmarx) into delivery pipelines.
  • •Monitor platform health, perform upgrades, troubleshoot issues, and ensure high availability with security/access/governance controls.

Key Requirements

  • •Hands-on experience with Cloudera Hadoop/CDP platforms and administering Cloudera CDP/CDH environments.
  • •Strong expertise in HDFS, Spark/PySpark, Python, Hive, YARN, Hue, and CDE.
  • •Experience building CI/CD pipelines using Jenkins and GitHub/Bitbucket.
  • •Good knowledge of SQL and performance tuning for Hive and Impala.
  • •Experience with Checkmarx (or similar SAST tools) and strong Linux administration/scripting skills.
Experience:3-5 years
Skills:TroubleshootingProblem-solving
Languages:English
Tech Stack:ClouderaCDPCDHHDFSHiveSparkYARNHueCDEPySparkPythonJenkinsGitHubBitbucketCheckmarxSQLImpalaLinuxCI/CD

Company Brief

Capco
Global management and technology consultancy specializing in financial services. Capco advises banks, insurers, and capital markets firms on digital transformation, risk and compliance, technology implementation, and operational improvement, combining industry expertise with advisory and engineering capabilities.
Industry: Management Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: London, United Kingdom
Founded: 1998
Glassdoor
Glassdoor: 3.7
WebsiteLinkedIn