Capco

1 month ago

Data Engineer - Scala + Spark + Java (Bng & Pune)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 22 hours agoStatus: Live

Job Summary

Design, build, and optimize large-scale data processing solutions using Scala, Spark, and Java. You’ll develop high-performance pipelines processing tens of millions of records daily, implement native APIs and microservices, collaborate with cross-functional teams, and drive data quality, governance, and performance optimization in a hybrid-capable Capco office environment.

Location: Bengaluru, Chennai, Mumbai, Pune, Gurugram

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Design, develop, and optimize large-scale data processing applications using Scala, Apache Spark, and Java.
•Build and maintain high-performance data pipelines capable of processing 80–90 million records daily with a focus on scalability, reliability, and efficiency.
•Develop and integrate Native APIs and data services to support business-critical applications and analytics platforms.
•Collaborate with cross-functional teams to gather requirements and deliver robust data engineering solutions.
•Troubleshoot and resolve performance bottlenecks across data processing and ingestion pipelines.

Key Requirements

•Strong hands-on experience in Scala, Apache Spark, and Java.
•Proven experience building and supporting large-scale distributed data processing systems handling tens of millions of records daily.
•Expertise in developing and consuming Native APIs and microservices.
•Strong understanding of Spark architecture, performance tuning, partitioning, caching, and optimization techniques.
•Experience with data modeling, ETL/ELT processes, and large-scale batch and streaming data pipelines; SQL and relational/non-relational databases.

Experience:5+ yearsFinancial servicesBankingFinTech

Skills:ScalaApache SparkJavaNative APIsKafkaAirflowHadoopSQLNoSQLCI/CDDevOpsAgile

Languages:English

Tech Stack:ScalaApache SparkJavaNative APIsMicroservicesKafkaAirflowHadoopSQLNoSQLCI/CDCloudAWSAzureGCP

Company Brief

Capco

Global management and technology consultancy specializing in financial services. Capco advises banks, insurers, and capital markets firms on digital transformation, risk and compliance, technology implementation, and operational improvement, combining industry expertise with advisory and engineering capabilities.

Industry: Management Consulting

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Headquarters: London, United Kingdom

Founded: 1998

Glassdoor: 3.7

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Capco

1 month ago

Data Engineer - Scala + Spark + Java (Bng & Pune)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 22 hours agoStatus: Live

Job Summary

Location: Bengaluru, Chennai, Mumbai, Pune, Gurugram

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Design, develop, and optimize large-scale data processing applications using Scala, Apache Spark, and Java.
•Build and maintain high-performance data pipelines capable of processing 80–90 million records daily with a focus on scalability, reliability, and efficiency.
•Develop and integrate Native APIs and data services to support business-critical applications and analytics platforms.
•Collaborate with cross-functional teams to gather requirements and deliver robust data engineering solutions.
•Troubleshoot and resolve performance bottlenecks across data processing and ingestion pipelines.

Key Requirements

•Strong hands-on experience in Scala, Apache Spark, and Java.
•Proven experience building and supporting large-scale distributed data processing systems handling tens of millions of records daily.
•Expertise in developing and consuming Native APIs and microservices.
•Strong understanding of Spark architecture, performance tuning, partitioning, caching, and optimization techniques.
•Experience with data modeling, ETL/ELT processes, and large-scale batch and streaming data pipelines; SQL and relational/non-relational databases.

Experience:5+ yearsFinancial servicesBankingFinTech

Skills:ScalaApache SparkJavaNative APIsKafkaAirflowHadoopSQLNoSQLCI/CDDevOpsAgile

Languages:English

Tech Stack:ScalaApache SparkJavaNative APIsMicroservicesKafkaAirflowHadoopSQLNoSQLCI/CDCloudAWSAzureGCP

Company Brief

Capco

Industry: Management Consulting

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Headquarters: London, United Kingdom

Founded: 1998

Glassdoor: 3.7

Website LinkedIn