Data Engineer - Scala + Spark + Java (Bng & Pune)

Capco
Bengaluru, Chennai, Mumbai, Pune, Gurugram
Workplace: HybridFull timeFunction: Software EngineeringExperience: 5+ yearsSkills: ["Scala","Apache Spark","Java","Native APIs","Kafka","Airflow","Hadoop","SQL","NoSQL","CI/CD","DevOps","Agile"]

Design, build, and optimize large-scale data processing solutions using Scala, Spark, and Java. You’ll develop high-performance pipelines processing tens of millions of records daily, implement native APIs and microservices, collaborate with cross-functional teams, and drive data quality, governance, and performance optimization in a hybrid-capable Capco office environment.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Capco
Capco
2 months ago

Data Engineer - Scala + Spark + Java (Bng & Pune)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 7 hours agoStatus: Live

Job Summary

Design, build, and optimize large-scale data processing solutions using Scala, Spark, and Java. You’ll develop high-performance pipelines processing tens of millions of records daily, implement native APIs and microservices, collaborate with cross-functional teams, and drive data quality, governance, and performance optimization in a hybrid-capable Capco office environment.
Location: Bengaluru, Chennai, Mumbai, Pune, Gurugram
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design, develop, and optimize large-scale data processing applications using Scala, Apache Spark, and Java.
  • •Build and maintain high-performance data pipelines capable of processing 80–90 million records daily with a focus on scalability, reliability, and efficiency.
  • •Develop and integrate Native APIs and data services to support business-critical applications and analytics platforms.
  • •Collaborate with cross-functional teams to gather requirements and deliver robust data engineering solutions.
  • •Troubleshoot and resolve performance bottlenecks across data processing and ingestion pipelines.

Key Requirements

  • •Strong hands-on experience in Scala, Apache Spark, and Java.
  • •Proven experience building and supporting large-scale distributed data processing systems handling tens of millions of records daily.
  • •Expertise in developing and consuming Native APIs and microservices.
  • •Strong understanding of Spark architecture, performance tuning, partitioning, caching, and optimization techniques.
  • •Experience with data modeling, ETL/ELT processes, and large-scale batch and streaming data pipelines; SQL and relational/non-relational databases.
Experience:5+ yearsFinancial servicesBankingFinTech
Skills:ScalaApache SparkJavaNative APIsKafkaAirflowHadoopSQLNoSQLCI/CDDevOpsAgile
Languages:English
Tech Stack:ScalaApache SparkJavaNative APIsMicroservicesKafkaAirflowHadoopSQLNoSQLCI/CDCloudAWSAzureGCP

Company Brief

Capco
Global management and technology consultancy specializing in financial services. Capco advises banks, insurers, and capital markets firms on digital transformation, risk and compliance, technology implementation, and operational improvement, combining industry expertise with advisory and engineering capabilities.
Industry: Management Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: London, United Kingdom
Founded: 1998
Glassdoor
Glassdoor: 3.7
WebsiteLinkedIn