Staff Data Engineer (8-10 years' exp - Java/Python, Scala, Spark, Hadoop)

Visa
Bengaluru
Workplace: OnsiteFull timeFunction: Administration & Executive AssistanceExperience: 8-10 yearsEducation: bachelorsSkills: ["Mentoring","Collaboration","Leadership","Troubleshooting"]

Design, implement, and improve scalable data platforms in a fintech environment. Lead modernization from SQL Server data warehouses to Hadoop/Databricks, building hybrid pipelines for near real-time analytics and AI use cases. Architect distributed ETL/ELT with Spark, Kafka, Airflow, and Delta Lake, and enable RAG/vector database integrations. Troubleshoot production issues, ensure governance and security compliance, and mentor junior engineers while bridging legacy and next-gen data teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Visa
Visa
4 days ago

Staff Data Engineer (8-10 years' exp - Java/Python, Scala, Spark, Hadoop)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Design, implement, and improve scalable data platforms in a fintech environment. Lead modernization from SQL Server data warehouses to Hadoop/Databricks, building hybrid pipelines for near real-time analytics and AI use cases. Architect distributed ETL/ELT with Spark, Kafka, Airflow, and Delta Lake, and enable RAG/vector database integrations. Troubleshoot production issues, ensure governance and security compliance, and mentor junior engineers while bridging legacy and next-gen data teams.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Modernize the data platform by transitioning from SQL Server warehouses to Hadoop/Databricks, including hybrid pipelines for near real-time analytics and AI.
  • •Implement scalable distributed data pipelines using Spark, Kafka, Airflow, and Delta Lake, and build ETL/ELT frameworks for large-scale data processing.
  • •Partner with AI teams to enable RAG pipelines, vector database integrations, and LLM data provisioning.
  • •Maintain and tune SQL Server–based warehouses and Hadoop/Spark environments, including performance analysis, replication, encryption, and HA solutions.
  • •Enforce data quality, lineage, governance, and compliance; mentor junior engineers and collaborate with product, ML, platform engineering, and InfoSec teams.

Key Requirements

  • •Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • •8+ years of hands-on data engineering experience in enterprise data warehousing and pipeline design.
  • •Proven success modernizing SQL Server–based data warehouses in high-SLA environments.
  • •Production-level experience architecting Hadoop, Spark, and Databricks data pipelines.
  • •Strong programming proficiency in Python, Java, or Scala, plus experience with AWS or Azure services.
Experience:8-10 yearsFintech
Education:Bachelor's in Computer Science, Data Engineering, or related field
Skills:MentoringCollaborationLeadershipTroubleshooting
Tech Stack:PythonJavaScalaSQLT-SQLSQL ServerHadoopSparkDatabricksDelta LakeKafkaAirflowAzure Data FactoryAWSGlueRedshiftS3KubernetesDockerTerraform

Company Brief

Visa
Global payments technology company that operates the VisaNet electronic payments network, facilitating credit, debit and digital transactions between consumers, merchants, financial institutions and governments worldwide.
Industry: Payments
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Francisco, United States
Founded: 1958
Glassdoor
Glassdoor: 3.8
WebsiteLinkedInGlassdoor