GCP/Streaming/Data Platforms /Consultant Specialist

HSBC
Pune
Workplace: OnsiteFull timeFunction: DevOps, Cloud & InfrastructureExperience: 8-10 yearsSkills: ["Reliability focus","Operational excellence","Data quality mindset","Security and governance mindset"]

Build and maintain scalable data ingestion, batch, and streaming pipelines across APIs, databases, files, and events. Own reliable pipeline operations with orchestration, retries, backfills, idempotency, and SLAs while designing data lake/warehouse architectures and curated datasets. Implement DataOps/DevOps practices such as CI/CD and Infrastructure as Code, and strengthen data quality, governance, observability, security, and PII handling across the platform using cloud services and modern streaming patterns.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
HSBC
HSBC
13 hours ago

GCP/Streaming/Data Platforms /Consultant Specialist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Build and maintain scalable data ingestion, batch, and streaming pipelines across APIs, databases, files, and events. Own reliable pipeline operations with orchestration, retries, backfills, idempotency, and SLAs while designing data lake/warehouse architectures and curated datasets. Implement DataOps/DevOps practices such as CI/CD and Infrastructure as Code, and strengthen data quality, governance, observability, security, and PII handling across the platform using cloud services and modern streaming patterns.
Location: Pune
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Build and maintain scalable data ingestion pipelines across APIs, databases, files, and events.
  • •Develop batch and streaming data processing including CDC patterns and near-real-time datasets.
  • •Ensure reliable pipeline operations using orchestration, retries, backfills, idempotency, and SLAs.
  • •Design and deliver data lake/warehouse architectures and curated datasets/data marts with domain or dimensional modelling.
  • •Implement DataOps/DevOps practices (CI/CD, operational excellence) and data governance/observability with secure storage and PII handling.

Key Requirements

  • •8–10 years of experience in data engineering delivering production-grade pipelines and datasets.
  • •Strong SQL and proficiency in Python and/or Scala/Java for data processing.
  • •Hands-on experience with orchestration tools (e.g., Airflow or equivalent) and ETL/ELT patterns.
  • •Solid understanding of data warehousing concepts, distributed processing, and performance optimisation.
  • •Experience with data quality/testing frameworks and operational monitoring/alerting with a security/governance mindset (including PII handling).
Experience:8-10 yearsData engineering
Skills:Reliability focusOperational excellenceData quality mindsetSecurity and governance mindset
Tech Stack:GCPBigQueryDataprocDataflowPub/SubKafkaAirflowPythonScalaJavaSQLCI/CDInfrastructure as CodeETLELTCDCLakehouseDataOpsDevOps

Company Brief

HSBC
Global banking and financial services organisation offering retail, commercial, corporate and investment banking, wealth management, and global markets services across Europe, Asia, the Americas and the Middle East.
Industry: Banking
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: London, United Kingdom
Founded: 1865
Glassdoor
Glassdoor: 3.6
WebsiteLinkedIn