Staff Backend Engineer, Datalake Platform

Stripe
Dublin
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 10+ yearsSkills: ["Technical leadership","Cross-team coordination","Mentorship","Technical judgment","Developer experience sensibility"]

Architect and lead the evolution of the Iceberg platform, building a metastore service that becomes the single source of truth for Iceberg table management across Spark, Trino, Flink, and PyIceberg. Own the migration strategy from Hive Metastore, shape the object storage abstraction layer and client libraries, and partner on compliance architecture. Drive cost and efficiency at petabyte scale while setting technical standards and mentoring engineers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Stripe
Stripe
2 months ago

Staff Backend Engineer, Datalake Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Architect and lead the evolution of the Iceberg platform, building a metastore service that becomes the single source of truth for Iceberg table management across Spark, Trino, Flink, and PyIceberg. Own the migration strategy from Hive Metastore, shape the object storage abstraction layer and client libraries, and partner on compliance architecture. Drive cost and efficiency at petabyte scale while setting technical standards and mentoring engineers.
Location: Dublin
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Architect the unified Iceberg platform by leading the metastore service design, including API contracts, authorization model, and per-table credential vending.
  • •Drive the metastore migration strategy: sequencing, backward compatibility, rollback approach, and cross-team coordination for Hive Metastore-backed workloads.
  • •Shape the object storage abstraction layer, including bucket provisioning, access control policy design, and developer-facing client libraries.
  • •Lead compliance architecture with security and compliance teams, translating regulatory requirements into preventative platform controls.
  • •Drive cost and efficiency improvements at petabyte scale, establishing standards for reliability, security, and developer experience while mentoring senior engineers.

Key Requirements

  • •10+ years of professional software engineering experience.
  • •Demonstrated track record designing, building, and operating large-scale distributed storage or data infrastructure systems.
  • •Deep experience with object storage (S3, Azure Blob or equivalent), including IAM, access control policy design, lifecycle management, and petabyte-scale operations.
  • •Proven ability to lead complex, multi-quarter infrastructure projects end-to-end with cross-team dependency management and migration coordination.
  • •Strong background in authorization and access control design for distributed data systems.
Experience:10+ yearsData infrastructureDistributed systemsData governanceBig data
Skills:Technical leadershipCross-team coordinationMentorshipTechnical judgmentDeveloper experience sensibility
Languages:English
Tech Stack:Apache IcebergIceberg REST CatalogSparkTrinoFlinkPyIcebergHive MetastoreObject storageAmazon S3Azure BlobIAMAuthorizationAccess controlAudit loggingData lifecycle managementSOXICFR

Company Brief

Stripe
Provides payment processing APIs and financial infrastructure for internet businesses. Powers online payments for millions of companies from startups to Fortune 500s.
Industry: Payments
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Decacorn (USD 10B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2010
Glassdoor
Glassdoor: 4.2
WebsiteLinkedInGlassdoor