Staff Software Engineer (Data Platform)

Databricks
Bengaluru
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 12+ yearsSkills: ["Communication","Leadership"]

A Staff Software Engineer on the Data Platform team builds the Databricks Data Intelligence Platform, designing and operating data metrics stores, cross-company data pipelines, and ETL frameworks across multi-cloud deployments. You’ll lead tooling, governance, and telemetry APIs, collaborate with product, data science, and applied AI teams, and help scale data infrastructure to support enterprise-wide decision making.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
1 year ago

Staff Software Engineer (Data Platform)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live
Reposted: similar role first listed 2 years ago

Job Summary

A Staff Software Engineer on the Data Platform team builds the Databricks Data Intelligence Platform, designing and operating data metrics stores, cross-company data pipelines, and ETL frameworks across multi-cloud deployments. You’ll lead tooling, governance, and telemetry APIs, collaborate with product, data science, and applied AI teams, and help scale data infrastructure to support enterprise-wide decision making.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design and run the Databricks metrics store enabling all business units and engineering teams to share and aggregate metrics with high quality, introspection, and performance.
  • •Design and run the cross-company Data Intelligence Platform containing every business and product metric, balancing data protections with ease of shareability for a public company transition.
  • •Develop tooling and infrastructure to manage and run Databricks on Databricks at scale across clouds, geographies, and deployment types (CI/CD, data pipeline testing, and infrastructure-as-code tooling).
  • •Design the base ETL framework used by all pipelines developed at the company.
  • •Partner with engineering teams to provide leadership in developing the long-term vision and requirements for the product.

Key Requirements

  • •12+ years of industry experience
  • •6+ years of technical leadership on large projects (ETL frameworks, metrics stores, infrastructure management, data security)
  • •Experience building, shipping and operating multi-geo data pipelines at scale
  • •Experience with workflow/orchestration frameworks (Airflow, DBT or equivalents)
  • •Experience with large-scale messaging systems (Kafka, RabbitMQ or equivalents)
Experience:12+ yearsData infrastructureData engineeringCloud
Skills:CommunicationLeadership
Languages:English
Tech Stack:AirflowDBTKafkaRabbitMQCI/CDInfrastructure-as-codeDatabricks

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn