Senior Software Engineer - Data Platform

Databricks
Bengaluru
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 6+ yearsSkills: ["Communication","Leadership","Collaboration"]

Senior Software Engineer on the Data Platform team building the Databricks Data Intelligence Platform. You will design and run metrics stores and cross-company data platforms, develop tooling for Databricks on Databricks at scale across clouds, and lead ETL frameworks and data pipelines while collaborating with product, data science, and AI teams to enable secure, scalable data access and governance.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
1 year ago

Senior Software Engineer - Data Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live
Reposted: similar role first listed 2 years ago

Job Summary

Senior Software Engineer on the Data Platform team building the Databricks Data Intelligence Platform. You will design and run metrics stores and cross-company data platforms, develop tooling for Databricks on Databricks at scale across clouds, and lead ETL frameworks and data pipelines while collaborating with product, data science, and AI teams to enable secure, scalable data access and governance.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design and run the Databricks metrics store enabling all business units and engineering teams to bring their detailed metrics into a common platform with high quality, introspection, and query performance.
  • •Design and run the cross-company Data Intelligence Platform containing every business and product metric used to run Databricks, balancing data protections with ease of shareability as the company transitions to a public company.
  • •Develop tooling and infrastructure to manage and run Databricks on Databricks at scale across multiple clouds and deployment types, including CI/CD processes, data quality test frameworks, and infrastructure-as-code tooling.
  • •Design the base ETL framework used by all pipelines developed at the company.
  • •Partner with engineering teams to provide leadership in developing the long-term vision and requirements for the Databricks product.

Key Requirements

  • •6+ years of industry experience
  • •4+ years of technical leadership on large projects (ETL frameworks, metrics stores, infrastructure management, data security)
  • •Experience building, shipping and operating reliable multi-geo data pipelines at scale
  • •Experience with workflow/orchestration frameworks (e.g., Airflow, DBT)
  • •Experience with large-scale messaging systems (Kafka, RabbitMQ)
Experience:6+ yearsData platformData infrastructureMulti-geoETLData pipelines
Skills:CommunicationLeadershipCollaboration
Languages:English
Tech Stack:AirflowDBTKafkaRabbitMQCI/CDInfrastructure-as-codeETLDatabricksCloudMulti-cloud

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn