Staff Software Engineer - Ingestion

Databricks
Bengaluru
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 15+ yearsSkills: ["Communication","Leadership","Problem-solving"]

Join Databricks as a Staff Software Engineer focusing on Ingestion for Lakeflow Connect. You will build and optimize large-scale ingestion pipelines, extract data from OLTP sources with minimal production load, and collaborate across teams to embed ingestion capabilities into dashboards, notebooks, SQL, and AI surfaces. Bring 15+ years distributed systems experience and lead architectural initiatives.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
10 months ago

Staff Software Engineer - Ingestion

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live
Reposted: similar role first listed 10 months ago

Job Summary

Join Databricks as a Staff Software Engineer focusing on Ingestion for Lakeflow Connect. You will build and optimize large-scale ingestion pipelines, extract data from OLTP sources with minimal production load, and collaborate across teams to embed ingestion capabilities into dashboards, notebooks, SQL, and AI surfaces. Bring 15+ years distributed systems experience and lead architectural initiatives.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Lead and contribute to the design and development of high-scale ingestion engines that process hundreds of TB of data daily across thousands of customers.
  • •Perform low-level system debugging, performance measurement, and optimization on large production clusters.
  • •Plan and lead complicated technical projects that involve multiple teams and influence product roadmap.
  • •Mentor team members, participate in sprint planning, and drive engineering initiatives across the organization.
  • •Break down complex problems into potential solutions and de-risk through prototyping and validation.

Key Requirements

  • •15+ years industry experience building and supporting large-scale distributed systems.
  • •Experience in areas like Database replication, backup, transaction recovery at major database vendors (e.g., Microsoft SQL Server, Oracle, IBM).
  • •Comfortable working towards a multi-year vision with incremental deliverables.
  • •Motivated by delivering customer value and impact.
  • •Strong foundation in algorithms and data structures and their real-world use cases.
Experience:15+ yearsDistributed systemsDatabase
Skills:CommunicationLeadershipProblem-solving
Languages:English
Tech Stack:SQL ServerOracleIBMIncremental data captureLog parsing

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn