Staff Software Engineer - Ingestion

Databricks
Bengaluru
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 15+ yearsSkills: ["Communication","Problem-solving"]

Senior-level software engineer specializing in ingestion for Lakeflow Connect, building and optimizing data ingestion for large-scale distributed systems. You will work on low-level data extraction from OLTP sources, contribute to architecture, mentor teammates, lead cross-team technical initiatives, and help drive the product roadmap for industrial-scale data ingestion within Databricks' Lakeflow and Data Engineering efforts.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
10 months ago

Staff Software Engineer - Ingestion

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Senior-level software engineer specializing in ingestion for Lakeflow Connect, building and optimizing data ingestion for large-scale distributed systems. You will work on low-level data extraction from OLTP sources, contribute to architecture, mentor teammates, lead cross-team technical initiatives, and help drive the product roadmap for industrial-scale data ingestion within Databricks' Lakeflow and Data Engineering efforts.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Lead and contribute to architectural design for ingestion pipelines, influencing product roadmap and taking ownership of new projects.
  • •Mentor team members, participate in sprint planning, and delegate work within the technical team.
  • •Break down complex problems quickly into potential solutions, knowns, and unknowns, and de-risk through prototyping/validation.
  • •Lead cross-team technical initiatives (TLG or similar) and drive org/eng-wide improvements driven by engineering needs.
  • •Debug low level production issues, measure performance, and optimize on large production clusters.

Key Requirements

  • •15+ years industry experience building and supporting large-scale distributed systems.
  • •Experience in areas like database replication, backup, transaction recovery at major database vendors (e.g., Microsoft SQL Server, Oracle, IBM).
  • •Comfortable working towards a multi-year vision with incremental deliverables.
  • •Motivated by delivering customer value and impact.
  • •Strong foundation in algorithms and data structures and their real-world use cases.
Experience:15+ years
Skills:CommunicationProblem-solving
Languages:English
Tech Stack:SQLDatabasesDistributed systemsLog parsingIncremental data captureData ingestionArchitecture design

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn