Senior Software Engineer - Ingestion

Databricks
Bengaluru
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 6+ yearsEducation: bachelorsSkills: ["Communication","Problem-solving","Collaboration"]

Build and optimize a highly scalable data ingestion engine for the Lakeflow Connect platform, enabling efficient data extraction from OLTP sources with minimal production impact. Collaborate across Databricks surfaces (Dashboards, Notebooks, SQL, AI) to embed ingestion capabilities, work on large-scale distributed backend systems, contribute to architecture and roadmap, and lead cross-team technical projects with hands-on debugging and prototyping.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
1 year ago

Senior Software Engineer - Ingestion

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build and optimize a highly scalable data ingestion engine for the Lakeflow Connect platform, enabling efficient data extraction from OLTP sources with minimal production impact. Collaborate across Databricks surfaces (Dashboards, Notebooks, SQL, AI) to embed ingestion capabilities, work on large-scale distributed backend systems, contribute to architecture and roadmap, and lead cross-team technical projects with hands-on debugging and prototyping.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Solve real business needs at large scale by applying your software engineering
  • •Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers
  • •Low level systems debugging, performance measurement & optimization on large production clusters
  • •Build architecture design, influence product roadmap, and take ownership and responsibility over new projects
  • •Use your deep experience to help prevent and investigate production issues

Key Requirements

  • •BS (or higher) in Computer Science, or a related field
  • •6+ years of production level experience in one of: Python, Java, Scala, C++, or similar language
  • •Experience developing large-scale distributed systems from scratch
  • •Hands-on experience in developing and operating backend systems
  • •Ability to contribute effectively throughout all project phases, from initial design and development to implementation and ongoing operations, with guidance from senior team members
Experience:6+ yearsData engineeringDistributed systemsBackendDatabase ingestion
Education:Bachelor's in Computer Science
Skills:CommunicationProblem-solvingCollaboration
Languages:English
Tech Stack:PythonJavaScalaC++Log parsingIncremental data captureOLTPBackend systems

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn