Staff Software Engineer - Streaming

Databricks
Seattle, Washington
Workplace: OnsiteFull timeUSD 182,400 - 247,000 annuallyFunction: Software EngineeringExperience: 8+ yearsEducation: bachelorsSkills: ["Engineering quality","Operability","Mentorship","Cross-functional collaboration","Operational excellence"]

Drive the technical direction of Spark Structured Streaming across open source and Databricks components. Build core engine capabilities such as state management and new operators, and re-imagine architecture to improve latency, throughput, and cost. Raise engineering quality and operability so streaming software is production-ready. Lead adoption across the product portfolio and guide long-term architecture and technical-debt decisions while mentoring and partnering with the engineering manager.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
1 month ago

Staff Software Engineer - Streaming

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Drive the technical direction of Spark Structured Streaming across open source and Databricks components. Build core engine capabilities such as state management and new operators, and re-imagine architecture to improve latency, throughput, and cost. Raise engineering quality and operability so streaming software is production-ready. Lead adoption across the product portfolio and guide long-term architecture and technical-debt decisions while mentoring and partnering with the engineering manager.
Location: Seattle, Washington
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Set and drive the technical vision for Spark Structured Streaming across OSS and the Databricks Data Intelligence Platform.
  • •Design and build core engine capabilities including state management, new operators, and architectural improvements for latency and throughput.
  • •Raise the bar for engineering quality and operability to build software that is easy to run in production.
  • •Drive stream processing adoption across the Databricks product portfolio.
  • •Mentor and technically lead engineers, partnering with the Engineering Manager to attract and grow talent.

Pay and Benefits

Salary: USD 182,400 - 247,000 annually

Key Requirements

  • •BS (or higher) in Computer Science or related field, or equivalent practical experience.
  • •8+ years building related systems in big-data ecosystems, Apache Spark, or database internals.
  • •Strong interest in database/storage systems, distributed systems, language design, or performance optimization.
  • •Ability to work toward a multi-year vision with incremental deliverables.
  • •Track record delivering features with operational excellence and high engineering quality.
Experience:8+ yearsBig dataApache SparkDatabases
Education:Bachelor's in Computer Science or a related technical field
Skills:Engineering qualityOperabilityMentorshipCross-functional collaborationOperational excellence
Languages:English
Tech Stack:Spark Structured StreamingApache SparkDatabricks Data Intelligence PlatformStream processingState managementDistributed systemsPerformance optimization

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn