Engineering Manager - Streaming

Databricks
Bellevue, San Francisco
Workplace: OnsiteFull timeUSD 181,000 - 253,750 annuallyFunction: Administration & Executive AssistanceExperience: 5+ yearsSkills: ["Leadership","Coaching","Cross-functional collaboration","Talent development"]

Lead the Spark Structured Streaming team to advance stream processing within OSS and the Databricks Data Intelligence Platform. Drive architecture, state management, new operators, and performance improvements to make the streaming engine state-of-the-art, while shaping the team, processes, and cross-functional collaboration to deliver high-quality, reliable infrastructure across Databricks products.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
8 months ago

Engineering Manager - Streaming

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Lead the Spark Structured Streaming team to advance stream processing within OSS and the Databricks Data Intelligence Platform. Drive architecture, state management, new operators, and performance improvements to make the streaming engine state-of-the-art, while shaping the team, processes, and cross-functional collaboration to deliver high-quality, reliable infrastructure across Databricks products.
Location: Bellevue, San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Manager level

Key Responsibilities

  • •Leading a talented engineering team in Spark™ Structured Streaming team developing and promoting the engine in OSS and the Databricks Data Intelligence Platform
  • •Overseeing sustained recruitment of top-tier talent, and upskilling talent on the team
  • •Implementing robust processes to efficiently execute product vision, strategy, and roadmap in alignment with organizational goals and priorities
  • •Build software that is not just high quality but easy to operate.
  • •Make company wide impact by driving Stream Processing adoption across the Databricks product portfolio

Pay and Benefits

Salary: USD 181,000 - 253,750 annually

Key Requirements

  • •5+ years experience working in a related system, including big-data ecosystem, Apache Spark™ or database internal
  • •A passion for database systems, storage systems, distributed systems, language design, or performance optimization
  • •Can ensure the team builds high quality and reliable infrastructure services. Experience being responsible for testing, quality, and SLAs of a product. Previous experience building and leading teams in a complex technical domain, such as on distributed data systems or database internals
  • •Ability to attract, hire, and coach engineers who meet the Databricks hiring standards. Can up level existing team via hiring top-notch senior talent, growing leaders and helping struggling members. Can gain trust of the team and guide their careers. Experience managing distributed teams preferred
  • •Comfortable working cross functionally with product management and directly with customers; ability to deeply understand product and customer personas
Experience:5+ yearsBig-dataApache SparkDistributed systemsStream processing
Skills:LeadershipCoachingCross-functional collaborationTalent development
Languages:English
Tech Stack:Apache SparkSpark Structured StreamingDelta LakeMLflowOSS

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn