Senior Data Engineer - Databricks

SugarCRM
Denver
Workplace: HybridFull timeUSD 155,000 - 185,000 annuallyFunction: Solutions Engineering & Sales EngineeringSkills: ["Communication","Collaboration","Ownership","Cross-functional teamwork","Problem-solving"]

Own Databricks production support for a revenue intelligence data platform, ensuring reliable, SLA-driven pipeline delivery through monitoring, incident response, and SLA reporting. Build and optimize high-performance pipelines using Delta Lake and incremental/streaming patterns, modernize legacy ETL/ELT into Databricks, and reduce compute costs. Implement multi-tenant isolation, data quality observability, and security/governance for enterprise CRM/ERP data across Azure and AWS while rotating on-call and maintaining runbooks and documentation.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
SugarCRM
SugarCRM
1 week ago

Senior Data Engineer - Databricks

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Own Databricks production support for a revenue intelligence data platform, ensuring reliable, SLA-driven pipeline delivery through monitoring, incident response, and SLA reporting. Build and optimize high-performance pipelines using Delta Lake and incremental/streaming patterns, modernize legacy ETL/ELT into Databricks, and reduce compute costs. Implement multi-tenant isolation, data quality observability, and security/governance for enterprise CRM/ERP data across Azure and AWS while rotating on-call and maintaining runbooks and documentation.
Location: Denver
Workplace: Hybrid
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Mid level

Key Responsibilities

  • •Provide Databricks production support for the data platform, including monitoring, alerting, and incident response across production data flows.
  • •Maintain and report SLA performance metrics for pipeline delivery, ensuring platform visibility and accountability.
  • •Design and build high-performance Databricks pipelines to ingest, transform, and serve ERP and CRM data at scale across Azure and AWS.
  • •Own Delta Lake architecture, including schema design, partitioning, data quality enforcement, and incremental processing patterns.
  • •Migrate legacy ETL/ELT pipelines to Databricks and implement automation/CI/CD to reduce manual intervention and ensure uninterrupted data delivery during transitions.

Pay and Benefits

Salary: USD 155,000 - 185,000 annually
Perks:Health Insurance401kPaid LeavePaid ParentalPet InsuranceLearning BudgetLegal ServicesTravel Allowance

Key Requirements

  • •4+ years of data engineering experience.
  • •At least 2 years with Databricks or the Apache Spark ecosystem across Azure and/or AWS.
  • •Proficiency in PySpark, SQL, and Python building and operating production-grade pipelines under SLA constraints.
  • •Hands-on Delta Lake experience including schema evolution, ACID transactions, optimize/vacuum lifecycle, and incremental/streaming processing patterns.
  • •Experience with data governance, security, and compliance for multi-tenant environments, including tenant isolation and access control.
Skills:CommunicationCollaborationOwnershipCross-functional teamworkProblem-solving
Certifications:Databricks Certified Data Engineer AssociateDatabricks Certified Data Engineer Professional
Tech Stack:DatabricksAzureAWSPySparkSQLPythonApache SparkDelta LakeUnity CatalogRBACSecrets managementUnity Catalog Isolation Attestation MapsServerlessPostgreSQLMicrosoft SQL ServerSSISInformaticaCI/CDVersion controlAutomated testing

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

SugarCRM
Provides customer relationship management (CRM) software and cloud-based sales, marketing, and service automation solutions for mid-market and enterprise customers, with on-premise and SaaS deployment options.
Industry: Enterprise Software
Company Size: Large (251 to 1,000 employees)
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Cupertino, United States
Founded: 2004
WebsiteLinkedIn