Lead Architect - Azure DBX

Fractal Labs
California
Workplace: OnsiteFull timeUSD 180,000 - 190,000 annuallyFunction: Software EngineeringExperience: 10+ yearsEducation: bachelorsSkills: ["Technical leadership","Stakeholder management","Communication","Problem-solving","Mentoring"]

Lead the design, development, and optimization of enterprise-scale data platforms on Microsoft Azure. Own lakehouse architecture and implement scalable Azure Databricks solutions using PySpark, Spark SQL, Delta Lake, and Medallion patterns. Build batch and real-time ETL/ELT pipelines integrated with ADF, ADLS Gen2, Synapse, and Azure SQL, while optimizing Spark performance and establishing governance, security, and CI/CD with Azure DevOps.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Fractal Labs
Fractal Labs
1 month ago

Lead Architect - Azure DBX

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Status: Live

Job Summary

Lead the design, development, and optimization of enterprise-scale data platforms on Microsoft Azure. Own lakehouse architecture and implement scalable Azure Databricks solutions using PySpark, Spark SQL, Delta Lake, and Medallion patterns. Build batch and real-time ETL/ELT pipelines integrated with ADF, ADLS Gen2, Synapse, and Azure SQL, while optimizing Spark performance and establishing governance, security, and CI/CD with Azure DevOps.
Location: California
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and implement scalable, high-performance data platforms using Azure Databricks and Azure services.
  • •Develop ETL/ELT pipelines with PySpark, Spark SQL, and Databricks workflows.
  • •Architect lakehouse solutions using Delta Lake and Medallion architecture, including data migration to Azure.
  • •Integrate data pipelines with ADF, ADLS Gen2, Azure Synapse Analytics, Azure SQL Database, and related Azure services.
  • •Establish data quality, monitoring, governance, and security; implement CI/CD with Azure DevOps and mentor engineers.

Pay and Benefits

Salary: USD 180,000 - 190,000 annually
Perks:Health InsuranceDentalVisionLife InsuranceDisability401kPaid HolidaysParental Leave

Key Requirements

  • •10+ years of experience in data engineering, BI, or data warehousing.
  • •5+ years hands-on experience with Azure Databricks.
  • •Strong expertise in PySpark, Spark SQL, Python, and advanced SQL.
  • •Experience designing enterprise-scale data lakes and lakehouse architectures.
  • •Hands-on experience with Delta Lake, Delta Live Tables (DLT), and Unity Catalog.
Experience:10+ yearsData engineeringData warehousingBI
Education:Bachelor's
Skills:Technical leadershipStakeholder managementCommunicationProblem-solvingMentoring
Certifications:Databricks Certified Data Engineer ProfessionalDatabricks Certified Data Engineer AssociateMicrosoft Certified: Azure Data Engineer Associate (DP-203)Microsoft Azure Solutions Architect Expert
Tech Stack:Azure DatabricksPySparkDelta LakeSpark SQLPythonETLELTLakehouseMedallion architectureAzure Data FactoryADFADLS Gen2Azure Synapse AnalyticsAzure SQL DatabaseAzure DevOpsGitTerraformARMBicepUnity Catalog

Company Brief

Fractal Labs
Provides AI-driven analytics, decision intelligence, and engineering solutions to Fortune 500 companies, helping enterprises apply advanced analytics and machine learning for marketing, supply chain, finance, and customer experience transformation.
Industry: Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: New York, United States
Founded: 2000
WebsiteLinkedIn