Databricks - Technical Specialist-Data Engg

Birlasoft
Pune
Workplace: OnsiteFull timeFunction: Data Analytics & Business IntelligenceSkills: ["Collaboration","Stakeholder management","Mentoring","Data governance mindset","Performance optimization"]

Design, architect, and optimize Azure-based data platforms and analytics solutions using Databricks and PySpark. Build high-throughput ELT/ETL pipelines with ingestion frameworks, Bronze-to-Silver transformations, and Gold-layer dimensional models aligned to business use cases. Implement data quality and governance in Unity Catalog, enforce standards and access controls, and deliver performant Delta Lake transformations with orchestration via ADF and end-to-end CI/CD collaboration.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
1 day ago

Databricks - Technical Specialist-Data Engg

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Design, architect, and optimize Azure-based data platforms and analytics solutions using Databricks and PySpark. Build high-throughput ELT/ETL pipelines with ingestion frameworks, Bronze-to-Silver transformations, and Gold-layer dimensional models aligned to business use cases. Implement data quality and governance in Unity Catalog, enforce standards and access controls, and deliver performant Delta Lake transformations with orchestration via ADF and end-to-end CI/CD collaboration.
Location: Pune
Workplace: Onsite
Employment Type: Full time
Job Function: Data Analytics & Business Intelligence

Key Responsibilities

  • •Build and maintain ingestion frameworks using ADF, Databricks, and Spark, including Bronze-to-Silver transformations aligned to architecture.
  • •Develop robust ELT/ETL pipelines to ingest and transform structured, semi-structured, and unstructured data from on-prem and cloud systems, APIs, and third-party sources.
  • •Implement curated Gold-layer dimensional data models (star/snowflake), including fact/dimension design, surrogate keys, and SCD handling for analytics use cases.
  • •Create Databricks and PySpark transformation scripts with performance tuning (caching, partitioning, Delta Lake features like ACID, schema enforcement/evolution, and time travel).
  • •Establish data quality checks, validation frameworks, and Unity Catalog governance (standards, metadata policies, and access controls), partnering with business/data stewards.

Key Requirements

  • •Strong hands-on expertise in Databricks and PySpark for building and optimizing data platforms and analytical solutions.
  • •Experience with Azure-based enterprise data pipelines including ingestion from diverse sources and complex transformations.
  • •Proficiency in ADF orchestration (pipelines, triggers, linked services, integration runtimes, parameterized datasets).
  • •Ability to design curated Gold-layer models, including dimensional models (star/snowflake), fact/dimensions, surrogate keys, and SCD handling.
  • •Knowledge of data governance and quality using Unity Catalog, including naming/metadata policies and access control (RBAC/ABAC).
Skills:CollaborationStakeholder managementMentoringData governance mindsetPerformance optimization
Tech Stack:DatabricksPySparkAzureADFSQLSparkELTETLDelta LakeUnity CatalogDimensional modelingSCDCI/CDNotebooksRBACABACAPIs

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn