Databricks - Sr Technical Lead-Data Engg (INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN)

Birlasoft
Pune
Workplace: OnsiteFull timeFunction: Administration & Executive AssistanceSkills: ["Mentoring","Collaboration","Stakeholder management","Guidance"]

Build and optimize enterprise data platforms on Azure using Databricks, PySpark, ADF, and SQL. Own end-to-end ingestion frameworks, Bronze-to-Silver transformations, ELT/ETL pipelines, and analytics-ready dimensional modeling. Implement data quality checks with Unity Catalog, enforce data governance and access controls, and handle compatibility for change. Collaborate with architects and business teams, and provide guidance to junior engineers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
3 days ago

Databricks - Sr Technical Lead-Data Engg (INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and optimize enterprise data platforms on Azure using Databricks, PySpark, ADF, and SQL. Own end-to-end ingestion frameworks, Bronze-to-Silver transformations, ELT/ETL pipelines, and analytics-ready dimensional modeling. Implement data quality checks with Unity Catalog, enforce data governance and access controls, and handle compatibility for change. Collaborate with architects and business teams, and provide guidance to junior engineers.
Location: Pune
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Architect, develop, and optimize ingestion frameworks using ADF, Databricks, and Spark, including Bronze-to-Silver transformations.
  • •Build high-throughput ELT/ETL pipelines integrating on-prem and cloud systems, APIs, and third-party sources.
  • •Develop PySpark transformation scripts and implement Delta Lake capabilities (ACID transactions, schema enforcement/evolution, time travel).
  • •Implement data quality checks, audit mechanisms, and enforce Unity Catalog standards including naming conventions, metadata policies, and RBAC/ABAC access controls.
  • •Collaborate with customer IT and business teams, align delivery with business objectives, and provide guidance to junior engineers.

Key Requirements

  • •Strong hands-on experience with Databricks, PySpark, ADF, and SQL for building data platforms and analytics solutions.
  • •Experience architecting and implementing enterprise-grade data pipelines, including ingestion from diverse sources and complex transformations.
  • •Ability to design and optimize ELT/ETL pipelines for structured, semi-structured, and unstructured data using Delta Lake.
  • •Knowledge of data governance and quality practices, including Unity Catalog standards, metadata policies, and access controls.
  • •Experience mentoring junior engineers and collaborating with architects, product owners, and business/IT stakeholders to deliver production-ready solutions.
Experience:Enterprise data pipelinesData governanceCloud data platformsData engineering
Skills:MentoringCollaborationStakeholder managementGuidance
Tech Stack:DatabricksPySparkADFSQLAzureSparkDelta LakeUnity CatalogDatabricks GenieCI/CDAPIs

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn