Data Engg + Databricks & PySpark-Sr Technical Lead-Data Engg

Birlasoft
Pune
Workplace: OnsiteFull timeFunction: Administration & Executive AssistanceSkills: ["Communication","Leadership","Problem-solving"]

Seasoned Senior Azure Data Engineer / Sr. Technical Lead responsible for designing and delivering enterprise-scale data solutions on Azure Databricks with PySpark, ADF, SQL, and Delta Lake. You will lead architecture, mentor engineers, and collaborate with cross-functional teams to build a scalable Modern Data Warehouse and Lakehouse on Azure.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
2 months ago

Data Engg + Databricks & PySpark-Sr Technical Lead-Data Engg

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 11 hours agoStatus: Live

Job Summary

Seasoned Senior Azure Data Engineer / Sr. Technical Lead responsible for designing and delivering enterprise-scale data solutions on Azure Databricks with PySpark, ADF, SQL, and Delta Lake. You will lead architecture, mentor engineers, and collaborate with cross-functional teams to build a scalable Modern Data Warehouse and Lakehouse on Azure.
Location: Pune
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Sr. Manager level

Key Responsibilities

  • •Lead the design, development, and deployment of large-scale data engineering solutions using Azure Databricks, PySpark, SQL, ADF, and Azure Data Lake; Architect end-to-end Modern Data Warehouse (MDW) and Lakehouse solutions with scalability, performance, security, and cost optimization.
  • •Define technical standards, coding best practices, reusable frameworks, and architectural guidelines for engineering teams; Provide technical leadership across the project lifecycle—requirements analysis, solution blueprinting, estimation, development, and deployment.
  • •Build, optimize, and maintain scalable, high-performance ELT/ETL pipelines to process large volumes of structured and unstructured data; enable integration with on-premise systems, cloud services, APIs, and third-party sources.
  • •Implement data quality frameworks covering validation, reconciliation, error handling, metadata management, and security; maintain detailed documentation and runbooks.
  • •Collaborate with BI, analytics, and architects to translate business requirements into scalable technical solutions; mentor junior and mid-level engineers and lead code reviews.

Key Requirements

  • •Senior Azure Data Engineer with extensive expertise in Azure Databricks, PySpark, ADF, SQL, and Azure Data Lake.
Experience:AzureDatabricksPySparkAzure Data FactorySQLDelta LakeAzure Data LakeMDWLakehouse
Skills:CommunicationLeadershipProblem-solving
Languages:English
Tech Stack:AzureDatabricksPySparkSQLAzure Data FactoryDelta LakeAzure Data LakeCI/CD

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn