Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg (INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN)

Birlasoft
Pune
Workplace: OnsiteFull-timeFunction: Administration & Executive AssistanceSkills: ["Leadership","Mentorship","Communication","Collaboration","Problem-solving"]

Seasoned data engineering leader responsible for designing and delivering enterprise-scale data solutions on Azure. Lead architecture, build and optimize ELT/ETL pipelines with Azure Databricks, PySpark, and Delta Lake, mentor engineers, and collaborate with BI and analytics teams to implement scalable MDW/Lakehouse data ecosystems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
2 months ago

Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg (INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Seasoned data engineering leader responsible for designing and delivering enterprise-scale data solutions on Azure. Lead architecture, build and optimize ELT/ETL pipelines with Azure Databricks, PySpark, and Delta Lake, mentor engineers, and collaborate with BI and analytics teams to implement scalable MDW/Lakehouse data ecosystems.
Location: Pune
Workplace: Onsite
Job Function: Administration & Executive Assistance
Seniority: Sr. Manager level

Key Responsibilities

  • •Lead the design, development, and deployment of large-scale data engineering solutions using Azure Databricks, PySpark, SQL, ADF, and Azure Data Lake; architect end-to-end MDW and Lakehouse solutions with a focus on scalability, security, and cost optimization
  • •Define technical standards, coding best practices, reusable frameworks, and architectural guidelines; provide technical leadership across the project lifecycle
  • •Build, optimize, and maintain scalable ELT/ETL pipelines; enable seamless integration with on-premise systems, cloud services, APIs, and third-party sources
  • •Design and implement advanced transformation logic with PySpark on Databricks; manage Databricks job pipelines, notebooks, clusters, and CI/CD integration
  • •Implement data governance, quality, and documentation frameworks; ensure security, data lineage, auditability, and detailed runbooks; collaborate with BI/analytics teams

Key Requirements

  • •Strong expertise in Azure Databricks, PySpark, ADF, SQL, and modern data engineering practices
  • •Experience designing and delivering enterprise-scale data solutions and MDW/Lakehouse architectures
  • •Hands-on engineering capabilities with the ability to lead requirements analysis, solution blueprinting, estimation, development, and deployment
  • •Proven ability to build, optimize, and maintain scalable ELT/ETL pipelines and data ingestion frameworks
  • •Experience with data governance, security, data lineage, and documentation; ability to mentor junior engineers
Experience:Data engineeringAzureDatabricksPySparkDelta Lake
Skills:LeadershipMentorshipCommunicationCollaborationProblem-solving
Tech Stack:Azure DatabricksPySparkSQLADFAzure Data LakeDelta LakeCI/CD

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn