Birlasoft

1 month ago

Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg (INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Seasoned data engineering leader responsible for designing and delivering enterprise-scale data solutions on Azure. Lead architecture, build and optimize ELT/ETL pipelines with Azure Databricks, PySpark, and Delta Lake, mentor engineers, and collaborate with BI and analytics teams to implement scalable MDW/Lakehouse data ecosystems.

Location: Pune

Workplace: Onsite

Job Function: Administration & Executive Assistance

Seniority: Sr. Manager level

Key Responsibilities

•Lead the design, development, and deployment of large-scale data engineering solutions using Azure Databricks, PySpark, SQL, ADF, and Azure Data Lake; architect end-to-end MDW and Lakehouse solutions with a focus on scalability, security, and cost optimization
•Define technical standards, coding best practices, reusable frameworks, and architectural guidelines; provide technical leadership across the project lifecycle
•Build, optimize, and maintain scalable ELT/ETL pipelines; enable seamless integration with on-premise systems, cloud services, APIs, and third-party sources
•Design and implement advanced transformation logic with PySpark on Databricks; manage Databricks job pipelines, notebooks, clusters, and CI/CD integration
•Implement data governance, quality, and documentation frameworks; ensure security, data lineage, auditability, and detailed runbooks; collaborate with BI/analytics teams

Key Requirements

•Strong expertise in Azure Databricks, PySpark, ADF, SQL, and modern data engineering practices
•Experience designing and delivering enterprise-scale data solutions and MDW/Lakehouse architectures
•Hands-on engineering capabilities with the ability to lead requirements analysis, solution blueprinting, estimation, development, and deployment
•Proven ability to build, optimize, and maintain scalable ELT/ETL pipelines and data ingestion frameworks
•Experience with data governance, security, data lineage, and documentation; ability to mentor junior engineers

Experience:Data engineeringAzureDatabricksPySparkDelta Lake

Skills:LeadershipMentorshipCommunicationCollaborationProblem-solving

Tech Stack:Azure DatabricksPySparkSQLADFAzure Data LakeDelta LakeCI/CD

Company Brief

Birlasoft

Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.

Industry: Professional Services

Company Size: Enterprise (1,001+ employees)

Revenue: USD 500M to 1B

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Noida, India

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Birlasoft

1 month ago

Data Engg with Databricks+ PySpark -Sr Technical Lead-Data Engg (INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Location: Pune

Workplace: Onsite

Job Function: Administration & Executive Assistance

Seniority: Sr. Manager level

Key Responsibilities

•Lead the design, development, and deployment of large-scale data engineering solutions using Azure Databricks, PySpark, SQL, ADF, and Azure Data Lake; architect end-to-end MDW and Lakehouse solutions with a focus on scalability, security, and cost optimization
•Define technical standards, coding best practices, reusable frameworks, and architectural guidelines; provide technical leadership across the project lifecycle
•Build, optimize, and maintain scalable ELT/ETL pipelines; enable seamless integration with on-premise systems, cloud services, APIs, and third-party sources
•Design and implement advanced transformation logic with PySpark on Databricks; manage Databricks job pipelines, notebooks, clusters, and CI/CD integration
•Implement data governance, quality, and documentation frameworks; ensure security, data lineage, auditability, and detailed runbooks; collaborate with BI/analytics teams

Key Requirements

•Strong expertise in Azure Databricks, PySpark, ADF, SQL, and modern data engineering practices
•Experience designing and delivering enterprise-scale data solutions and MDW/Lakehouse architectures
•Hands-on engineering capabilities with the ability to lead requirements analysis, solution blueprinting, estimation, development, and deployment
•Proven ability to build, optimize, and maintain scalable ELT/ETL pipelines and data ingestion frameworks
•Experience with data governance, security, data lineage, and documentation; ability to mentor junior engineers

Experience:Data engineeringAzureDatabricksPySparkDelta Lake

Skills:LeadershipMentorshipCommunicationCollaborationProblem-solving

Tech Stack:Azure DatabricksPySparkSQLADFAzure Data LakeDelta LakeCI/CD

Company Brief

Birlasoft

Industry: Professional Services

Company Size: Enterprise (1,001+ employees)

Revenue: USD 500M to 1B

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Noida, India

Website LinkedIn