Databricks + PySpark - Technical Lead-Data Engg

Birlasoft
Mumbai, Pune, Noida, Bengaluru
Workplace: OnsiteFull timeFunction: Administration & Executive AssistanceExperience: 2-3 yearsSkills: []

Design, develop, and deploy scalable data pipelines using Azure services, with a focus on Databricks and PySpark. Build and maintain data source integrations to handle growing data volume and complexity, and develop modern data warehouse solutions using Azure Data Lake and Azure Databricks. Deliver technical specifications and application interface designs, create batch processing and integration workflows for structured and non-structured data, and collaborate with BI and business teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
15 hours ago

Databricks + PySpark - Technical Lead-Data Engg

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 15 hours agoStatus: Live

Job Summary

Design, develop, and deploy scalable data pipelines using Azure services, with a focus on Databricks and PySpark. Build and maintain data source integrations to handle growing data volume and complexity, and develop modern data warehouse solutions using Azure Data Lake and Azure Databricks. Deliver technical specifications and application interface designs, create batch processing and integration workflows for structured and non-structured data, and collaborate with BI and business teams.
Location: Mumbai, Pune, Noida, Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Perform design, development, and deployment using Azure services including Databricks, PySpark, SQL, and Data Factory.
  • •Develop and maintain scalable data pipelines and build new data source integrations.
  • •Create technical specification designs and application interface designs.
  • •Build modern data warehouse solutions using Azure stack components (Azure Data Lake, Azure Databricks) and PySpark.
  • •Develop batch processing and integration solutions for structured and non-structured data; collaborate with BI and business teams.

Key Requirements

  • •2-3 years of project experience with Azure Databricks.
  • •2-3 years of experience with Azure Data Factory (ADF).
  • •2+ years of experience with PySpark.
  • •Develop scalable data pipelines and build data source integrations for increasing data volume and complexity.
  • •Develop modern data warehouse solutions using Azure Data Lake/Azure Databricks and perform technical specification and application interface design.
Experience:2-3 years
Tech Stack:AzureDatabricksPySparkSQLData FactoryAzure Data LakeAzure DatabricksAzure StackBatch processing

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn