Databricks + PySpark - Technical Lead-Data Engg

Birlasoft
Mumbai, Pune, Noida, Bengaluru
Workplace: OnsiteFull timeFunction: Administration & Executive AssistanceExperience: 2-3 yearsSkills: ["Collaboration"]

Design, develop, and deploy data engineering solutions on Azure, using Databricks and PySpark alongside SQL and Azure Data Factory. Build scalable data pipelines and new data source integrations to handle growing data volume and complexity, including batch processing and structured/non-structured data workflows. Create technical specifications and interfaces, develop modern data warehouse solutions with Azure Data Lake and Azure Databricks, and collaborate with BI analytics and business teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
14 hours ago

Databricks + PySpark - Technical Lead-Data Engg

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Design, develop, and deploy data engineering solutions on Azure, using Databricks and PySpark alongside SQL and Azure Data Factory. Build scalable data pipelines and new data source integrations to handle growing data volume and complexity, including batch processing and structured/non-structured data workflows. Create technical specifications and interfaces, develop modern data warehouse solutions with Azure Data Lake and Azure Databricks, and collaborate with BI analytics and business teams.
Location: Mumbai, Pune, Noida, Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Perform design, development, and deployment using Azure services such as Databricks, PySpark, SQL, and Data Factory.
  • •Develop and maintain scalable data pipelines and build new data source integrations for increasing data volume and complexity.
  • •Create technical specification design and application interface design.
  • •Develop modern data warehouse solutions using Azure Stack components like Azure Data Lake and Azure Databricks with PySpark.
  • •Build batch processing and integration solutions for structured and non-structured data, and collaborate with BI analytics and the business team.

Key Requirements

  • •2 to 3 years of project experience in Azure Databricks.
  • •2 to 3 years of experience with Azure Data Factory (ADF).
  • •2+ years of experience with PySpark.
  • •Experience with Azure services including Databricks, PySpark, SQL, and Data Factory.
  • •Experience creating technical specifications and application interface design.
Experience:2-3 yearsData engineeringData pipelinesAzure
Skills:Collaboration
Tech Stack:AzureDatabricksPySparkSQLData FactoryADFAzure Data LakeAzure DatabricksAzure StackBatch processingData pipelinesData source integrationsBI analytics

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn