Azure Subcontractor

Birlasoft
Hyderabad
Workplace: OnsiteFull timeFunction: DevOps, Cloud & InfrastructureSkills: ["Problem-solving","Team collaboration","Agile/scrum methodology","Documentation and technical design"]

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows with Apache Spark (PySpark), SQL, and Delta Lake, including batch and streaming pipeline development. Integrate data across databases, APIs, and cloud storage, and implement data transformation, validation, partitioning, and Z-Ordering. Create reusable notebooks and jobs, monitor performance, and collaborate with analysts and architects on data requirements.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
2 months ago

Azure Subcontractor

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows with Apache Spark (PySpark), SQL, and Delta Lake, including batch and streaming pipeline development. Integrate data across databases, APIs, and cloud storage, and implement data transformation, validation, partitioning, and Z-Ordering. Create reusable notebooks and jobs, monitor performance, and collaborate with analysts and architects on data requirements.
Location: Hyderabad
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure

Key Responsibilities

  • •Design, develop, and maintain ETL/ELT pipelines using Databricks.
  • •Develop scalable data processing frameworks using Apache Spark (PySpark).
  • •Build and optimize batch and streaming data pipelines.
  • •Integrate data from databases, APIs, cloud storage, and enterprise applications, then perform cleansing and validation.
  • •Develop Delta Lake tables, create reusable Databricks notebooks/workflows/jobs, and troubleshoot pipeline failures and performance issues.

Key Requirements

  • •Strong experience with Databricks and Apache Spark (PySpark).
  • •Proficiency in Python and strong SQL skills.
  • •Experience building ETL/ELT pipelines and data warehousing concepts.
  • •Experience with Delta Lake, including partitioning and Z-Ordering for data storage optimization.
  • •Experience with Git and version control, plus coding standards and CI/CD best practices.
Skills:Problem-solvingTeam collaborationAgile/scrum methodologyDocumentation and technical design
Tech Stack:DatabricksApache SparkPySparkPythonSQLETLELTDelta LakeGitCI/CDAzure DatabricksADLS Gen2Azure Data FactoryAmazon S3AWS GlueEMRGoogle BigQueryCloud StorageSpark Structured StreamingAirflow

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn