Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

Birlasoft
Hyderabad
Workplace: OnsiteFull timeFunction: DevOps, Cloud & InfrastructureSkills: ["Problem solving","Team collaboration","Agile/scrum","Documentation","Technical design"]

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows, batch and streaming processing with Apache Spark (PySpark), and create reusable notebooks, jobs, and workflows. Implement data transformation, cleansing, validation, and Delta Lake tables with partitioning and Z-Ordering. Integrate data from databases, APIs, and cloud storage, monitor pipeline performance, and collaborate with analysts, architects, and stakeholders.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
2 months ago

Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows, batch and streaming processing with Apache Spark (PySpark), and create reusable notebooks, jobs, and workflows. Implement data transformation, cleansing, validation, and Delta Lake tables with partitioning and Z-Ordering. Integrate data from databases, APIs, and cloud storage, monitor pipeline performance, and collaborate with analysts, architects, and stakeholders.
Location: Hyderabad
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure

Key Responsibilities

  • •Design, develop, and maintain ETL/ELT pipelines using Databricks.
  • •Develop scalable data processing frameworks with Apache Spark (PySpark), including batch and streaming pipelines.
  • •Integrate and transform data from databases, APIs, cloud storage, and enterprise applications.
  • •Develop and optimize Delta Lake tables using partitioning and Z-Ordering.
  • •Monitor and troubleshoot pipeline failures and performance issues; collaborate with stakeholders on data requirements.

Key Requirements

  • •Strong experience with Databricks, including building ETL/ELT pipelines.
  • •Expertise in Apache Spark / PySpark and proficiency in Python.
  • •Strong SQL skills and experience with batch and streaming data pipelines.
  • •Experience with Delta Lake and data warehousing concepts.
  • •Experience with Git/version control and following coding standards and CI/CD best practices.
Experience:Data engineeringETL/ELTCloud data
Skills:Problem solvingTeam collaborationAgile/scrumDocumentationTechnical design
Certifications:Databricks certification
Tech Stack:DatabricksApache SparkPySparkPythonSQLETL/ELTDelta LakePartitioningZ-OrderingNotebooksWorkflowsGitCI/CDMicrosoft AzureAzure DatabricksADLS Gen2Azure Data FactoryAmazon S3AWS GlueEMR

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn