Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

Birlasoft
Hyderabad
Workplace: OnsiteFull timeFunction: DevOps, Cloud & InfrastructureSkills: ["Problem-solving","Team collaboration","Documentation","Technical design","Agile/scrum"]

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. You’ll build ETL/ELT workflows with Apache Spark (PySpark), optimize batch and streaming processing, and integrate data from databases, APIs, cloud storage, and enterprise applications. Create reusable notebooks, workflows, and jobs, implement data transformation/validation, and develop Delta Lake tables with partitioning and Z-Ordering, collaborating with stakeholders on data requirements.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
2 months ago

Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. You’ll build ETL/ELT workflows with Apache Spark (PySpark), optimize batch and streaming processing, and integrate data from databases, APIs, cloud storage, and enterprise applications. Create reusable notebooks, workflows, and jobs, implement data transformation/validation, and develop Delta Lake tables with partitioning and Z-Ordering, collaborating with stakeholders on data requirements.
Location: Hyderabad
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure

Key Responsibilities

  • •Design, develop, and maintain ETL/ELT pipelines using Databricks.
  • •Develop scalable data processing frameworks using Apache Spark (PySpark).
  • •Build and optimize batch and streaming data pipelines.
  • •Integrate data from databases, APIs, cloud storage, and enterprise applications.
  • •Monitor and troubleshoot pipeline failures and performance issues, collaborating with business analysts, architects, and stakeholders.

Key Requirements

  • •Strong experience with Databricks.
  • •Expertise in Apache Spark / PySpark for scalable data processing.
  • •Proficiency in Python and strong SQL skills.
  • •Experience developing ETL/ELT pipelines.
  • •Experience with Delta Lake and data warehousing concepts.
Skills:Problem-solvingTeam collaborationDocumentationTechnical designAgile/scrum
Tech Stack:DatabricksApache SparkPySparkPythonSQLETL/ELTDelta LakeGitCI/CDAzure DatabricksADLS Gen2Azure Data FactoryAmazon S3AWS GlueAWS EMRBigQueryCloud StorageSpark Structured StreamingAirflowMedallion Architecture

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn