Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

Birlasoft
Hyderabad
Workplace: OnsiteFull timeFunction: DevOps, Cloud & InfrastructureSkills: ["Problem solving","Team collaboration","Documentation","Technical design","Agile/scrum"]

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows with Apache Spark (PySpark), including batch and streaming processing, integrating data from databases, APIs, and cloud storage. Develop Delta Lake tables with partitioning and Z-Ordering, create reusable notebooks and jobs, and monitor performance and failures. Collaborate with business analysts, architects, and stakeholders, following coding standards and CI/CD best practices.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
2 months ago

Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows with Apache Spark (PySpark), including batch and streaming processing, integrating data from databases, APIs, and cloud storage. Develop Delta Lake tables with partitioning and Z-Ordering, create reusable notebooks and jobs, and monitor performance and failures. Collaborate with business analysts, architects, and stakeholders, following coding standards and CI/CD best practices.
Location: Hyderabad
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure

Key Responsibilities

  • •Design, develop, and maintain ETL/ELT pipelines using Databricks.
  • •Develop scalable data processing frameworks with Apache Spark (PySpark), including batch and streaming pipelines.
  • •Integrate and transform data from multiple sources such as databases, APIs, cloud storage, and enterprise applications.
  • •Build Delta Lake tables and optimize data storage using partitioning and Z-Ordering.
  • •Create reusable notebooks, workflows, and jobs; monitor, troubleshoot, and optimize pipeline performance.

Key Requirements

  • •Strong experience with Databricks.
  • •Expertise in Apache Spark / PySpark and strong SQL skills.
  • •Proficiency in Python and experience developing ETL/ELT pipelines.
  • •Experience with Delta Lake and data warehousing concepts.
  • •Experience with Git/version control and following CI/CD best practices.
Skills:Problem solvingTeam collaborationDocumentationTechnical designAgile/scrum
Certifications:Databricks certificationCloud platform certification
Tech Stack:DatabricksApache SparkPySparkPythonSQLETL/ELTDelta LakeDelta tablesZ-OrderingGitCI/CDAzure DatabricksADLS Gen2Azure Data FactoryAmazon Web Services (AWS)S3GlueEMRGoogle CloudBigQuery

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn