Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows, batch and streaming processing with Apache Spark (PySpark), and create reusable notebooks, jobs, and workflows. Implement data transformation, cleansing, validation, and Delta Lake tables with partitioning and Z-Ordering. Integrate data from databases, APIs, and cloud storage, monitor pipeline performance, and collaborate with analysts, architects, and stakeholders.