Azure Subcontractor (INDIA - HYDERABAD - BIRLASOFT OFFICE, IN)

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows with Apache Spark (PySpark), including batch and streaming processing, integrating data from databases, APIs, and cloud storage. Develop Delta Lake tables with partitioning and Z-Ordering, create reusable notebooks and jobs, and monitor performance and failures. Collaborate with business analysts, architects, and stakeholders, following coding standards and CI/CD best practices.