Azure Subcontractor

Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks. Build ETL/ELT workflows with Apache Spark (PySpark), SQL, and Delta Lake, including batch and streaming pipeline development. Integrate data across databases, APIs, and cloud storage, and implement data transformation, validation, partitioning, and Z-Ordering. Create reusable notebooks and jobs, monitor performance, and collaborate with analysts and architects on data requirements.