Azure Data Engineer

Aon
Krakow
Workplace: HybridFull timeFunction: DevOps, Cloud & InfrastructureSkills: ["Work independently","Self-motivated","Organized","Communicate with stakeholders","Manage time","Work under deadlines","Troubleshooting","Performance optimization"]

Design and deliver scalable Azure Databricks data pipelines and governed lakehouse solutions. Build ETL/ELT workflows with PySpark, SQL, Notebooks, and Jobs/Workflows, implementing Delta Lake bronze/silver/gold patterns and Unity Catalog for centralized governance, RBAC, auditing, and standards. Optimize datasets and Power BI connectivity (Direct Lake/Direct Query), manage Databricks clusters and scheduling, monitor pipelines, and improve CI/CD with Git and Azure DevOps/GitHub while collaborating with BI teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Aon
Aon
1 day ago

Azure Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live

Job Summary

Design and deliver scalable Azure Databricks data pipelines and governed lakehouse solutions. Build ETL/ELT workflows with PySpark, SQL, Notebooks, and Jobs/Workflows, implementing Delta Lake bronze/silver/gold patterns and Unity Catalog for centralized governance, RBAC, auditing, and standards. Optimize datasets and Power BI connectivity (Direct Lake/Direct Query), manage Databricks clusters and scheduling, monitor pipelines, and improve CI/CD with Git and Azure DevOps/GitHub while collaborating with BI teams.
Location: Krakow
Workplace: Hybrid
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure

Key Responsibilities

  • •Facilitate workshops to discuss, review, and document business reporting requirements.
  • •Develop and implement scalable data integration pipelines on Azure Databricks using PySpark, SQL, Notebooks, Jobs, and Workflows.
  • •Build and maintain lakehouse architectures using Delta Lake and bronze/silver/gold layers to support analytics and reporting.
  • •Implement Unity Catalog governance including RBAC, data access controls, auditing, and standardized naming conventions.
  • •Optimize Power BI/Databricks query performance (Direct Lake/Direct Query), configure clusters/schedules, and implement monitoring and CI/CD for pipelines.

Key Requirements

  • •Strong experience building scalable ETL/ELT pipelines on Azure Databricks using PySpark, SQL, Notebooks, Jobs, and Workflows.
  • •Expertise in lakehouse architectures, Delta Lake, and bronze/silver/gold data-layer patterns, with reusable transformation frameworks.
  • •Experience implementing Unity Catalog, role-based access control, data access controls, auditing, and consistent catalog/schema/table standards.
  • •Ability to create performance-optimized datasets for Power BI and collaborate on semantic models, data contracts, refresh strategies, including Direct Lake/Direct Query where applicable.
  • •Experience optimizing Databricks clusters and job scheduling, implementing monitoring/alerting, and contributing to CI/CD practices using Git and Azure DevOps or GitHub.
Experience:FinanceInsuranceETLELTLakehouseData governancePower BIAzure Databricks
Skills:Work independentlySelf-motivatedOrganizedCommunicate with stakeholdersManage timeWork under deadlinesTroubleshootingPerformance optimization
Languages:English
Tech Stack:AzureAzure DatabricksPySparkSQLDelta LakeUnity CatalogPower BINotebooksJobsWorkflowsBronze layerSilver layerGold layerDirect LakeDirect QueryDatabricks clustersCluster policiesMonitoringLoggingAlerting

Company Brief

Aon
Global professional services firm providing risk, retirement, human resources, and insurance brokerage solutions to clients worldwide, including consulting, reinsurance, and data-driven risk management services.
Industry: Insurance
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: London, United Kingdom
Founded: 1982
Glassdoor
Glassdoor: 3.9
WebsiteLinkedInGlassdoor