Senior Data Engineer

Aon
Bengaluru
Workplace: HybridFull timeFunction: Solutions Engineering & Sales EngineeringExperience: 7+ yearsEducation: bachelorsSkills: ["Communication","Stakeholder collaboration","Analytical problem-solving","Independent work","Collaboration"]

Build and modernize Azure-based data architecture on Databricks for Aon’s Altair modernization program. Design and maintain scalable PySpark ETL/ELT pipelines, data models, and quality/governance with Unity Catalog to support reinsurance analytics and property & casualty loss ratio calculations. Partner with solution architects, product owners, and QA to deliver reliable data assets, optimize pipeline performance and CI/CD, and collaborate with AI specialists to integrate Azure OpenAI/LLMs for intelligent workflow automation.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Aon
Aon
18 hours ago

Senior Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live
Reposted: similar role first listed 1 week ago

Job Summary

Build and modernize Azure-based data architecture on Databricks for Aon’s Altair modernization program. Design and maintain scalable PySpark ETL/ELT pipelines, data models, and quality/governance with Unity Catalog to support reinsurance analytics and property & casualty loss ratio calculations. Partner with solution architects, product owners, and QA to deliver reliable data assets, optimize pipeline performance and CI/CD, and collaborate with AI specialists to integrate Azure OpenAI/LLMs for intelligent workflow automation.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Mid level

Key Responsibilities

  • •Develop and maintain scalable data ingestion, transformation, and integration pipelines on Databricks using PySpark.
  • •Build robust ETL/ELT workflows for structured and unstructured data from upstream systems and implement agreed ingestion patterns and Unity Catalog.
  • •Create data models, schemas, and data quality/governance frameworks, including lineage, security, and compliance for reinsurance analytics.
  • •Collaborate with business stakeholders and SMEs to translate reinsurance business requirements into technical data solutions and resolve moderately complex data challenges.
  • •Optimize pipeline performance, reliability, scalability, and cost on Azure; troubleshoot production issues and implement CI/CD automation for data engineering workflows.

Key Requirements

  • •Any graduate or post-graduate (full time) education
  • •Minimum 7+ years of relevant experience in data engineering, software engineering, or big data development
  • •Proven experience developing ETL/ELT pipelines and working with large-scale datasets
  • •Hands-on experience with Databricks for building data pipelines and transformations
  • •Strong technical skills in PySpark and Python, plus SQL proficiency for data manipulation and analysis
Experience:7+ yearsBig dataData engineeringReinsurance
Education:Bachelor's in Engineering, Computer Science, Data Engineering, Information Systems, or related field
Skills:CommunicationStakeholder collaborationAnalytical problem-solvingIndependent workCollaboration
Certifications:Azure Data Engineer Associate
Languages:English
Tech Stack:AzureDatabricksPySparkPythonSQLAzure Data FactoryAzure Data Lake StorageUnity CatalogAzure OpenAILLMsCI/CDMicroservicesAPI integrationAirflowGenie Spaces/AgentsWorkflow StudioAB Connect

Company Brief

Aon
Global professional services firm providing risk, retirement, human resources, and insurance brokerage solutions to clients worldwide, including consulting, reinsurance, and data-driven risk management services.
Industry: Insurance
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: London, United Kingdom
Founded: 1982
Glassdoor
Glassdoor: 3.9
WebsiteLinkedInGlassdoor