Lead Data Engineer - R01569363

Brillio
Bengaluru
Workplace: HybridFull timeFunction: Administration & Executive AssistanceExperience: 4-6 yearsEducation: bachelorsSkills: ["Collaboration","Documentation","Troubleshooting"]

Design and implement scalable Azure data pipelines and ETL workloads using tools like Azure Data Factory, Synapse Analytics, Spark, and lakehouse/warehouse modeling. Build and optimize real-time and batch data feeds by integrating sources such as Azure Data Explorer (Kusto), Delta Lake formats, and SQL systems. Maintain Azure data architectures, monitor performance and data quality, and develop Power BI reports using DAX and data modeling while documenting data architecture and processes.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Brillio
Brillio
2 weeks ago

Lead Data Engineer - R01569363

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Design and implement scalable Azure data pipelines and ETL workloads using tools like Azure Data Factory, Synapse Analytics, Spark, and lakehouse/warehouse modeling. Build and optimize real-time and batch data feeds by integrating sources such as Azure Data Explorer (Kusto), Delta Lake formats, and SQL systems. Maintain Azure data architectures, monitor performance and data quality, and develop Power BI reports using DAX and data modeling while documenting data architecture and processes.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Design and implement scalable ETL processes on Azure Data Factory, Synapse Analytics, and Spark to deliver robust real-time and batch data feeds.
  • •Develop and optimize data pipelines and models for large-scale lakehouse and warehouse analytics with performance and reliability targets.
  • •Integrate and manage data sources from Azure Data Explorer (Kusto) and Delta Lake formats to enable advanced analytics and reporting.
  • •Configure and maintain cloud-hosted data architectures using Azure services, ensuring secure, efficient, and resilient operations.
  • •Monitor, troubleshoot, and improve SQL performance and develop Power BI reports (data modeling and DAX) while documenting data architecture and processes.

Key Requirements

  • •4 to 6 years of hands-on data engineering experience with substantial Azure analytics and pipeline development.
  • •Hands-on expertise in Azure Synapse Analytics and Azure Data Factory to build scalable ETL and data feeds.
  • •Strong data engineering skills with Azure Data Explorer (Kusto), PySpark, and Delta Lake.
  • •Experience with SQL performance tuning and maintaining data quality across systems.
  • •Experience building Power BI reports with data modeling and DAX.
Experience:4-6 years
Education:Bachelor's in Computer Science, Information Technology, Data Engineering, or a closely related discipline
Skills:CollaborationDocumentationTroubleshooting
Certifications:Microsoft Certified: Azure Data Engineer AssociateMicrosoft Certified: Azure Solutions Architect Expert
Tech Stack:Azure Synapse AnalyticsAzure Data FactoryAzure Data Explorer (Kusto)PySparkDelta LakeAzure Data LakeAzure Data ExplorerSparkAzure FunctionsCosmos DBPower BIDAXAzure DevOpsAKSEvent HubAzure SentinelSQLETLLakehouseWarehouse

Company Brief

Brillio
Provides digital transformation and IT consulting services, including cloud migration, analytics, digital engineering, and managed services to accelerate business outcomes for enterprises across industries.
Industry: Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Santa Clara, United States
Founded: 2014
WebsiteLinkedIn