Lead Data Engineer

Brillio
Bengaluru
Workplace: HybridFull timeFunction: Administration & Executive AssistanceExperience: 5+ yearsSkills: ["Communication","Problem-solving","Teamwork"]

Senior Data Engineer leading cloud modernization on GCP and BigQuery, building scalable data pipelines, enabling real-time processing, and migrating legacy on-prem environments to a cloud-native data ecosystem. You’ll drive data integration, ETL modernization, and performance tuning across enterprise-scale data platforms in a hybrid, collaborative setting.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Brillio
Brillio
1 year ago

Lead Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 21 hours agoStatus: Live

Job Summary

Senior Data Engineer leading cloud modernization on GCP and BigQuery, building scalable data pipelines, enabling real-time processing, and migrating legacy on-prem environments to a cloud-native data ecosystem. You’ll drive data integration, ETL modernization, and performance tuning across enterprise-scale data platforms in a hybrid, collaborative setting.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Administration & Executive Assistance

Key Responsibilities

  • •Lead data migration and cloud modernization initiatives, migrating large-scale datasets to Google BigQuery and ensuring data quality, integrity, and performance.
  • •Build real-time streaming pipelines for IoT/telemetry data and integrate data from APIs, relational databases, and IoT devices.
  • •Modernize SSIS packages into cloud-native ETL pipelines and develop scalable workflows using Airflow, Python, Spark, and GCP-native tools.
  • •Write and optimize complex SQL queries, stored procedures, and scheduled jobs within BigQuery; develop modular, reusable transformation scripts in Python, Java, Spark, and SQL.
  • •Monitor and optimize query performance and cost efficiency in the cloud data environment.

Key Requirements

  • •5+ years in Data Engineering with focus on cloud and big data technologies
  • •Minimum 2+ years hands-on experience with GCP, specifically BigQuery
  • •Proven experience migrating on-premise data systems to the cloud
  • •Strong development experience with Apache Airflow, Python, and Apache Spark
  • •Expertise in streaming data ingestion, particularly IoT or sensor data
Experience:5+ yearsCloudBig dataIoTData engineering
Skills:CommunicationProblem-solvingTeamwork
Certifications:GCP Professional Data Engineer
Tech Stack:GCPBigQueryPythonAirflowSQLDBTSparkJavaKafkaTerraform

Company Brief

Brillio
Provides digital transformation and IT consulting services, including cloud migration, analytics, digital engineering, and managed services to accelerate business outcomes for enterprises across industries.
Industry: Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Santa Clara, United States
Founded: 2014
WebsiteLinkedIn