Brillio

3 months ago

Lead Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Lead the design, development, and optimization of scalable data pipelines and platforms for Brillio. You will work with Spark/PySpark on Databricks in a cloud-based big data environment, building data lakes/warehouses, implementing ETL/ELT flows, and enabling API-driven data ingestion within a hybrid/remote India team.

Location: Bengaluru

Workplace: Hybrid

Employment Type: Full time

Job Function: Administration & Executive Assistance

Seniority: Manager level

Key Responsibilities

•Design and build scalable data pipelines using Spark/PySpark on Databricks
•Develop and optimize ETL/ELT workflows for large-scale data processing
•Work with AWS EMR, S3, and Hadoop ecosystem for distributed data processing
•Build and maintain data lake and data warehouse solutions
•Develop and integrate APIs for data ingestion and consumption

Key Requirements

•5+ years of data engineering experience with strong Databricks and big data expertise
•Hands-on experience with Spark, PySpark, AWS ecosystem (S3, EMR, Lambda, etc.), and modern data architectures
•Proficiency in designing and maintaining data lakes and data warehouses; API integration for data ingestion/consumption
•Experience with ETL/ELT workflows and data quality governance
•Familiarity with Airflow or Autosys for workflow orchestration and performance tuning

Experience:5+ yearsBig dataDatabricksSparkPySparkAWS

Education:Bachelor's

Skills:PythonSQLUNIXETLAirflowAutosysGitAPI developmentDatabricksSparkPySparkHadoopS3

Languages:English

Tech Stack:PythonSparkPySparkDatabricksAWSEMRS3HadoopSQLAirflowAutosysGitUNIXAPI development

Company Brief

Brillio

Provides digital transformation and IT consulting services, including cloud migration, analytics, digital engineering, and managed services to accelerate business outcomes for enterprises across industries.

Industry: Consulting

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Funding: Private Equity Backed

Headquarters: Santa Clara, United States

Founded: 2014

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Brillio

3 months ago

Lead Data Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Location: Bengaluru

Workplace: Hybrid

Employment Type: Full time

Job Function: Administration & Executive Assistance

Seniority: Manager level

Key Responsibilities

•Design and build scalable data pipelines using Spark/PySpark on Databricks
•Develop and optimize ETL/ELT workflows for large-scale data processing
•Work with AWS EMR, S3, and Hadoop ecosystem for distributed data processing
•Build and maintain data lake and data warehouse solutions
•Develop and integrate APIs for data ingestion and consumption

Key Requirements

•5+ years of data engineering experience with strong Databricks and big data expertise
•Hands-on experience with Spark, PySpark, AWS ecosystem (S3, EMR, Lambda, etc.), and modern data architectures
•Proficiency in designing and maintaining data lakes and data warehouses; API integration for data ingestion/consumption
•Experience with ETL/ELT workflows and data quality governance
•Familiarity with Airflow or Autosys for workflow orchestration and performance tuning

Experience:5+ yearsBig dataDatabricksSparkPySparkAWS

Education:Bachelor's

Skills:PythonSQLUNIXETLAirflowAutosysGitAPI developmentDatabricksSparkPySparkHadoopS3

Languages:English

Tech Stack:PythonSparkPySparkDatabricksAWSEMRS3HadoopSQLAirflowAutosysGitUNIXAPI development

Company Brief

Brillio

Industry: Consulting

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Funding: Private Equity Backed

Headquarters: Santa Clara, United States

Founded: 2014

Website LinkedIn