Data Specialist - R01569712

Brillio
Bengaluru
Workplace: HybridFull timeFunction: Software EngineeringExperience: 5-6 yearsEducation: bachelorsSkills: ["Collaboration","Problem-solving","Technical documentation","Performance tuning","Stakeholder management"]

Build and run robust ETL pipelines with Databricks and PySpark to process large-scale datasets. Develop and optimize SQL queries, stored procedures, and scalable data models for analytics and reporting. Collaborate with data architects and business stakeholders to translate requirements into high-performance data solutions, integrate diverse sources into modern data platforms, and maintain data quality, performance, and reliability while troubleshooting ingestion and transformation issues.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Brillio
Brillio
4 days ago

Data Specialist - R01569712

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Build and run robust ETL pipelines with Databricks and PySpark to process large-scale datasets. Develop and optimize SQL queries, stored procedures, and scalable data models for analytics and reporting. Collaborate with data architects and business stakeholders to translate requirements into high-performance data solutions, integrate diverse sources into modern data platforms, and maintain data quality, performance, and reliability while troubleshooting ingestion and transformation issues.
Location: Bengaluru
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and implement robust ETL pipelines using Databricks and PySpark to process large-scale datasets.
  • •Develop, optimize, and maintain complex SQL queries, stored procedures, and scalable data models for analytics and reporting.
  • •Collaborate with data architects and business stakeholders to translate requirements into high-performance data solutions.
  • •Integrate data from diverse sources into data warehouses and modern data platforms while ensuring data quality and consistency.
  • •Troubleshoot and resolve issues in data ingestion, transformation, and storage within Databricks; monitor and tune job performance for throughput and reliability.

Key Requirements

  • •5-6 years of data engineering experience with hands-on expertise in Databricks and PySpark.
  • •Advanced proficiency in Databricks and strong expertise in PySpark for distributed data processing and transformation.
  • •Strong SQL skills, including designing and maintaining stored procedures for analytics and data manipulation.
  • •Experience with data warehousing architectures and designing scalable data models.
  • •Hands-on experience with Apache Spark and troubleshooting data ingestion, transformation, and storage issues in Databricks.
Experience:5-6 yearsData warehousingData engineeringCloud data platforms
Education:Bachelor's in Computer Science or Information Technology
Skills:CollaborationProblem-solvingTechnical documentationPerformance tuningStakeholder management
Certifications:Databricks CertificationApache Spark CertificationSQL CertificationData warehousing certifications
Tech Stack:DatabricksPySparkSQLStored proceduresApache SparkData warehousesAzure DatabricksAWS GlueCI/CDApache Kafka

Company Brief

Brillio
Provides digital transformation and IT consulting services, including cloud migration, analytics, digital engineering, and managed services to accelerate business outcomes for enterprises across industries.
Industry: Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Santa Clara, United States
Founded: 2014
WebsiteLinkedIn