Data Engineer (SQL, PySpark, Snowflake, DBT, Redshift) - AVP/VP

KKR
Gurugram
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 8+ yearsSkills: ["Communication","Cross-functional collaboration","Agility","Ownership mindset","Mentoring"]

Design, build, and run production-grade data pipelines on AWS to power analytics for Insurance Systems. Own the full lifecycle from ingestion and orchestration through lakehouse storage, transformation, governance, and cost-efficient operations. Work with data scientists, analysts, and platform teams to deliver reliable, well-governed data products using an AWS + lakehouse stack (Apache Iceberg, Glue, Spark, Snowflake) and strong observability and data quality.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
KKR
KKR
2 days ago

Data Engineer (SQL, PySpark, Snowflake, DBT, Redshift) - AVP/VP

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Design, build, and run production-grade data pipelines on AWS to power analytics for Insurance Systems. Own the full lifecycle from ingestion and orchestration through lakehouse storage, transformation, governance, and cost-efficient operations. Work with data scientists, analysts, and platform teams to deliver reliable, well-governed data products using an AWS + lakehouse stack (Apache Iceberg, Glue, Spark, Snowflake) and strong observability and data quality.
Location: Gurugram
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Director level

Key Responsibilities

  • •Design, build, and maintain scalable, fault-tolerant data pipelines and ETL/ELT for diverse data types.
  • •Own end-to-end pipeline orchestration including scheduling, dependencies, retries, SLAs, and observability.
  • •Build and manage lakehouse data assets on Apache Iceberg, including partitioning, schema evolution, time-travel, and maintenance.
  • •Develop and operate large-scale processing jobs using Apache Spark and AWS Glue, modeling and optimizing data in Snowflake.
  • •Architect AWS-based data solutions and ensure data quality, integrity, lineage, security, and cost-efficient operations.

Key Requirements

  • •8+ years of hands-on data engineering experience building production data pipelines.
  • •Strong proficiency in Python for data engineering and automation, with advanced SQL and relational database experience (e.g., PostgreSQL, MySQL).
  • •Production experience with orchestration in a workflow orchestration tool (e.g., Apache Airflow or Dagster).
  • •Hands-on experience with Apache Spark for large-scale distributed processing and Apache Iceberg for lakehouse storage.
  • •Experience building on AWS and operating ETL/ELT with AWS Glue and a data warehouse such as Snowflake.
Experience:8+ years
Skills:CommunicationCross-functional collaborationAgilityOwnership mindsetMentoring
Languages:English
Tech Stack:AWSS3AWS GlueEMRLambdaAthenaKinesisRedshiftIAMApache SparkApache IcebergSnowflakeAWS Glue Data CatalogSnowflake HorizonApache AirflowDagsterDbtDockerKubernetesAmazon EKS

Company Brief

KKR
Global investment firm providing alternative asset management and capital markets services across private equity, credit, real assets, and hedge funds, serving institutional and private clients worldwide.
Industry: Asset Management
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: New York, United States
Founded: 1976
WebsiteLinkedIn