Onshore - Sr Engg_CurationSup

Fractal Labs
California
Workplace: RemoteFull timeUSD 150,000 - 170,000 annuallyFunction: Software EngineeringSkills: ["Troubleshooting","Debugging","Incident handling","Automation","Collaboration"]

Build and maintain scalable data pipelines and platforms using Azure Databricks, Python, and SQL. Optimize batch and real-time ETL/ELT with Spark and Delta Lake, while designing data quality frameworks (validation, profiling, anomaly detection) and governance practices. Own production monitoring, incident handling, and SLA adherence. Implement CI/CD using Azure DevOps and Git and automate deployments with ARM templates/Terraform, integrating data quality checks into release workflows.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Fractal Labs
Fractal Labs
1 month ago

Onshore - Sr Engg_CurationSup

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Status: Live

Job Summary

Build and maintain scalable data pipelines and platforms using Azure Databricks, Python, and SQL. Optimize batch and real-time ETL/ELT with Spark and Delta Lake, while designing data quality frameworks (validation, profiling, anomaly detection) and governance practices. Own production monitoring, incident handling, and SLA adherence. Implement CI/CD using Azure DevOps and Git and automate deployments with ARM templates/Terraform, integrating data quality checks into release workflows.
Location: California
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design, develop, and maintain robust data pipelines using Azure Databricks, Python, and SQL.
  • •Build and optimize ETL/ELT processes for batch and real-time data using Spark and distributed processing.
  • •Implement data quality frameworks and KPIs, including automated validation checks and root-cause analysis for data issues.
  • •Work on Azure platform capabilities (ADF, ADLS Gen2, Synapse Analytics, Azure Databricks) and optimize Delta Lake architectures.
  • •Monitor pipelines for failures and performance issues, ensuring production stability and managing incidents with monitoring/logging and CI/CD automation.

Pay and Benefits

Salary: USD 150,000 - 170,000 annually
Perks:Health InsuranceDentalVisionLife InsuranceDisability Insurance401kPaid HolidaysParental Leave

Key Requirements

  • •Strong experience in Python and SQL for data engineering work.
  • •Hands-on experience with Azure Databricks (Spark, Delta Lake) and building ETL/ELT pipelines.
  • •Experience with Azure data services including Azure Data Factory, ADLS Gen2, and Synapse Analytics.
  • •Proven ability to implement data quality frameworks (validation rules, profiling, anomaly detection) and data quality KPIs.
  • •Experience with DevOps tooling such as Azure DevOps, Git, and CI/CD pipelines for production support and automation.
Skills:TroubleshootingDebuggingIncident handlingAutomationCollaboration
Tech Stack:Azure DatabricksPythonSQLAzure Data FactoryADLS Gen2Synapse AnalyticsSparkDelta LakeData lakeLakehouseAzure DevOpsGitCI/CDARM templatesTerraformAzure MonitorLog AnalyticsGreat ExpectationsDeequETL

Company Brief

Fractal Labs
Provides AI-driven analytics, decision intelligence, and engineering solutions to Fortune 500 companies, helping enterprises apply advanced analytics and machine learning for marketing, supply chain, finance, and customer experience transformation.
Industry: Consulting
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: New York, United States
Founded: 2000
WebsiteLinkedIn