Avanade

2 days ago

Databricks Machine Learning Lead

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Design, develop, and deliver scalable, secure, high-performance data solutions on the Databricks Lakehouse Platform. Provide senior technical leadership to implement robust data architectures using Delta Lake, Unity Catalog, Databricks Workflows, and ML models. Hands-on coding in PySpark/Scala and SQL to build production-grade batch and streaming ETL/ELT pipelines. Lead performance tuning for large Spark jobs and establish engineering standards, testing frameworks, and DataOps/CI/CD pipelines.

Location: Kuala Lumpur

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Key Responsibilities

•Define and implement robust data architectures using the Databricks ecosystem, including Delta Lake, Unity Catalog, machine learning models, and Databricks Workflows.
•Serve as the most senior developer, writing production-grade code in PySpark/Scala and SQL for complex batch and streaming ETL/ELT pipelines.
•Lead performance tuning and optimization for large-scale Spark jobs to improve cluster utilization and manage costs.
•Define and enforce technical standards for code quality and testing frameworks, including unit and integration testing.
•Establish and drive DataOps/CI/CD pipelines for the engineering team to ensure delivery of high-quality data products.

Key Requirements

•8+ years of experience in machine learning, data science, or MLOps, including 4+ years focused on the Databricks Lakehouse Platform.
•Expert proficiency in Python and PySpark/Scala for large-scale data processing and machine learning.
•Deep practical experience with Delta Lake architecture and optimization techniques.
•Proven expertise implementing MLOps using MLflow (Tracking, Registry, Projects, and Deployment).
•Ability to lead design and enforce coding standards, testing practices, and DataOps/CI/CD pipelines for an engineering team.

Experience:8+ years

Skills:Technical leadershipPerformance optimizationEngineering standardsData architecture designQuality-focused delivery

Tech Stack:Databricks Lakehouse PlatformDelta LakeUnity CatalogDatabricks WorkflowsPySparkScalaPythonSQLSparkETLELTMLflowDataOpsCI/CD

Company Brief

Avanade

Global digital innovation and IT services company delivering Microsoft-based cloud, digital and application services. Partners with enterprises to design, build and run business solutions across cloud, data, AI, modern workplace and industry-specific transformations.

Industry: Consulting

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Headquarters: Seattle, United States

Founded: 2000

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Avanade

2 days ago

Databricks Machine Learning Lead

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Location: Kuala Lumpur

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Key Responsibilities

•Define and implement robust data architectures using the Databricks ecosystem, including Delta Lake, Unity Catalog, machine learning models, and Databricks Workflows.
•Serve as the most senior developer, writing production-grade code in PySpark/Scala and SQL for complex batch and streaming ETL/ELT pipelines.
•Lead performance tuning and optimization for large-scale Spark jobs to improve cluster utilization and manage costs.
•Define and enforce technical standards for code quality and testing frameworks, including unit and integration testing.
•Establish and drive DataOps/CI/CD pipelines for the engineering team to ensure delivery of high-quality data products.

Key Requirements

•8+ years of experience in machine learning, data science, or MLOps, including 4+ years focused on the Databricks Lakehouse Platform.
•Expert proficiency in Python and PySpark/Scala for large-scale data processing and machine learning.
•Deep practical experience with Delta Lake architecture and optimization techniques.
•Proven expertise implementing MLOps using MLflow (Tracking, Registry, Projects, and Deployment).
•Ability to lead design and enforce coding standards, testing practices, and DataOps/CI/CD pipelines for an engineering team.

Experience:8+ years

Skills:Technical leadershipPerformance optimizationEngineering standardsData architecture designQuality-focused delivery

Tech Stack:Databricks Lakehouse PlatformDelta LakeUnity CatalogDatabricks WorkflowsPySparkScalaPythonSQLSparkETLELTMLflowDataOpsCI/CD

Company Brief

Avanade

Industry: Consulting

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Headquarters: Seattle, United States

Founded: 2000

Glassdoor: 3.9

Website LinkedIn