Senior Data Engineer - Databricks

Ultra Tendency
Kuala Lumpur
Workplace: HybridFull timeFunction: Solutions Engineering & Sales EngineeringSkills: ["Communication","Collaboration","Knowledge sharing"]

Design and build scalable data platforms on the Databricks Lakehouse Platform, implementing reliable batch and streaming pipelines for analytics, machine learning, and BI. Optimize performance and cost, and apply best practices for data quality, governance, and security. Collaborate with data engineers, scientists, and architects to translate requirements into production-ready solutions, while supporting junior engineers and knowledge sharing in a hybrid Kuala Lumpur team.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Ultra Tendency
Ultra Tendency
1 day ago

Senior Data Engineer - Databricks

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Design and build scalable data platforms on the Databricks Lakehouse Platform, implementing reliable batch and streaming pipelines for analytics, machine learning, and BI. Optimize performance and cost, and apply best practices for data quality, governance, and security. Collaborate with data engineers, scientists, and architects to translate requirements into production-ready solutions, while supporting junior engineers and knowledge sharing in a hybrid Kuala Lumpur team.
Location: Kuala Lumpur
Workplace: Hybrid
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Mid level

Key Responsibilities

  • •Design, implement, and maintain scalable data pipelines using Databricks Lakehouse Platform.
  • •Develop and optimize batch and streaming data workflows for analytics, machine learning, and BI.
  • •Translate business and data requirements into reliable, production-ready data solutions through cross-functional collaboration.
  • •Improve performance and cost efficiency of data processing workloads within the Databricks environment.
  • •Support data quality, governance, and security best practices and contribute to knowledge sharing for junior engineers.

Pay and Benefits

Perks:Remote WorkLearning Budget

Key Requirements

  • •Strong experience with Databricks and Apache Spark (PySpark, SQL, or Scala).
  • •Experience building data platforms on major cloud providers (AWS, Azure, or GCP).
  • •Solid understanding of distributed data processing, data modelling, and performance optimisation.
  • •Experience with CI/CD pipelines and version control tools such as Git.
  • •Familiarity with orchestration frameworks such as Airflow or Databricks Workflows.
Experience:Data engineeringBig DataCloudStreamingMachine learningData platforms
Skills:CommunicationCollaborationKnowledge sharing
Languages:English
Tech Stack:DatabricksDatabricks Lakehouse PlatformApache SparkPySparkSQLScalaDelta LakeBatch processingStreaming dataAWSAzureGCPCI/CDGitAirflowDatabricks WorkflowsData qualityData governanceData securityApache Kafka

Company Brief

Ultra Tendency
Provides creative digital services including branding, web design, social media content, and marketing strategies for brands, creators, and lifestyle businesses.
Industry: Professional Services
Website