Databricks -Technical Specialist-Data Engg

Birlasoft
Noida
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningSkills: []

Design and implement GenAI and agentic AI solutions on the Databricks platform, building LLM-powered use cases with RAG and robust prompt engineering. Own end-to-end data engineering for scalable pipelines using PySpark, SQL, Delta Lake, Unity Catalog, and medallion architecture, while optimizing Spark performance, cost, and scalability. Ensure data quality and observability, prepare feature-ready datasets, and develop fine-tuned models with MLflow and Mosaic AI guardrails.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Birlasoft
Birlasoft
1 day ago

Databricks -Technical Specialist-Data Engg

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Design and implement GenAI and agentic AI solutions on the Databricks platform, building LLM-powered use cases with RAG and robust prompt engineering. Own end-to-end data engineering for scalable pipelines using PySpark, SQL, Delta Lake, Unity Catalog, and medallion architecture, while optimizing Spark performance, cost, and scalability. Ensure data quality and observability, prepare feature-ready datasets, and develop fine-tuned models with MLflow and Mosaic AI guardrails.
Location: Noida
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Design and implement GenAI and agentic AI solutions using Databricks Genie, Agent Bricks, and Mosaic AI.
  • •Build LLM-powered use cases, including prompt engineering, RAG, and enterprise guardrails.
  • •Design and build scalable data pipelines using Databricks, PySpark, and SQL.
  • •Implement Delta Lake, Unity Catalog, and medallion architecture; optimize Spark jobs for performance, cost, and scalability.
  • •Ensure data quality, reliability, and observability, and prepare feature-ready datasets for AI/ML workloads.

Key Requirements

  • •Design and implement GenAI and agentic AI solutions using Databricks Genie, Databricks Agent Bricks, and Mosaic AI, including model training, evaluation, and prompt engineering.
  • •Build LLM-powered use cases and integrate GenAI solutions with enterprise data and business workflows.
  • •Design and build scalable data pipelines using Databricks, PySpark, and SQL.
  • •Implement Delta Lake, Unity Catalog, and medallion architecture, including Spark job optimization for performance and scalability.
  • •Prepare high-quality, feature-ready datasets and develop/fine-tune LLMs and ML models using Databricks MLflow and Mosaic AI with guardrails for enterprise use cases.
Experience:GenAIAgentic AILLMsRAG
Tech Stack:DatabricksDatabricks GenieDatabricks Agent BricksMosaic AIPySparkSQLDelta LakeUnity CatalogMedallion architectureApache SparkDatabricks MLflowRAG

Company Brief

Birlasoft
Birlasoft is a global IT services and digital solutions provider delivering consulting, enterprise applications, cloud, and infrastructure services to enterprises across industries, helping accelerate digital transformation and business modernization.
Industry: Professional Services
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Noida, India
WebsiteLinkedIn