Principal Engineer, AI/ML Systems (Context Services)

Cognite
Bengaluru
Full timeFunction: Data Science & Machine LearningExperience: 10+ yearsEducation: mastersSkills: ["Ownership","Technical rigor","Systems thinking","Architectural trade-offs","Mentorship"]

Own the technical architecture for Context Services, turning unstructured industrial data into structured, actionable intelligence. Define end-to-end system architecture for low-latency, fault-tolerant APIs/services used by thousands of concurrent users. Lead AI/LLM orchestration design (model serving, vector databases, agentic workflows, state management) and partner closely with the central Platform team to integrate and extend core infrastructure while setting engineering standards and mentoring engineers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cognite
Cognite
3 months ago

Principal Engineer, AI/ML Systems (Context Services)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 42 minutes agoStatus: Live

Job Summary

Own the technical architecture for Context Services, turning unstructured industrial data into structured, actionable intelligence. Define end-to-end system architecture for low-latency, fault-tolerant APIs/services used by thousands of concurrent users. Lead AI/LLM orchestration design (model serving, vector databases, agentic workflows, state management) and partner closely with the central Platform team to integrate and extend core infrastructure while setting engineering standards and mentoring engineers.
Location: Bengaluru
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Define end-to-end system architecture for Context Services, including low-latency APIs/services with sub-second response times for thousands of concurrent users.
  • •Bridge AI Engineers and Platform Engineering by translating ambiguous industrial data problems into scalable technical strategy and sequenced execution.
  • •Architect AI/LLM orchestration frameworks for model serving, vector databases, and agentic workflows with reliable state management and prompt tracking.
  • •Serve as the primary technical liaison to the central Platform team, defining how Context Services leverages and extends core infrastructure.
  • •Set engineering standards and review practices; mentor Senior and mid-level engineers and unblock the hardest cross-cutting technical problems while driving innovation via research, prototyping, and open-source contributions where relevant.

Key Requirements

  • •10+ years of industry experience in machine learning and software development.
  • •Strong programming skills in Python, C++, or Java, building high-concurrency, asynchronous applications and REST/gRPC APIs at scale.
  • •Expertise in ML frameworks including PyTorch, TensorFlow, Keras, or Scikit-learn.
  • •Solid containerization and deployment knowledge (Docker, Kubernetes, and cloud platforms), with experience architecting for fault tolerance and reliability.
  • •Proficiency with MLOps best practices and cloud platforms such as AWS, Azure, or GCP.
Experience:10+ yearsMachine learningSoftware development
Education:Master's
Skills:OwnershipTechnical rigorSystems thinkingArchitectural trade-offsMentorship
Languages:English
Tech Stack:PythonC++JavaRESTGRPCPyTorchTensorFlowKerasScikit-learnDockerKubernetesAWSAzureGCPMLOpsVector databasesDelta LakeApache IcebergLakehousesLLM evaluation frameworks

Company Brief

Cognite
Provides industrial data software that helps companies connect, contextualize, and use operational data for analytics, AI, and digital transformation. Its platform is used by heavy-industry customers to improve asset performance and operations.
Industry: Data Infrastructure
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Headquarters: Oslo, Norway
Founded: 2016
WebsiteLinkedIn