AI Framework Engineer - QA & Benchmarking

Intel
Shanghai
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningEducation: mastersSkills: []

Design and build agentic QA automation to detect, triage, and report framework and hardware bugs with minimal manual effort. Own end-to-end benchmarks and unit/microbenchmarks for PyTorch, vLLM, and SGLang, validating latency, throughput, and functionality across hardware. Maintain issue tracking and reproduction documentation, and integrate tests into CI/CD pipelines to prevent and diagnose performance regressions.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Intel
Intel
5 days ago

AI Framework Engineer - QA & Benchmarking

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Design and build agentic QA automation to detect, triage, and report framework and hardware bugs with minimal manual effort. Own end-to-end benchmarks and unit/microbenchmarks for PyTorch, vLLM, and SGLang, validating latency, throughput, and functionality across hardware. Maintain issue tracking and reproduction documentation, and integrate tests into CI/CD pipelines to prevent and diagnose performance regressions.
Location: Shanghai
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Entry level

Key Responsibilities

  • •Design and build automated QA flows using LLMs/agents to catch, triage, and report framework and hardware bugs.
  • •Run, maintain, and expand end-to-end benchmarks along with unit tests and microbenchmarks.
  • •Validate latency, throughput, and functionality across different hardwares and track/reproduce performance regressions.
  • •Maintain test tracking documentation and bug reproduction steps.
  • •Integrate tests into CI/CD pipelines.

Key Requirements

  • •Bachelor’s or Master’s degree in Software Engineering or a related field.
  • •Proficient in Python.
  • •Basic understanding of deep learning concepts, transformer models, and standard model execution flow.
  • •Comfortable working in Linux, including shell scripting (Bash) and using Git for version control.
  • •Preferred experience with PyTorch, vLLM, or SGLang (hands-on experience or coursework) or building basic LLM applications/scripts/agent workflows.
Experience:AI/MLDeep learningLLMTestingBenchmarking
Education:Master's in Software Engineering
Tech Stack:PythonPyTorchVLLMSGLangLinuxBashGitCI/CDDockerPyTorch ProfilerLangChainGitHub ActionsTransformersLLM APIs

Company Brief

Intel
Designs and manufactures semiconductor chips, processors, and related hardware for PCs, data centers, networking, and embedded applications, while providing software and services to accelerate computing across industries globally.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1968
Glassdoor
Glassdoor: 3.8
WebsiteLinkedInGlassdoor