Machine Learning Senior Software Engineer

Akamai Technologies
Cambridge
Workplace: RemoteFull timeUSD 121,400 - 218,600 annuallyFunction: Software EngineeringExperience: 5+ yearsSkills: []

Build and operate systems for validating, securing, quantizing, and optimizing AI models in production across Akamai’s Inference Cloud. Own end-to-end pipelines that scan models for vulnerabilities, apply compression techniques to reduce latency and footprint, and implement safety/compliance guardrails against risks like prompt injection. Design infrastructure for model routing and prompt management, and contribute to evaluation frameworks for accuracy, performance, and safety metrics.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Akamai Technologies
Akamai Technologies
1 day ago

Machine Learning Senior Software Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and operate systems for validating, securing, quantizing, and optimizing AI models in production across Akamai’s Inference Cloud. Own end-to-end pipelines that scan models for vulnerabilities, apply compression techniques to reduce latency and footprint, and implement safety/compliance guardrails against risks like prompt injection. Design infrastructure for model routing and prompt management, and contribute to evaluation frameworks for accuracy, performance, and safety metrics.
Location: Cambridge
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Develop and maintain model validation and security scanning pipelines to assess quality, correctness, and vulnerabilities before deployment.
  • •Implement quantization, pruning, and other optimization techniques to reduce model footprint and improve inference latency across hardware configurations.
  • •Build guardrail and content safety systems to enforce compliance policies and mitigate risks such as jail breaking and prompt injection.
  • •Design model routing and prompt management infrastructure to support intelligent request handling across model variants.
  • •Contribute to model evaluation frameworks that measure accuracy, performance, and safety metrics across the model lifecycle.

Pay and Benefits

Salary: USD 121,400 - 218,600 annually
Equity and Bonus:Equity
Perks:Health Insurance401kPaid LeaveParental LeaveSick TimeEquity

Key Requirements

  • •5 years of relevant experience and a Bachelor's/Master's degree in Computer Science, Machine Learning, or a related field.
  • •Hands-on experience with modern ML frameworks such as PyTorch, TensorFlow, or JAX, including model training, fine-tuning, and inference optimization.
  • •Proficiency in model quantization techniques (GPTQ, AWQ, GGUF) and understanding of how model compression impacts accuracy and latency.
  • •Experience with large language models (LLMs), transformer architectures, and multi-modal AI systems.
  • •Familiarity with model safety and responsible AI practices, including content filtering, red-teaming, or adversarial robustness evaluation.
Experience:5+ yearsMachine learningLarge language models
Education:
Tech Stack:PyTorchTensorFlowJAXPythonGPTQAWQGGUFTransformer architecturesLLMsContainerized deploymentsCI/CDCloud infrastructure

Company Brief

Akamai Technologies
Provides a global content delivery network (CDN) and cloud services to improve web and application performance, security, and delivery for enterprises, media companies, and cloud providers.
Industry: Cloud Computing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Cambridge, United States
Founded: 1998
WebsiteLinkedIn