AI Engineer, Model Quality and Performance

Own model quality and performance for inference offerings by defining what “good” means and measuring it at scale. Build AI-agent-driven eval suites per model release and customer use case, mining trajectories and synthesizing representative test sets. Automate end-to-end eval execution and release qualification using pipelines on Docker, Git, and CI. Forecast and benchmark production performance for top customers and create product-quality tooling that unifies quality and performance signals.