Skip to content

Continuous Inference Benchmarking of the AI Frontier#

GTC 2026 digest Program Adjacent pick San Jose · 16–19 March 2026

Abstract Talk page Slides Recording

Cameron Quilici, Dylan Patel, Kimbo Chen (SemiAnalysis) — Talk, Tuesday, March 17

  • Why: Independent, nightly, reproducible inference benchmarks with energy and cost-per-token dimensions — useful third-party context for any infra capacity or accelerator evaluation the PM does.
  • What: InferenceX, SemiAnalysis' open-source benchmark suite: nightly sweeps of the latest software optimizations across leading AI accelerators, moving beyond peak metrics to throughput, energy consumption, cost-per-token, and user-facing interactivity thresholds. (from abstract only)
  • How: Multidimensional, continuously-run benchmarking rather than static datasheet comparison; the talk covers design, execution, and interpretation of results.
  • Where applicable: Cross-vendor accelerators; third-party (not vendor) analysis. Directly usable for procurement and capacity planning; methodology transfers to internal benchmarking programs.