Articles

Articles on agentic inference, AgentX results, chip performance, and ML infrastructure.

Agentic Benchmark for LLM Inference: Metrics and Methodology

How an agent benchmark replays long-context, multi-turn workloads to measure latency, throughput, cache behavior, and serving cost

Multi-turn sessions, long contexts, and near-total prefix reuse make agentic inference a systems problem, and change what a benchmark has to measure