InferenceX
中文

Articles

Articles on agentic inference, AgentX results, chip performance, and ML infrastructure.

New to the terminology? Browse the AI inference glossary.

Allagenticagentsagentxamdannouncementasicb200b300benchmarkcanndeepseekdisaggdynamofp4fp8gb200gb300glm5gpuh100h200huaweiinferencekimilatencymi355xminimaxnvfp4nvidianvl72openaiqwenrocmrubinsglangthroughputtilerttrtllmvllmwide-ep
·2 min read

GLM 5.3 on AgentX: MI355X ATOM Beats GB300 NVL72 on Part of the Curve

Where AMD’s vendor engine wins on performance per dollar, and what E2E Normalized Interactivity actually measures

agentxagenticbenchmarkinferenceglm5mi355xgb300nvl72trtllmsglangamdnvidia
·2 min read

MiniMax M3 on AgentX: B300 TRT-LLM TP2 Owns the Crown

NVIDIA sweeps the 432B model, and the missing DP-attention points explain why cache locality became a routing constraint

agentxagenticbenchmarkinferenceminimaxb300b200gb200trtllmvllmnvidia
·2 min read

MI355X versus GB300 NVL72 Inference Performance: 20x Gap on Qwen3.5 SGLang

GatedDeltaNet, a 262k native context, and no AMD competition at all on the same engine

agentxagenticbenchmarkinferenceqwensglangtrtllmnvidiaamd
·20 min read

Vera Rubin NVL72 vs GB200 NVL72? Inference TCO & Architecture Analysis

Rubin LUT Based Tensor Core, Feynman, Rack Scale, Perf Per MegaWatt, Perf Per Dollar, Software Improvements, Public Rubin Software, PyTorch, vLLM, OpenAI Triton

benchmarkgpuinferencenvidiarubingb200gb300deepseektrtllmdynamo
·29 min read

DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time — Huawei, GB300 NVL72, MI355X, B200

Day 0 Inference Performance, InferenceX, 100x performance improvement in 26 Days, Cost per Million Tokens, Huawei 950DT Inference Trace Analysis

benchmarkgpuinferencedeepseeknvidiaamdhuaweigb300b300b200mi355xh200sglangvllmtrtllmcann
·8 min read

GB200 NVL72 vs B200 on DeepSeek R1 670B: Up to 4.4x Throughput per GPU at 125 tok/s/user

DeepSeek R1 FP4 1k/1k. NVL72's 72-GPU NVLink scale-up fabric lets decode run wide EP up to EP=32, where B200's 8-GPU NVLink island caps out at EP=8 over RoCEv2

benchmarkgpuinferencedeepseeknvidiagb200b200nvl72trtllmdynamowide-epdisagg