AgentX｜最新结果

真实智能体工作负载下的推理性能对比

比较不同硬件平台在长上下文、多轮智能体工作负载下的推理性能，覆盖 OpenAI Jalapeño、MI355X、GB300 NVL72、GB200 NVL72、B200、H200、H100 和 RTX Pro，即将支持 TPUv7/v8、Rubin NVL72 与 MI455X UALoE72。

总览查看完整仪表板

对比结果目录

AgentX 与 8K→1K 结果

305 组推理基准测试的正面对比，涵盖 DeepSeekv4 Pro 0813 1.6T, DeepSeek R1, Kimi K3 2.8T, Kimi K2.5/K2.6/K2.7-Code 1T, GLM 5/5.1, GLM 5.3 744B, MiniMax M3 428B, MiniMax M2.5/M2.7, Qwen 3.8 Flash Next 176B-A6B, Qwen 3.5 397B-A17B, gpt-oss 120B, and Llama 3.3 70B。已有 AgentX 数据的模型默认打开长上下文、多轮 trace replay 结果；尚未纳入 AgentX 的模型默认打开受控的 8K→1K 工作负载。每张卡片均标明对应场景。

芯片每美元性能对比精度对比（FP8 vs BF16 等）投机解码对比（MTP vs 关闭）

DeepSeekv4 Pro 0813 1.6T

28 组芯片对比具有 DeepSeekv4 Pro 0813 1.6T 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI300X

Blackwell · CDNA 3

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI300X

Blackwell · CDNA 3

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI300X

Blackwell · CDNA 3

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4

DeepSeek R1

36 组芯片对比具有 DeepSeek R1 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI300X

Blackwell · CDNA 3

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI300X

Blackwell · CDNA 3

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI300X

Blackwell · CDNA 3

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H100 vs MI300X

Hopper · CDNA 3

H100 vs MI325X

Hopper · CDNA 3

H100 vs MI355X

Hopper · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H100

Blackwell · Hopper

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H100

Blackwell · Hopper

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H100

Blackwell · Hopper

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H100

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

H100 vs H200

Hopper · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4

Kimi K3 2.8T

15 组芯片对比具有 Kimi K3 2.8T 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

Kimi K2.5/K2.6/K2.7-Code 1T

28 组芯片对比具有 Kimi K2.5/K2.6/K2.7-Code 1T 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI300X

Blackwell · CDNA 3

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI300X

Blackwell · CDNA 3

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI300X

Blackwell · CDNA 3

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4

GLM 5/5.1

21 组芯片对比具有 GLM 5/5.1 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI325X vs MI355X

CDNA 3 · CDNA 4

GLM 5.3 744B

21 组芯片对比具有 GLM 5.3 744B 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI325X vs MI355X

CDNA 3 · CDNA 4

MiniMax M3 428B

36 组芯片对比具有 MiniMax M3 428B 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI300X

Blackwell · CDNA 3

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI300X

Blackwell · CDNA 3

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI300X

Blackwell · CDNA 3

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H100 vs MI300X

Hopper · CDNA 3

H100 vs MI325X

Hopper · CDNA 3

H100 vs MI355X

Hopper · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H100

Blackwell · Hopper

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H100

Blackwell · Hopper

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H100

Blackwell · Hopper

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H100

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

H100 vs H200

Hopper · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4

MiniMax M2.5/M2.7

36 组芯片对比具有 MiniMax M2.5/M2.7 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI300X

Blackwell · CDNA 3

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI300X

Blackwell · CDNA 3

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI300X

Blackwell · CDNA 3

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H100 vs MI300X

Hopper · CDNA 3

H100 vs MI325X

Hopper · CDNA 3

H100 vs MI355X

Hopper · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H100

Blackwell · Hopper

B200 vs H200

Blackwell · Hopper

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H100

Blackwell · Hopper

B300 vs H200

Blackwell · Hopper

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H100

Blackwell · Hopper

GB200 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs H100

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

H100 vs H200

Hopper · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4

Qwen 3.8 Flash Next 176B-A6B

3 组芯片对比具有 Qwen 3.8 Flash Next 176B-A6B 的基准测试数据。

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B300 vs H100

Blackwell · Hopper

B300 vs H200

Blackwell · Hopper

H100 vs H200

Hopper · Hopper

Qwen 3.5 397B-A17B

45 组芯片对比具有 Qwen 3.5 397B-A17B 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

B300 vs MI300X

Blackwell · CDNA 3

B300 vs MI325X

Blackwell · CDNA 3

B300 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI300X

Blackwell · CDNA 3

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

GB300 NVL72 vs MI300X

Blackwell · CDNA 3

GB300 NVL72 vs MI325X

Blackwell · CDNA 3

GB300 NVL72 vs MI355X

Blackwell · CDNA 4

H100 vs MI300X

Hopper · CDNA 3

H100 vs MI325X

Hopper · CDNA 3

H100 vs MI355X

Hopper · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

MI300X vs RTX PRO 6000

CDNA 3 · Blackwell

MI325X vs RTX PRO 6000

CDNA 3 · Blackwell

MI355X vs RTX PRO 6000

CDNA 4 · Blackwell

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs B300

Blackwell · Blackwell

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs GB300 NVL72

Blackwell · Blackwell

B200 vs H100

Blackwell · Hopper

B200 vs H200

Blackwell · Hopper

B200 vs RTX PRO 6000

Blackwell · Blackwell

B300 vs GB200 NVL72

Blackwell · Blackwell

B300 vs GB300 NVL72

Blackwell · Blackwell

B300 vs H100

Blackwell · Hopper

B300 vs H200

Blackwell · Hopper

B300 vs RTX PRO 6000

Blackwell · Blackwell

GB200 NVL72 vs GB300 NVL72

Blackwell · Blackwell

GB200 NVL72 vs H100

Blackwell · Hopper

GB200 NVL72 vs H200

Blackwell · Hopper

GB200 NVL72 vs RTX PRO 6000

Blackwell · Blackwell

GB300 NVL72 vs H100

Blackwell · Hopper

GB300 NVL72 vs H200

Blackwell · Hopper

GB300 NVL72 vs RTX PRO 6000

Blackwell · Blackwell

H100 vs H200

Hopper · Hopper

H100 vs RTX PRO 6000

Hopper · Blackwell

H200 vs RTX PRO 6000

Hopper · Blackwell

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4

gpt-oss 120B

21 组芯片对比具有 gpt-oss 120B 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

GB200 NVL72 vs MI300X

Blackwell · CDNA 3

GB200 NVL72 vs MI325X

Blackwell · CDNA 3

GB200 NVL72 vs MI355X

Blackwell · CDNA 4

H100 vs MI300X

Hopper · CDNA 3

H100 vs MI325X

Hopper · CDNA 3

H100 vs MI355X

Hopper · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs GB200 NVL72

Blackwell · Blackwell

B200 vs H100

Blackwell · Hopper

B200 vs H200

Blackwell · Hopper

GB200 NVL72 vs H100

Blackwell · Hopper

GB200 NVL72 vs H200

Blackwell · Hopper

H100 vs H200

Hopper · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4

Llama 3.3 70B

15 组芯片对比具有 Llama 3.3 70B 的基准测试数据。

NVIDIA vs AMD

跨厂商的不同架构代际对比。

B200 vs MI300X

Blackwell · CDNA 3

B200 vs MI325X

Blackwell · CDNA 3

B200 vs MI355X

Blackwell · CDNA 4

H100 vs MI300X

Hopper · CDNA 3

H100 vs MI325X

Hopper · CDNA 3

H100 vs MI355X

Hopper · CDNA 4

H200 vs MI300X

Hopper · CDNA 3

H200 vs MI325X

Hopper · CDNA 3

H200 vs MI355X

Hopper · CDNA 4

NVIDIA vs NVIDIA

Hopper 与 Blackwell 代际对比。

B200 vs H100

Blackwell · Hopper

B200 vs H200

Blackwell · Hopper

H100 vs H200

Hopper · Hopper

AMD vs AMD

CDNA 3 与 CDNA 4 代际对比。

MI300X vs MI325X

CDNA 3 · CDNA 3

MI300X vs MI355X

CDNA 3 · CDNA 4

MI325X vs MI355X

CDNA 3 · CDNA 4