Fastest GPU for DeepSeek V4.1 Flash
GB300 NVL72 leads at 359,012 tokens/s per GPU, 9% ahead of B300.
Measured on the AgentX agentic coding workload at a matched interactivity target of 50 tokens/s per user. Hardware without a measurement at this operating point is not ranked.
| Rank | GPU | Tokens/s per GPU | $ / 1M tokens | Precision | Engine |
|---|---|---|---|---|---|
| 1 | GB300 NVL72 | 359,012 | $0.002 | fp4 | vLLM |
| 2 | B300 | 328,417 | $0.002 | fp4 | vLLM |
| 3 | B200 | 262,143 | $0.002 | fp4 | vLLM |
| 4 | MI355X | 144,407 | $0.003 | fp4 | vLLM |
| 5 | GB200 NVL72 | 35,242 | $0.015 | fp4 | SGLang |
Optimizing for cost instead of speed? See the cheapest GPU for DeepSeek V4.1 Flash
Methodology
Every number on this page is a measurement, not a spec-sheet estimate. The InferenceX fleet serves DeepSeek V4.1 Flash on real hardware with community serving engines, sweeping concurrency to trace each platform's throughput-versus-interactivity frontier.
Platforms are then read at the same operating point (50 tokens/s per user) so the comparison is iso-interactivity: a GPU cannot win by quoting throughput at an unusably slow per-user speed. Cost converts measured throughput to $ per million total tokens using $/GPU/hr rates from the SemiAnalysis AI Cloud TCO model.
The derivation is shared with the InferenceX overview leaderboard, and results re-run continuously, so this ranking updates as new engine releases and configs land.
Frequently asked questions
- What is the fastest GPU for DeepSeek V4.1 Flash inference?
- As of the latest benchmark runs, GB300 NVL72 leads at 359,012 tokens/s per GPU on the AgentX agentic coding workload, measured at a matched interactivity target of 50 tokens/s per user.
- How is "fastest" measured?
- Every platform is read at the same interactivity tier (50 tokens/s per user) on the AgentX agentic coding workload, then ranked by measured throughput per GPU. This is the same derivation the InferenceX overview leaderboard renders, so the ranking can never disagree with the dashboard.
- How often is this ranking updated?
- Benchmarks re-run continuously on the InferenceX cluster fleet; the newest result feeding this ranking landed on 2026-10-14. The page always renders the latest data.