公开数据 API
InferenceX API 参考文档
从 InferenceX 使用的同一组数据源中，读取基准测试数据、溯源信息、数据集、CollectiveX 数据和诊断数据。
- 规范版本
- v1 · OpenAPI 3.1
- 身份验证
- 身份验证已发布的只读端点不需要身份验证。
- 响应格式
- 响应格式除非端点明确说明 CSV，否则响应均为 JSON。日期使用 YYYY-MM-DD，时间戳使用 UTC ISO 8601。
- 基础 URL
- https://inferencex.semianalysis.com
01 / 快速入门
快速入门
只需几步，即可从查看契约到获得真实响应。
- 01
查询可用配置
先查询 availability，选择实际可用的模型、硬件、框架和序列取值。
查询可用配置curl "https://inferencex.semianalysis.com/api/v1/availability" - 02
获取基准行
然后为受支持的展示模型请求最新原始基准行。
获取基准行curl "https://inferencex.semianalysis.com/api/v1/benchmarks?model=DeepSeek-R1-0528"
技能版本 · 1.0.0
通过智能体使用 API
inferencex-api 技能帮助智能体查找和使用公开 API，涵盖基准测试、溯源、数据集、CollectiveX 和诊断接口。已验证的单轮请求 PowerX 导出是首个完整示例。
@semianalysisai/inferencex-skills
需要 Node 24 或更新版本、npm，以及 Codex 或 Claude Code。安装和 API 查询均需联网。
查询通过公开 API 完成，无需数据库凭据。独立的 MCP server 有自己的配置流程；本技能不依赖它，也不会改动它的配置。
安装到项目
在项目目录中执行对应智能体的安装命令，然后在该项目中启动智能体会话。
Codex
npm exec --yes --package @semianalysisai/inferencex-skills@1.0.0 -- inferencex-skills install --target codexClaude Code
npm exec --yes --package @semianalysisai/inferencex-skills@1.0.0 -- inferencex-skills install --target claude升级时，将安装命令中的版本号改为新的已发布版本，并加上 --force 重新执行。默认会跳过已有技能。请先保存本地修改：--force 会覆盖同名文件，但保留不再随包提供的旧文件。
检查已复制的技能版本时，将上方命令中的 install 改为 status，并保留相同的 --target。Installer version 表示安装器版本，Installed version 表示项目内已复制技能的版本。旧版安装可能显示 unknown。
使用示例（英文）首个示例：实测 PowerX 数据
使用 inferencex-api 导出 DeepSeek-V4-Pro 最新可用的实测 PowerX 数据：
- 仅选取输入恰好为 8192、输出恰好为 1024 个 token 的单轮请求，并要求 strictV2。
- 在 InferenceX 仓库之外，使用已安装 CLI 的 powerx export 命令，分别生成 CSV 和 JSON 证据包。将 result.csv 或 result.json 与对应的 manifest.json 和 responses/ 一起保留，核验每个证据包后再报告结果。
- 区分实测单 GPU 功率、整个部署的 GPU 能耗与预留功率估算。
- 保留原始模型键、来源标识和 URL、测量日期，以及独立的快照元数据。
- 记录请求 URL、提取时间、包版本、本地筛选条件，以及返回和选中的数据条数。
- 说明数据行被排除的原因，并列出所请求指标的缺失项。
- 缺失指标保持不可用，真实零值保持为零。说明空结果的含义，不据此推断所有基准测试数据都不存在。PowerX 指南与直接导出
打开下方安装路径中的指南，查看验证规则、单位、缺失数据处理和溯源说明。随包提供的 Node 24 命令行工具（CLI）可在项目中直接运行，无需检出 InferenceX 仓库或提供数据库凭据。
- Codex
- .agents/skills/inferencex-api/references/powerx.md
- Claude Code
- .claude/skills/inferencex-api/references/powerx.md
运行已安装的 CLI（Codex）
mkdir -p evidence
node .agents/skills/inferencex-api/scripts/inferencex.mjs powerx export \
--model DeepSeek-V4-Pro --isl 8192 --osl 1024 \
--format csv --output-dir evidence/powerx-csv
node .agents/skills/inferencex-api/scripts/inferencex.mjs verify evidence/powerx-csvClaude Code 使用 .claude/skills/inferencex-api 路径。导出 JSON 时改用 --format json --output-dir evidence/powerx-json，并核验该目录。每次导出都使用新的输出目录，其中包含 result.csv 或 result.json、manifest.json 和 responses/。请保留整个证据包：即使结果为空，也能保留请求和数据覆盖范围的元数据。省略 --date 表示查询最新可用观测值，也可添加 --date YYYY-MM-DD 指定截止日期。
avg_power_w 是实测单 GPU 平均功率，单位为 W。schema v2 中不带角色前缀的 joules 指标表示整个部署的 GPU 能耗；带 prefill/decode 前缀的能耗仅对应相应角色。这些数据是已有观测值，不是新运行的基准测试，也不是设施总能耗测量值。
02 / 约定
约定
适用于受支持接口的通用请求、错误与缓存行为。
- 客户端请求统计
- 可选的 inferencex-cli/<version> 或 inferencex-skill/<version> User-Agent 标识用于归类公开 GET 请求，包括缓存命中及重试。X-InferenceX-Traffic 区分 normal、ci 和 validation 流量。仅记录接口路径模板、包版本、客户端类型（CLI 或 skill）、部署环境与流量类别，不记录查询参数值或用户标识。包内客户端可设置 INFERENCEX_TELEMETRY=0 关闭来源标记。这些请求头不影响身份验证、响应数据或缓存。
- 错误
- JSON 错误包含 error 字符串。400 表示参数缺失或无效，404 表示请求的记录不存在，500 表示服务器查询失败。
- 缓存
- 只读端点可能由共享缓存提供。CollectiveX 使用较短的刷新窗口，框架版本使用一小时共享缓存。
- 标识符
- 基准结果 ID 和 GitHub 运行 ID 为正整数。批量诊断端点接受以逗号分隔并去重的 ID。
03 / 数据结构
BenchmarkRow 与指标
理解主要基准测试响应数据及其中的实测字段。
- BenchmarkRow
配置字段与 metrics 映射位于同一层级，时间指标以秒为单位。以 _per_gpu 结尾的吞吐量字段保留历史名称，实际表示每颗物理芯片每秒处理的 token 数，TPU 也使用此单位。num_prefill_gpu 和 num_decode_gpu 表示物理芯片数，与逻辑 TP 独立；聚合部署可能在两列中重复记录同一芯片数，只有分离式部署才应将两列相加。可选字段 metrics.dp 记录产物中提供的数据并行度。判断 P99 inter-token latency 是否达标时，应使用以秒为单位的 p99_itl（乘以 1000 可换算为毫秒）。p99_tpot 表示请求内每个输出 token 的平均耗时；不能用 p99_intvty 的倒数代替 p99_itl。
结构
代码BenchmarkRows示例
代码{ "id": 421, "hardware": "h200_sxm", "framework": "vllm", "model": "dsr1", "precision": "fp8", "spec_method": "none", "disagg": false, "is_multinode": false, "prefill_tp": 8, "prefill_ep": 1, "prefill_dp_attention": false, "prefill_num_workers": 1, "decode_tp": 8, "decode_ep": 1, "decode_dp_attention": false, "decode_num_workers": 1, "num_prefill_gpu": 0, "num_decode_gpu": 8, "benchmark_type": "single_turn", "isl": 1024, "osl": 1024, "conc": 32, "offload_mode": "off", "image": "vllm/vllm-openai:v0.10.2", "recipe_fingerprint": "7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d", "metrics": { "median_ttft": 0.42, "median_tpot": 0.018, "tput_per_gpu": 128.4, "power_valid": 1, "power_metric_schema_version": 2, "avg_power_w": 678.5, "joules_per_output_token": 5.3, "joules_per_total_token": 2.65, "avg_temp_c": 61.2 }, "date": "2026-08-08", "run_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789" }滚动查看完整示例。
- 实测功率
基准测试数据行可能包含实测功率、能耗和 GPU 遥测指标（avg_power_w、avg_total_gpu_power_w、total_gpu_energy_j、p75_power_w、p75_total_gpu_power_w、p90_power_w、p90_total_gpu_power_w、joules_per_*、avg_temp_c、peak_temp_c、avg_util_pct、avg_mem_used_mb）。power_valid 有三种状态：1 表示测量窗口已通过验证；0 表示验证失败，生产端会移除实测值，摄取端也会再次清除，若仍有残留，应视为不可靠；缺失表示当前响应未提供验证结论。旧数据可能缺少该字段，但仅凭字段缺失，既无法判断缺失原因，也无法判断数据新旧或测量是否无效。power_metric_schema_version == 2 规定所有无前缀的 joules_per_* 字段均按整个部署统计能耗。未标注版本的分离式部署数据中，这些字段曾记录单个角色的能耗，因此其统计口径不明确。多节点和分离式运行中，各 worker 的功率和遥测明细位于 workers[]。power_invalid_reasons 列出生产端的原因码。power_audit 可在有效与无效行上提供测量窗口、设备和采样数量、生产端标识及保留的审计产物引用。缺少审计信息不能证明测量的新旧或有效性。查询实测功率时，使用 powerValid=strictV2，仅保留 power_valid == 1 且 power_metric_schema_version == 2 的行。这是唯一支持的功率筛选值。常规基准测试请求应省略 powerValid，以保留缺少有效功率测量的结果。
结构
代码BenchmarkRows示例
代码{ "power_valid": 1, "power_metric_schema_version": 2, "avg_power_w": 678.5, "joules_per_output_token": 5.3 }- 以 ID 为键的映射
批量诊断响应是以十进制基准结果 ID 为键的 JSON 对象。缺少某个键表示该 ID 没有可用值。
结构
代码Record<string, value>示例
代码{ "421": true }- CollectiveX 版本
CollectiveX 读取需要明确指定受支持的契约版本。受支持版本：1。
结构
代码CollectiveXDataset
04 / 参考
端点参考
展开任一操作，即可查看参数、状态码和完整示例。
51 项操作
仪表板只读视图
通过显式筛选参数读取仪表板数据和计算结果。
GET测试版/api/v1/views/options获取 views API 的全部选项域
views API 的静态发现端点：模型（含数据库键、分类与发布日期）、序列、精度、硬件（含厂商、架构、TDP 及各供应商每小时成本）、推理框架、投机解码方法、百分位、x 轴与坐标缩放模式、图表指标（中英文标签、单位、极性）、快捷筛选域、可靠性时间范围，以及 overview/calculator/fleet 的选项集，并附仪表盘实际使用的默认值。所有取值直接来自仪表盘控件渲染所用的注册表，因此该响应是其余 /api/v1/views 端点的权威输入目录。不访问数据库。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| format | query | enum | 可选 | 响应编码。该发现端点仅支持 JSON。 | json |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/options'响应
ViewOptions200
各 views 端点接受的全部选项域，以及与仪表盘一致的默认值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"options"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"properties": {
"format": {
"type": "string",
"enum": [
"json"
]
}
},
"required": [
"format"
],
"additionalProperties": false
},
"models": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"dbKeys": {
"type": "array",
"items": {
"type": "string"
}
},
"category": {
"type": "string"
},
"releaseDate": {
"type": [
"string",
"null"
]
},
"compareSlug": {
"type": [
"string",
"null"
]
}
},
"required": [
"name",
"dbKeys",
"category",
"releaseDate",
"compareSlug"
],
"additionalProperties": false
}
},
"sequences": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"label": {
"type": "string"
},
"labelZh": {
"type": "string"
},
"urlSegment": {
"type": [
"string",
"null"
]
},
"isl": {
"type": [
"integer",
"null"
]
},
"osl": {
"type": [
"integer",
"null"
]
},
"kind": {
"type": "string"
},
"deprecated": {
"type": "boolean"
}
},
"required": [
"key",
"label",
"labelZh",
"urlSegment",
"isl",
"osl",
"kind",
"deprecated"
],
"additionalProperties": false
}
},
"precisions": {
"type": "array",
"items": {
"type": "string"
}
},
"hardware": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"label": {
"type": "string"
},
"vendor": {
"type": "string"
},
"arch": {
"type": "string"
},
"tdpW": {
"type": "number"
},
"costPerHour": {
"type": "object",
"properties": {
"h": {
"type": "number"
},
"r": {
"type": "number"
}
},
"required": [
"h",
"r"
],
"additionalProperties": false
}
},
"required": [
"key",
"label",
"vendor",
"arch",
"tdpW",
"costPerHour"
],
"additionalProperties": false
}
},
"frameworks": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"label": {
"type": "string"
},
"family": {
"type": [
"string",
"null"
]
}
},
"required": [
"key",
"label",
"family"
],
"additionalProperties": false
}
},
"specMethods": {
"type": "array",
"items": {
"type": "string"
}
},
"percentiles": {
"type": "array",
"items": {
"type": "string"
}
},
"xAxisModes": {
"type": "array",
"items": {
"type": "string"
}
},
"scaleModes": {
"type": "array",
"items": {
"type": "string"
}
},
"metrics": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"configKey": {
"type": "string"
},
"label": {
"type": "string"
},
"labelZh": {
"type": "string"
},
"unit": {
"type": [
"string",
"null"
]
},
"polarity": {
"type": [
"string",
"null"
]
},
"group": {
"type": [
"string",
"null"
]
},
"source": {
"type": "string"
}
},
"required": [
"key",
"configKey",
"label",
"labelZh",
"unit",
"polarity",
"group",
"source"
],
"additionalProperties": false
}
},
"quickFilters": {
"type": "object",
"properties": {
"vendors": {
"type": "array",
"items": {
"type": "string"
}
},
"frameworkFamilies": {
"type": "array",
"items": {
"type": "string"
}
},
"deployments": {
"type": "array",
"items": {
"type": "string"
}
},
"specModes": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"vendors",
"frameworkFamilies",
"deployments",
"specModes"
],
"additionalProperties": false
},
"reliabilityRanges": {
"type": "array",
"items": {
"type": "string"
}
},
"overview": {
"type": "object",
"additionalProperties": true
},
"calculator": {
"type": "object",
"additionalProperties": true
},
"fleet": {
"type": "object",
"additionalProperties": true
},
"defaults": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params",
"models",
"sequences",
"precisions",
"hardware",
"frameworks",
"metrics",
"defaults"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "options",
"apiVersion": "v1",
"params": {
"format": "json"
},
"models": [
{
"name": "DeepSeek-V4-Pro",
"dbKeys": [
"dsv4"
],
"category": "default",
"releaseDate": "2026-06-30",
"compareSlug": "deepseek-v4-pro"
}
],
"sequences": [
{
"key": "8k/1k",
"label": "8k/1k",
"labelZh": "8k/1k",
"urlSegment": "8k-1k",
"isl": 8192,
"osl": 1024,
"kind": "fixed",
"deprecated": false
}
],
"precisions": [
"fp4",
"fp4fp8",
"fp8",
"bf16",
"int4"
],
"hardware": [
{
"key": "h200",
"label": "H200",
"vendor": "NVIDIA",
"arch": "Hopper",
"tdpW": 700,
"costPerHour": {
"h": 2.29,
"n": 2.99,
"r": 3.11
}
}
],
"frameworks": [
{
"key": "trt",
"label": "TRTLLM",
"family": "trt"
}
],
"specMethods": [
"mtp",
"none"
],
"percentiles": [
"p75",
"p90"
],
"xAxisModes": [
"interactivity",
"ttft",
"e2e",
"e2e-normalized-interactivity"
],
"scaleModes": [
"auto",
"linear",
"log"
],
"metrics": [
{
"key": "tokensPerDollarN",
"configKey": "y_tokensPerDollarN",
"label": "Tokens per Dollar (Neocloud)",
"labelZh": "每美元 Token 数（Neocloud）",
"unit": null,
"polarity": "higher",
"group": "Cost",
"source": "benchmark"
}
],
"quickFilters": {
"vendors": [
"NVIDIA",
"AMD"
],
"frameworkFamilies": [
"vllm",
"sglang",
"trt",
"atom"
],
"deployments": [
"single-node",
"multi-node",
"disagg"
],
"specModes": [
"mtp",
"stp"
]
},
"reliabilityRanges": [
"last-3-days",
"last-7-days",
"last-month",
"last-3-months",
"all-time"
],
"defaults": {
"model": "DeepSeek-V4-Pro",
"sequence": "8k/1k",
"metric": "y_tokensPerDollarH",
"percentile": "p90",
"xmode": "interactivity"
}
}滚动查看完整示例。
400
format 参数无效——该端点仅支持 JSON。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unsupported format: csv",
"param": "format",
"allowed": [
"json"
]
}500
选项数据组装失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/inference获取主推理图表视图
返回 /inference 散点图所用的序列：按硬件配置分组，在所选指标、序列、精度与 x 轴模式下给出各并发档位的 x/y 数据点，并复用仪表板代码计算边界与 best-per-SKU 标记。筛选参数与仪表板快捷筛选一致（gpus、vendors、框架系列、部署模式、投机解码）。设置 optimal=true 可只保留边界点，best=true 可只保留每个 GPU SKU 的最优曲线。实测功耗使用较高功耗侧的外包络：frontier.direction 描述这一边界，metric.direction 则保留 best-per-SKU 选择所用的优化方向。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| allPoints | query | string | 可选 | 布尔值，默认为 false。包括被图表范围裁剪的数据点；optimal 和 best 仍独立生效。 | |
| best | query | boolean | 可选 | 仅返回每个 GPU SKU 的最优曲线（对应仪表盘 “Best per SKU” 开关）。 | true |
| date | query | string | 可选 | 截止日期（YYYY-MM-DD）：每个配置取该日期当天或之前的最新运行。 | 2026-08-01 |
| dates | query | string | 可选 | 最多十二个比较项，以逗号分隔，格式为 YYYY-MM-DD 或 YYYY-MM-DD~rRUN_ID。仅含日期时读取当天的逻辑快照，不按截止日期向前回溯；含运行 ID 时读取该次运行的逻辑快照。各快照独立计算。 | |
| deployment | query | string | 可选 | 逗号分隔的部署模式；agg 会展开为 single-node 与 multi-node。 | disagg |
| end | query | string | 可选 | 比较范围结束日期 YYYY-MM-DD，不得早于 start。历史视图将其用作含终点的数据范围。 | |
| format | query | enum | 可选 | 响应编码。csv 为每个数据点返回一行平面数据。 | csv |
| frameworks | query | string | 可选 | 逗号分隔的推理框架系列。 | vllm,sglang |
| gpus | query | string | 可选 | 逗号分隔的硬件键或 GPU 名称（如 h200 或完整 hwKey）。 | h200,mi355x |
| metric | query | string | 可选 | Y 轴指标键或配置键，如 tpPerGpu 或 y_tokensPerDollarN（见 options → metrics）。 | y_tpPerGpu |
| model | query | string | 必填 | 前端模型显示名（见 /api/v1/views/options → models）。 | DeepSeek-V4-Pro |
| optimal | query | boolean | 可选 | 仅返回每个硬件在各精度、各快照日期上的边界点。实测功耗指标与图表一致，保留较高功耗侧的外包络；其他指标保留各自的帕累托前沿。功耗包络不构成能效推荐。 | true |
| percentile | query | enum | 可选 | agentic-traces 场景下 x 轴延迟字段使用的百分位。 | p75 |
| power | query | string | 可选 | 以逗号分隔的 certified、legacy 功率数据等级。省略时选择全部等级。 | |
| precisions | query | string | 可选 | 逗号分隔的精度列表。省略时按数据最密的精度自动选择，与仪表盘默认行为一致。 | fp8,bf16 |
| priceSource | query | string | 可选 | 利润视图支持 list、openrouter、custom；推理和历史视图支持 normalized、openrouter。响应 pricing 记录实际使用的价格。 | |
| runId | query | integer | 可选 | GitHub Actions 运行 id。返回该次运行的精确快照而非最新数据。 | 12345678 |
| sequence | query | enum | 可选 | 基准序列。也接受 8k-1k、agentic 等别名。 | agentic-traces |
| spec | query | string | 可选 | 逗号分隔的投机解码模式。 | mtp |
| start | query | string | 可选 | 比较范围起始日期 YYYY-MM-DD。与 end 一起只加入两个端点，不加入中间所有日期。历史视图将其用作含起点的数据范围。 | |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 | |
| unofficialrun | query | string | 可选 | 最多八个公开 CI 运行 ID，以逗号分隔。去除各项首尾空白和重复 ID 后，按剩余顺序分配运行索引。叠加结果与官方数据分开。 | |
| userCosts | query | string | 可选 | JSON 对象，将硬件键映射为有限非负美元/芯片小时，用于自定义成本指标。 | |
| userPowers | query | string | 可选 | JSON 对象，将硬件键映射为有限非负千瓦/芯片功率假设。 | |
| vendors | query | string | 可选 | 逗号分隔的 GPU 厂商。 | NVIDIA |
| xmetric | query | enum | 可选 | 当 x 轴为首 Token 时间（TTFT）时使用的百分位。 | p99_ttft |
| xmode | query | enum | 可选 | X 轴模式。e2e-normalized-interactivity 使用已持久化的 AgentX 派生指标；没有合格派生值的数据点不参与此视图。 | e2e |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/inference?model=DeepSeek-V4-Pro&metric=y_tokensPerDollarN&sequence=8k-1k'响应
InferenceView200
按硬件配置分组的图表就绪序列，每个数据点带帕累托前沿与 best-per-SKU 标记。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"inference"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"metric": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"configKey": {
"type": "string"
},
"label": {
"type": "string"
},
"labelZh": {
"type": "string"
},
"unit": {
"type": [
"string",
"null"
]
},
"polarity": {
"type": [
"string",
"null"
]
},
"direction": {
"type": [
"string",
"null"
],
"description": "Configured optimization direction, also used by best-per-SKU selection."
}
},
"required": [
"key",
"configKey",
"label",
"labelZh"
],
"additionalProperties": false
},
"xAxis": {
"type": "object",
"properties": {
"mode": {
"type": "string"
},
"field": {
"type": "string"
},
"label": {
"type": "string"
}
},
"required": [
"mode",
"field",
"label"
],
"additionalProperties": false
},
"frontier": {
"type": "object",
"properties": {
"direction": {
"type": [
"string",
"null"
],
"description": "Selected boundary direction. Measured-power gauges use upper_right for interactivity or upper_left for latency, independently of metric.direction."
},
"points": {
"type": "integer"
}
},
"required": [
"direction",
"points"
],
"additionalProperties": false
},
"hardware": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"label": {
"type": "string"
},
"vendor": {
"type": "string"
}
},
"required": [
"key",
"label"
],
"additionalProperties": false
}
},
"series": {
"type": "array",
"items": {
"type": "object",
"properties": {
"hwKey": {
"type": "string"
},
"gpu": {
"type": "string"
},
"framework": {
"type": "string"
},
"specMethod": {
"type": "string"
},
"label": {
"type": "string"
},
"vendor": {
"type": "string"
},
"deployment": {
"type": "string"
},
"kvOffload": {
"type": "boolean"
},
"bestPerSku": {
"type": "boolean"
},
"points": {
"type": "array",
"items": {
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"precision": {
"type": "string"
},
"x": {
"type": "number"
},
"y": {
"type": "number"
},
"concurrency": {
"type": "number"
},
"tp": {
"type": "number"
},
"date": {
"type": "string",
"format": "date"
},
"runId": {
"type": "integer"
},
"frontier": {
"type": "boolean"
},
"bestPerSku": {
"type": "boolean"
},
"metrics": {
"type": "object",
"additionalProperties": {
"type": "number"
}
}
},
"required": [
"x",
"y",
"concurrency",
"tp",
"date",
"frontier",
"bestPerSku",
"metrics"
],
"additionalProperties": false
}
}
},
"required": [
"hwKey",
"gpu",
"framework",
"specMethod",
"label",
"deployment",
"kvOffload",
"bestPerSku",
"points"
],
"additionalProperties": false
}
},
"count": {
"type": "integer"
},
"pricing": {
"type": [
"object",
"null"
],
"additionalProperties": true
},
"comparisons": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"overlays": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"view",
"apiVersion",
"params",
"metric",
"xAxis",
"frontier",
"series",
"count"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "inference",
"apiVersion": "v1",
"params": {
"model": "DeepSeek-V4-Pro",
"sequence": "8k/1k",
"precisions": [
"fp8"
],
"metric": "y_tpPerGpu",
"xmode": "interactivity",
"xmetric": "p90_ttft",
"percentile": "p90",
"date": null,
"runId": null,
"gpus": [],
"vendors": [],
"frameworks": [],
"deployment": [],
"spec": [],
"optimal": true,
"best": true,
"format": "json"
},
"metric": {
"key": "tpPerGpu",
"configKey": "y_tpPerGpu",
"label": "Output Throughput per GPU (tok/s/gpu)",
"labelZh": "单 GPU 输出吞吐（tok/s/gpu）",
"unit": "tok/s/gpu",
"polarity": "higher",
"direction": "upper_left"
},
"xAxis": {
"mode": "interactivity",
"field": "median_intvty",
"label": "Median Interactivity (tok/s/user)"
},
"frontier": {
"direction": "upper_left",
"points": 14
},
"hardware": [
{
"key": "h200_trt",
"label": "H200 (TRTLLM)",
"vendor": "NVIDIA"
}
],
"series": [
{
"hwKey": "h200_trt",
"gpu": "h200",
"framework": "trt",
"specMethod": "none",
"label": "H200 (TRTLLM)",
"vendor": "NVIDIA",
"deployment": "single-node",
"kvOffload": false,
"bestPerSku": true,
"points": [
{
"x": 12.5,
"y": 450.5,
"concurrency": 64,
"tp": 8,
"date": "2026-08-20",
"runId": 12345678,
"frontier": true,
"bestPerSku": true,
"metrics": {
"tpPerGpu": 450.5,
"outputTputPerGpu": 400.2,
"inputTputPerGpu": 50.3
}
}
]
}
],
"count": 1
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
hwKey,gpu,framework,specMethod,label,vendor,deployment,kvOffload,x,y,concurrency,tp,date,runId,frontier,bestPerSku,metric_tpPerGpu
h200_trt,h200,trt,none,H200 (TRTLLM),NVIDIA,single-node,false,12.5,450.5,64,8,2026-08-20,12345678,true,true,450.5400
参数无效。响应体会给出参数名，枚举参数还会列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown xmode: bogus",
"param": "xmode",
"allowed": [
"interactivity",
"ttft",
"e2e",
"e2e-normalized-interactivity"
]
}500
基准数据查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/historical获取历史趋势视图
返回服务端计算的 Historical Trends 仪表盘趋势线：在每个基准快照日期上，对每个硬件配置（选择多个精度时按精度分线）在目标交互速率处对所选指标插值，再组装为按日期排序的趋势线。插值与仪表盘使用相同的单调样条数学。曲线补齐至 extendToDate（默认当前 UTC 日期），补齐点标为 synthetic: true。需要可复现的快照时请显式指定 extendToDate。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| deployment | query | string | 可选 | 逗号分隔的部署模式；agg 会展开为 single-node 与 multi-node。 | single-node |
| end | query | string | 可选 | 包含的最晚快照日期（YYYY-MM-DD）。 | 2026-08-01 |
| extendToDate | query | string | 可选 | 历史曲线补齐至此日期，格式为 YYYY-MM-DD；默认当前 UTC 日期，与仪表板一致。 | |
| format | query | enum | 可选 | 响应编码。csv 为每条趋势线的每个点返回一行平面数据。 | csv |
| frameworks | query | string | 可选 | 逗号分隔的推理框架系列。 | vllm,trt |
| gpus | query | string | 可选 | 逗号分隔的硬件键或 GPU 名称。 | h200,mi355x |
| metric | query | string | 可选 | 趋势指标键或配置键，如 tpPerGpu 或 y_tokensPerDollarN（见 options → metrics）。 | y_tpPerGpu |
| model | query | string | 必填 | 前端模型显示名（见 /api/v1/views/options → models）。 | DeepSeek-V4-Pro |
| precisions | query | string | 可选 | 逗号分隔的精度列表。省略时按数据最密的精度自动选择。选择多个精度时，每个硬件会按精度分线（键为 hwKey__precision）。 | fp8,bf16 |
| priceSource | query | string | 可选 | 利润视图支持 list、openrouter、custom；推理和历史视图支持 normalized、openrouter。响应 pricing 记录实际使用的价格。 | |
| sequence | query | enum | 可选 | 基准序列。也接受 8k-1k、agentic 等别名。 | agentic-traces |
| start | query | string | 可选 | 包含的最早快照日期（YYYY-MM-DD）。 | 2026-01-01 |
| target | query | number | 可选 | 目标交互速率（tok/s/user）：在每个快照日期上按该值对指标插值。 | 50 |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 | |
| vendors | query | string | 可选 | 逗号分隔的 GPU 厂商。 | AMD |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/historical?model=DeepSeek-V4-Pro&metric=y_tpPerGpu&target=35'响应
HistoricalView200
按硬件配置给出的按日期排序趋势线，在目标交互速率处插值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"historical"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"metric": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"configKey": {
"type": "string"
},
"label": {
"type": "string"
},
"labelZh": {
"type": "string"
}
},
"required": [
"key",
"configKey",
"label",
"labelZh"
],
"additionalProperties": false
},
"target": {
"type": "number"
},
"hwKeysWithData": {
"type": "array",
"items": {
"type": "string"
}
},
"series": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"hwKey": {
"type": "string"
},
"precision": {
"type": [
"string",
"null"
]
},
"label": {
"type": "string"
},
"vendor": {
"type": [
"string",
"null"
]
},
"points": {
"type": "array",
"items": {
"type": "object",
"properties": {
"date": {
"type": "string",
"format": "date"
},
"value": {
"type": "number"
},
"synthetic": {
"type": "boolean"
}
},
"required": [
"date",
"value"
],
"additionalProperties": false
}
}
},
"required": [
"key",
"hwKey",
"label",
"points"
],
"additionalProperties": false
}
},
"count": {
"type": "integer"
}
},
"required": [
"view",
"apiVersion",
"params",
"metric",
"target",
"hwKeysWithData",
"series",
"count"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "historical",
"apiVersion": "v1",
"params": {
"model": "DeepSeek-V4-Pro",
"sequence": "8k/1k",
"metric": "y_tpPerGpu",
"target": 35,
"precisions": [
"fp8"
],
"gpus": [],
"vendors": [],
"frameworks": [],
"deployment": [],
"start": null,
"end": null,
"format": "json"
},
"metric": {
"key": "tpPerGpu",
"configKey": "y_tpPerGpu",
"label": "Output Throughput per GPU (tok/s/gpu)",
"labelZh": "单 GPU 输出吞吐（tok/s/gpu）"
},
"target": 35,
"hwKeysWithData": [
"h200_trt"
],
"series": [
{
"key": "h200_trt",
"hwKey": "h200_trt",
"precision": null,
"label": "H200 (TRTLLM)",
"vendor": "NVIDIA",
"points": [
{
"date": "2026-07-01",
"value": 310.4
},
{
"date": "2026-08-20",
"value": 355.2
},
{
"date": "2026-08-25",
"value": 355.2,
"synthetic": true
}
]
}
],
"count": 3
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
key,hwKey,precision,label,vendor,date,value,synthetic
h200_trt,h200_trt,,H200 (TRTLLM),NVIDIA,2026-07-01,310.4,false400
参数无效。响应体会给出参数名，枚举参数还会列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "target must be >= 1",
"param": "target"
}500
历史基准数据查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/calculator插值计算器工作点
在服务端计算吞吐计算器：基准测试扫描按硬件配置分组，取帕累托前沿，并用与仪表盘相同的单调 Steffen–Hermite 插值在所请求目标处求值。可选地按固定功率为每个配置估算集群规模（mw），并给出每个配置在 $/M token 成本上限内的最大交互性（costcap）。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| costProvider | query | enum | 可选 | 成本口径：costh（自有）或 costr（租赁）；tcoBasis 选择 internal 或 external 假设。 | costh |
| costType | query | enum | 可选 | 成本与吞吐字段所用的 token 口径。 | total |
| costcap | query | number | 可选 | 成本上限（$/M token）。设置后响应附带 costCap 部分，给出各配置在上限内的最大交互性。 | 2.5 |
| date | query | date | 可选 | 使用 YYYY-MM-DD 当日或之前的数据。省略则使用最新数据。 | 2026-08-08 |
| format | query | enum | 可选 | 响应编码。 | json |
| gpus | query | CSV list | 可选 | 以逗号分隔的硬件键；可匹配完整 hwKey（b300_sglang）或基础芯片（b300）。 | b300,mi355x |
| hideSkuAboveConfigLimit | query | string | 可选 | 布尔值，默认为 true。排除目标超出配置实测上限的硬件。 | |
| mode | query | enum | 可选 | 插值方向。 | interactivity-to-throughput |
| model | query | string | 必填 | 展示模型名称或对比 slug。 | DeepSeek-V4-Pro |
| mw | query | number | 可选 | 设施功率预算（MW）。设置后每个结果附带 fleet 字段（芯片数、总 tok/s、并发用户数、成本）。 | 100 |
| percentile | query | enum | 可选 | agentic traces 的交互性分位数；固定序列使用中位数。 | p90 |
| precisions | query | CSV list | 可选 | 以逗号分隔的精度列表。省略时选择官方数据中曲线最多的精度，并纳入 unofficial-run 叠加数据中的精度。 | fp4,fp8 |
| runId | query | string | 可选 | 用于固定数据快照的 GitHub workflow 运行编号（数字）。 | 123456789 |
| sequence | query | enum | 可选 | 负载序列。支持 1k/1k、1k/8k、8k/1k（或连字符形式）以及 agentic-traces（别名 agentic）。 | 1k/1k |
| target | query | number | 可选 | 输入轴上的目标值：交互性（tok/s/user）；当 mode 为 throughput-to-interactivity 时为吞吐（tok/s/GPU）。 | 35 |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 | |
| unofficialrun | query | string | 可选 | 最多八个公开 CI 运行 ID，以逗号分隔。去除各项首尾空白和重复 ID 后，按剩余顺序分配运行索引。叠加结果与官方数据分开。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/calculator?model=DeepSeek-V4-Pro&sequence=1k/1k'响应
CalculatorView200
每个硬件配置在所请求目标下经 Steffen–Hermite 插值得到的工作点。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"calculator"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"generatedAt": {
"type": [
"string",
"null"
],
"description": "Latest run date among the rows the view was computed from."
},
"params": {
"type": "object",
"additionalProperties": true
},
"hardware": {
"type": "array",
"items": {
"type": "object",
"properties": {
"hwKey": {
"type": "string"
},
"resultKey": {
"type": "string"
},
"source": {
"type": "string"
},
"precision": {
"type": [
"string",
"null"
]
},
"label": {
"type": "string"
},
"value": {
"type": "number"
},
"inputThroughput": {
"type": "number"
},
"outputThroughput": {
"type": "number"
},
"cost": {
"type": "object",
"properties": {
"total": {
"type": "number"
},
"input": {
"type": "number"
},
"output": {
"type": "number"
}
},
"required": [
"total",
"input",
"output"
],
"additionalProperties": false
},
"tpPerMw": {
"type": "number"
},
"inputTpPerMw": {
"type": "number"
},
"outputTpPerMw": {
"type": "number"
},
"concurrency": {
"type": "number"
},
"cacheHitRate": {
"type": [
"number",
"null"
]
},
"inputTokenShare": {
"type": [
"number",
"null"
]
},
"clamped": {
"type": "boolean"
},
"clampedAbove": {
"type": "boolean"
},
"clampedBelow": {
"type": "boolean"
},
"nearest": {
"type": "object",
"properties": {
"below": {
"type": [
"object",
"null"
],
"properties": {
"interactivity": {
"type": "number"
},
"throughput": {
"type": "number"
},
"concurrency": {
"type": "number"
}
},
"additionalProperties": false
},
"above": {
"type": [
"object",
"null"
],
"properties": {
"interactivity": {
"type": "number"
},
"throughput": {
"type": "number"
},
"concurrency": {
"type": "number"
}
},
"additionalProperties": false
}
},
"required": [
"below",
"above"
],
"additionalProperties": false
},
"fleet": {
"type": [
"object",
"null"
],
"description": "Present only when mw is set.",
"properties": {
"chips": {
"type": "number"
},
"totalTokPerSec": {
"type": "number"
},
"concurrentUsers": {
"type": "number"
},
"costPerHour": {
"type": "number"
},
"costPerMonth": {
"type": "number"
}
},
"additionalProperties": false
}
},
"required": [
"hwKey",
"resultKey",
"precision",
"label",
"value",
"inputThroughput",
"outputThroughput",
"cost",
"tpPerMw",
"inputTpPerMw",
"outputTpPerMw",
"concurrency",
"cacheHitRate",
"inputTokenShare",
"clamped",
"clampedAbove",
"clampedBelow",
"nearest"
],
"additionalProperties": false
}
},
"costCap": {
"type": "array",
"description": "Present only when costcap is set.",
"items": {
"type": "object",
"properties": {
"hwKey": {
"type": "string"
},
"resultKey": {
"type": "string"
},
"label": {
"type": "string"
},
"maxInteractivity": {
"type": [
"number",
"null"
]
},
"throughput": {
"type": [
"number",
"null"
]
},
"concurrentUsers": {
"type": [
"number",
"null"
]
}
},
"required": [
"hwKey",
"resultKey",
"label",
"maxInteractivity",
"throughput",
"concurrentUsers"
],
"additionalProperties": false
}
},
"count": {
"type": "integer"
}
},
"required": [
"view",
"apiVersion",
"generatedAt",
"params",
"hardware",
"count"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "calculator",
"apiVersion": "v1",
"generatedAt": "2026-08-20",
"params": {
"model": "DeepSeek-V4-Pro",
"sequence": "1k/1k",
"precisions": [
"fp4"
],
"target": 35,
"mode": "interactivity-to-throughput",
"costProvider": "costh",
"costType": "total",
"percentile": "p90",
"gpus": [],
"format": "json"
},
"hardware": [
{
"hwKey": "b300_sglang",
"resultKey": "b300_sglang",
"precision": "fp4",
"label": "B300 (SGLang)",
"value": 1234.5,
"inputThroughput": 820.1,
"outputThroughput": 414.4,
"cost": {
"total": 1.21,
"input": 1.83,
"output": 3.62
},
"tpPerMw": 890123.4,
"inputTpPerMw": 591234.5,
"outputTpPerMw": 298888.9,
"concurrency": 24,
"cacheHitRate": null,
"inputTokenShare": 0.5,
"clamped": false,
"clampedAbove": false,
"clampedBelow": false,
"nearest": {
"below": {
"interactivity": 30,
"throughput": 1500,
"concurrency": 32
},
"above": {
"interactivity": 50,
"throughput": 900,
"concurrency": 16
}
}
}
],
"count": 1
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string",
"description": "One flat row per hardware result."
}响应示例
代码
hwKey,resultKey,precision,label,value,inputThroughput,outputThroughput,costTotal,costInput,costOutput,tpPerMw,concurrency,clamped,clampedAbove,clampedBelow
b300_sglang,b300_sglang,fp4,B300 (SGLang),1234.5,820.1,414.4,1.21,1.83,3.62,890123.4,24,false,false,false400
参数无效。响应体给出参数名；枚举类参数还会给出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
},
"param": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"error": "Unknown mode: sideways",
"param": "mode",
"allowed": [
"interactivity-to-throughput",
"throughput-to-interactivity"
]
}500
计算器视图构建失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
},
"param": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/fleet集群生命周期经济性
在默认 35 tok/s/user 目标下，按设施功率预算为每种芯片确定固定集群规模，并沿模型生命周期投影收入、成本与利润。每种芯片沿其实测的最优演进阶梯前进：某一运行日期的最佳配置若超过此前所有配置，即构成一个台阶，并按 ramp 逐步生效。价格默认取最便宜集群的盈亏平衡价，输出:输入价格比固定为 4。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| cache | query | number | 可选 | 按缓存读取折扣计费的缓存输入百分比。仅适用于 agentic traces。 | 10 |
| costProvider | query | string | 可选 | costh 为自有成本，costr 为租赁成本。利润视图还支持 custom，需配合 customCosts。不支持 costn。 | |
| costType | query | string | 可选 | total（默认）、input 或 output token。分离式输入和输出速率保留各自的 prefill、decode 分母。 | |
| format | query | enum | 可选 | 响应编码。 | json |
| gpus | query | CSV list | 可选 | 以逗号分隔的硬件键；可匹配完整 hwKey（b300_sglang）或基础芯片（b300）。 | b300,mi355x |
| horizon | query | number | 可选 | 投影时长（月）。默认在最后一次实测扫描后再留一小段。 | 12 |
| metric | query | enum | 可选 | 每个点的 value 字段所对应的指标。 | margin |
| model | query | string | 必填 | 展示模型名称或对比 slug。 | DeepSeek-V4-Pro |
| mtbi | query | number | 可选 | 平均中断间隔（天）。 | 24 |
| mw | query | number | 必填 | 设施功率预算（MW），必须大于 0。 | 100 |
| oprice | query | number | 可选 | 输出 token 价格（$/M token）。默认取输入价格的 4 倍。 | 1.68 |
| percentile | query | enum | 可选 | agentic traces 的交互性分位数；固定序列使用中位数。 | p90 |
| precisions | query | CSV list | 可选 | 以逗号分隔的精度列表。省略时自动选择数据中曲线最密的精度。 | fp4 |
| price | query | number | 可选 | 输入 token 价格（$/M token）。默认取最便宜集群的盈亏平衡价；只给 oprice 时按 4 倍比例推导。 | 0.42 |
| ramp | query | number | 可选 | 每次配置上线达到满负荷所需的月数。默认与仪表板生命周期面板一致（0.5）。 | 0.5 |
| recovery | query | number | 可选 | 每次中断的恢复时间（小时）。 | 12 |
| sequence | query | enum | 可选 | 负载序列。支持 1k/1k、1k/8k、8k/1k（或连字符形式）以及 agentic-traces（别名 agentic）。 | 8k/1k |
| target | query | string | 可选 | 正数工作点目标；交互性转吞吐量模式下单位为 tok/s/user。利润视图按模型设置默认值。 | |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/fleet?model=DeepSeek-V4-Pro&mw=100'响应
FleetView200
每种芯片一条生命周期经济性序列：按功率预算确定固定集群规模，并沿模型生命周期投影每次实测到的配置改进。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"fleet"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"generatedAt": {
"type": [
"string",
"null"
],
"description": "Latest run date among the history rows the view was computed from."
},
"params": {
"type": "object",
"additionalProperties": true
},
"assumptions": {
"type": "object",
"additionalProperties": true
},
"series": {
"type": "array",
"items": {
"type": "object",
"properties": {
"hwKey": {
"type": "string",
"description": "Base chip key, e.g. b300."
},
"label": {
"type": "string"
},
"hwKeysUsed": {
"type": "array",
"items": {
"type": "string"
},
"description": "Every config that contributed a rung, in takeover order."
},
"disagg": {
"type": "boolean"
},
"gpus": {
"type": "integer"
},
"provisionedMw": {
"type": "number"
},
"costPerHour": {
"type": "number"
},
"concurrentUsersNow": {
"type": "number"
},
"availability": {
"type": "number"
},
"breakEvenPricePerMTok": {
"type": [
"number",
"null"
]
},
"improvementFactor": {
"type": [
"number",
"null"
]
},
"improvementCount": {
"type": "integer"
},
"paybackMonth": {
"type": [
"number",
"null"
]
},
"lifetimeMargin": {
"type": "number"
},
"revenuePerDay": {
"type": "number"
},
"costPerDay": {
"type": "number"
},
"marginPerDay": {
"type": "number"
},
"startMonth": {
"type": "number"
},
"endMonth": {
"type": "number"
},
"rampEndMonth": {
"type": [
"number",
"null"
]
},
"points": {
"type": "array",
"items": {
"type": "object",
"properties": {
"month": {
"type": "number",
"description": "Months since the anchor date (model release)."
},
"value": {
"type": "number",
"description": "The selected metric at this point."
},
"revenue": {
"type": "number",
"description": "$/day"
},
"cost": {
"type": "number",
"description": "$/day"
},
"margin": {
"type": "number",
"description": "$/day"
},
"revenuePerMw": {
"type": "number",
"description": "$/MW/day"
},
"marginPerMw": {
"type": "number",
"description": "$/MW/day"
},
"cumulative": {
"type": "number",
"description": "Cumulative margin, $"
},
"cumulativeRevenue": {
"type": "number",
"description": "Cumulative revenue, $"
},
"isStep": {
"type": "boolean"
},
"isRamp": {
"type": "boolean"
}
},
"required": [
"month",
"value",
"revenue",
"cost",
"margin",
"revenuePerMw",
"marginPerMw",
"cumulative",
"cumulativeRevenue",
"isStep",
"isRamp"
],
"additionalProperties": false
}
}
},
"required": [
"hwKey",
"label",
"hwKeysUsed",
"disagg",
"gpus",
"provisionedMw",
"costPerHour",
"concurrentUsersNow",
"availability",
"breakEvenPricePerMTok",
"points"
],
"additionalProperties": true
}
},
"count": {
"type": "integer"
}
},
"required": [
"view",
"apiVersion",
"generatedAt",
"params",
"assumptions",
"series",
"count"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "fleet",
"apiVersion": "v1",
"generatedAt": "2026-08-20",
"params": {
"model": "DeepSeek-V4-Pro",
"sequence": "8k/1k",
"precisions": [
"fp4"
],
"mw": 100,
"price": 0.42,
"oprice": 1.68,
"ramp": 0.5,
"cache": 10,
"mtbi": 24,
"recovery": 12,
"horizon": 7,
"metric": "margin",
"percentile": "p90",
"gpus": [],
"format": "json"
},
"assumptions": {
"target": 35,
"costProvider": "costh",
"costType": "total",
"mtbiDays": 24,
"recoveryHours": 12,
"inputPricePerMTok": 0.42,
"outputPricePerMTok": 1.68,
"outputPriceMultiple": 4,
"rampMonths": 0.5,
"cachedInputPct": 10,
"cacheReadRatio": 1,
"availability": 0.98,
"breakEvenPricePerMTok": 0.42,
"anchorDate": "2026-04-24",
"horizonMonths": 7
},
"series": [
{
"hwKey": "b300",
"label": "B300",
"hwKeysUsed": [
"b300_sglang"
],
"disagg": false,
"gpus": 70921,
"provisionedMw": 99.99,
"costPerHour": 212763,
"concurrentUsersNow": 2500000,
"availability": 0.98,
"breakEvenPricePerMTok": 0.42,
"improvementFactor": 1.33,
"improvementCount": 1,
"paybackMonth": null,
"lifetimeMargin": 0,
"points": [
{
"month": 1.25,
"value": -1250000,
"revenue": 3860000,
"cost": 5110000,
"margin": -1250000,
"revenuePerMw": 38600,
"marginPerMw": -12500,
"cumulative": -38000000,
"cumulativeRevenue": 117000000,
"isStep": true,
"isRamp": true
}
]
}
],
"count": 1
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string",
"description": "One row per lifecycle point."
}响应示例
代码
hwKey,label,month,value,revenue,cost,margin,revenuePerMw,marginPerMw,cumulative,cumulativeRevenue,isStep,isRamp
b300,B300,1.25,-1250000,3860000,5110000,-1250000,38600,-12500,-38000000,117000000,true,true400
参数无效或缺失。响应体给出参数名；枚举类参数还会给出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
},
"param": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"error": "mw is required (facility power budget in MW, > 0)",
"param": "mw"
}500
集群视图构建失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
},
"param": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/evaluation获取评测图表视图
返回 /evaluation 页面为指定模型、基准和运行日期渲染的聚合评测柱状数据：每个配置取最新数据，同配置的重试合并为一行（score 为平均值，stderr 覆盖最小/最大误差范围，n 为参与平均的运行次数）。benchmarks 列出该模型的全部可用基准。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| unofficialrun | query | string | 可选 | 最多八个公开 CI 运行 ID，以逗号分隔。去除各项首尾空白和重复 ID 后，按剩余顺序分配运行索引。叠加结果与官方数据分开。 | |
| benchmark | query | string | 可选 | 评测任务键（例如 gsm8k）。默认取该模型可用基准中按字母序的第一个。传入未知值会返回 400，并列出可用基准。 | gsm8k |
| date | query | date | 可选 | 请求的评测运行日期（YYYY-MM-DD），会像页面一样解析到最接近的可用日期。默认使用最新可用日期。 | 2026-08-20 |
| format | query | enum | 可选 | 响应编码。csv 为每个配置返回一行平面数据，标签中的换行会被展平。 | json |
| gpus | query | string | 可选 | 以逗号分隔的硬件或配置键；gpu-metrics 使用数字芯片索引。省略时选择全部。 | |
| model | query | string | 必填 | 展示模型名称（不区分大小写）或对比页 slug。 | DeepSeek-V4-Pro |
| precisions | query | CSV list | 可选 | 以逗号分隔的精度过滤（fp4、fp4fp8、fp8、bf16、int4）。默认包含该模型评测数据中出现的全部精度。 | fp8 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/evaluation?model=DeepSeek-V4-Pro&benchmark=gsm8k&format=json'响应
EvaluationView200
按解析后的模型、基准和日期聚合的评测图表数据行。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"evaluation"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"properties": {
"model": {
"type": "string"
},
"benchmark": {
"type": [
"string",
"null"
]
},
"date": {
"type": [
"string",
"null"
],
"format": "date"
},
"precisions": {
"type": "array",
"items": {
"type": "string"
}
},
"gpus": {
"type": "array",
"items": {
"type": "string"
}
},
"unofficialrun": {
"type": [
"string",
"null"
]
},
"format": {
"type": "string",
"enum": [
"json",
"csv"
]
}
},
"required": [
"model",
"benchmark",
"date",
"precisions",
"gpus",
"unofficialrun",
"format"
],
"additionalProperties": false
},
"benchmarks": {
"type": "array",
"items": {
"type": "string"
}
},
"rows": {
"type": "array",
"items": {
"type": "object",
"properties": {
"source": {
"type": "string"
},
"hwKey": {
"type": "string"
},
"label": {
"type": "string"
},
"score": {
"type": "number"
},
"stderr": {
"type": "number"
},
"n": {
"type": "integer",
"description": "How many repeated runs (retries/reruns) the row averages."
},
"precision": {
"type": "string"
},
"framework": {
"type": "string"
},
"date": {
"type": "string",
"format": "date"
}
},
"required": [
"source",
"hwKey",
"label",
"score",
"stderr",
"n",
"precision",
"framework",
"date"
],
"additionalProperties": false
}
}
},
"required": [
"view",
"apiVersion",
"params",
"benchmarks",
"rows"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "evaluation",
"apiVersion": "v1",
"params": {
"model": "DeepSeek-V4-Pro",
"benchmark": "gsm8k",
"date": "2026-08-20",
"precisions": [
"fp8"
],
"format": "json",
"gpus": [],
"unofficialrun": null
},
"benchmarks": [
"aime25",
"gsm8k"
],
"rows": [
{
"source": "official",
"hwKey": "h200_sglang",
"label": "H200 (SGLang)\nC128 T8 E1",
"score": 0.85,
"stderr": 0.01,
"n": 2,
"precision": "fp8",
"framework": "sglang",
"date": "2026-08-20"
}
]
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
hwKey,label,score,stderr,n,precision,framework,date
h200_sglang,H200 (SGLang) C128 T8 E1,0.85,0.01,2,fp8,sglang,2026-08-20400
model、benchmark、date、precisions 或 format 参数无效。响应体会列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown benchmark for DeepSeek-V4-Pro: mmlu",
"param": "benchmark",
"allowed": [
"aime25",
"gsm8k"
]
}500
评测数据查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/reliability获取可靠性图表视图
返回 /reliability 页面图表渲染的各硬件基准运行成功率聚合结果，按滚动时间范围预设分桶。成功率为百分比，保留 2 位小数；generatedFrom 给出底层运行统计数据的最早与最晚日期。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| asOf | query | string | 可选 | 用于复现滚动可靠性或镜像日期差计算的参考日期 YYYY-MM-DD。 | |
| format | query | enum | 可选 | 响应编码。csv 为每个硬件返回一行平面数据。 | json |
| gpus | query | string | 可选 | 以逗号分隔的硬件或配置键；gpu-metrics 使用数字芯片索引。省略时选择全部。 | |
| range | query | enum | 可选 | 聚合使用的滚动时间范围预设，与 /reliability 页面的预设一致。 | last-7-days |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/reliability?range=last-7-days&format=json'响应
ReliabilityView200
所选时间范围内每个硬件的聚合成功率。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"reliability"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"properties": {
"range": {
"type": "string",
"enum": [
"last-3-days",
"last-7-days",
"last-month",
"last-3-months",
"all-time"
]
},
"format": {
"type": "string",
"enum": [
"json",
"csv"
]
},
"gpus": {
"type": "array",
"items": {
"type": "string"
}
},
"asOf": {
"type": [
"string",
"null"
],
"format": "date"
}
},
"required": [
"range",
"format",
"gpus",
"asOf"
],
"additionalProperties": false
},
"range": {
"type": "string",
"enum": [
"last-3-days",
"last-7-days",
"last-month",
"last-3-months",
"all-time"
]
},
"hardware": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"label": {
"type": "string"
},
"successRate": {
"type": "number",
"description": "Success percentage over the range, rounded to 2 decimal places."
},
"successes": {
"type": "integer"
},
"total": {
"type": "integer"
}
},
"required": [
"key",
"label",
"successRate",
"successes",
"total"
],
"additionalProperties": false
}
},
"generatedFrom": {
"type": "object",
"properties": {
"firstDate": {
"type": [
"string",
"null"
],
"format": "date"
},
"lastDate": {
"type": [
"string",
"null"
],
"format": "date"
}
},
"required": [
"firstDate",
"lastDate"
],
"additionalProperties": false
}
},
"required": [
"view",
"apiVersion",
"params",
"range",
"hardware",
"generatedFrom"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "reliability",
"apiVersion": "v1",
"params": {
"range": "last-7-days",
"format": "json",
"gpus": [],
"asOf": null
},
"range": "last-7-days",
"hardware": [
{
"key": "h200",
"label": "H200",
"successRate": 93.33,
"successes": 28,
"total": 30
},
{
"key": "b200",
"label": "B200",
"successRate": 90,
"successes": 27,
"total": 30
}
],
"generatedFrom": {
"firstDate": "2025-11-03",
"lastDate": "2026-08-26"
}
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
range,key,label,successRate,successes,total
last-7-days,h200,H200,93.33,28,30400
range 或 format 参数无效。响应体会列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown range: last-year",
"param": "range",
"allowed": [
"last-3-days",
"last-7-days",
"last-month",
"last-3-months",
"all-time"
]
}500
可靠性数据查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/gpu-specs获取 GPU 规格视图
返回 /gpu-specs 页面背后的静态芯片规格表——可用显存、带宽、稠密 Tensor Core TFLOP/s，以及 scale-up/scale-out 互连细节——并附带可作图指标的元数据。不读取数据库；算力为稠密（不含稀疏）值，显存容量为驱动可用值。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| format | query | enum | 可选 | 响应编码。csv 为每个芯片返回一行平面数据。 | json |
| metric | query | enum | 可选 | 图表指标键。设置后响应会附加 ranking 数组，按该指标降序排列芯片（无该指标值的芯片不参与排名）。 | memoryBandwidth |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/gpu-specs?metric=memoryBandwidth&format=json'响应
GpuSpecsView200
静态芯片规格与图表指标元数据；仅在设置 metric 时返回 ranking。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"gpu-specs"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"properties": {
"metric": {
"type": [
"string",
"null"
]
},
"format": {
"type": "string",
"enum": [
"json",
"csv"
]
}
},
"required": [
"metric",
"format"
],
"additionalProperties": false
},
"chips": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"label": {
"type": "string"
},
"name": {
"type": "string"
},
"vendor": {
"type": "string",
"enum": [
"nvidia",
"amd"
]
},
"memory": {
"type": "string"
},
"memoryType": {
"type": "string"
},
"memoryBandwidth": {
"type": "string"
},
"fp4": {
"type": [
"number",
"null"
]
},
"fp8": {
"type": "number"
},
"bf16": {
"type": "number"
},
"scaleUpTech": {
"type": "string"
},
"scaleUpBandwidth": {
"type": "string"
},
"scaleUpWorldSize": {
"type": "integer"
},
"scaleOutBandwidth": {
"type": [
"string",
"null"
]
},
"scaleOutTech": {
"type": [
"string",
"null"
]
},
"nic": {
"type": [
"string",
"null"
]
},
"scaleOutSwitch": {
"type": [
"string",
"null"
]
},
"scaleOutTopology": {
"type": [
"string",
"null"
]
},
"scaleUpTopology": {
"type": "string"
},
"scaleUpSwitch": {
"type": [
"string",
"null"
]
},
"memoryGB": {
"type": [
"number",
"null"
]
},
"memoryBandwidthTBs": {
"type": [
"number",
"null"
]
},
"fp4Tflops": {
"type": [
"number",
"null"
]
},
"fp8Tflops": {
"type": "number"
},
"bf16Tflops": {
"type": "number"
},
"scaleUpBandwidthGBs": {
"type": [
"number",
"null"
]
},
"domainMemoryTB": {
"type": "number"
},
"domainMemoryBandwidthTBs": {
"type": "number"
},
"scaleOutBandwidthGbits": {
"type": [
"number",
"null"
]
}
},
"required": [
"key",
"label",
"name",
"vendor",
"memory",
"memoryType",
"memoryBandwidth",
"fp4",
"fp8",
"bf16",
"scaleUpTech",
"scaleUpBandwidth",
"scaleUpWorldSize",
"scaleOutBandwidth",
"scaleOutTech",
"nic",
"scaleOutSwitch",
"scaleOutTopology",
"scaleUpTopology",
"scaleUpSwitch",
"memoryGB",
"memoryBandwidthTBs",
"fp4Tflops",
"fp8Tflops",
"bf16Tflops",
"scaleUpBandwidthGBs",
"domainMemoryTB",
"domainMemoryBandwidthTBs",
"scaleOutBandwidthGbits"
],
"additionalProperties": false
}
},
"metrics": {
"type": "array",
"items": {
"type": "object",
"properties": {
"key": {
"type": "string"
},
"label": {
"type": "string"
},
"unit": {
"type": "string"
}
},
"required": [
"key",
"label",
"unit"
],
"additionalProperties": false
}
},
"ranking": {
"type": "array",
"items": {
"type": "object",
"properties": {
"chip": {
"type": "string"
},
"label": {
"type": "string"
},
"value": {
"type": "number"
},
"rank": {
"type": "integer"
}
},
"required": [
"chip",
"label",
"value",
"rank"
],
"additionalProperties": false
}
}
},
"required": [
"view",
"apiVersion",
"params",
"chips",
"metrics"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "gpu-specs",
"apiVersion": "v1",
"params": {
"metric": "memoryBandwidth",
"format": "json"
},
"chips": [
{
"key": "b200-sxm",
"label": "B200 SXM",
"name": "B200 SXM",
"vendor": "nvidia",
"memory": "180 GB",
"memoryType": "HBM3e",
"memoryBandwidth": "8 TB/s",
"fp4": 9000,
"fp8": 4500,
"bf16": 2250,
"scaleUpTech": "NVLink 5.0",
"scaleUpBandwidth": "900 GB/s",
"scaleUpWorldSize": 8,
"scaleOutBandwidth": "400 Gbit/s",
"scaleOutTech": "gIB RoCEv2 Ethernet",
"nic": "ConnectX-7 400GbE",
"scaleOutSwitch": "12.8T Whitebox Leaf Tomahawk3 & 25.6T Whitebox Tomahawk4",
"scaleOutTopology": "4-rail optimized",
"scaleUpTopology": "Switched 2-rail Optimized",
"scaleUpSwitch": "28.8Tbit/s NVSwitch Gen 4.0",
"memoryGB": 180,
"memoryBandwidthTBs": 8,
"fp4Tflops": 9000,
"fp8Tflops": 4500,
"bf16Tflops": 2250,
"scaleUpBandwidthGBs": 900,
"domainMemoryTB": 1.44,
"domainMemoryBandwidthTBs": 64,
"scaleOutBandwidthGbits": 400
}
],
"metrics": [
{
"key": "memory",
"label": "Memory",
"unit": "GB"
},
{
"key": "memoryBandwidth",
"label": "Mem BW",
"unit": "TB/s"
}
],
"ranking": [
{
"chip": "b200-sxm",
"label": "B200 SXM",
"value": 8,
"rank": 1
}
]
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
key,label,name,vendor,memory,memoryType,memoryBandwidth,fp4,fp8,bf16
b200-sxm,B200 SXM,B200 SXM,nvidia,180 GB,HBM3e,8 TB/s,9000,4500,2250400
metric 或 format 参数无效。响应体会列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown metric: tdp",
"param": "metric",
"allowed": [
"memory",
"memoryBandwidth",
"fp4",
"fp8",
"bf16",
"scaleUpBandwidth",
"scaleUpWorldSize",
"domainMemory",
"domainMemoryBandwidth",
"scaleOutBandwidth"
]
}滚动查看完整示例。
500
GPU 规格数据组装失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/overview获取总览成本矩阵视图
以数据形式返回 /overview 页面的矩阵：对每个精选「模型-场景」行，给出各硬件在请求交互性档位下最优的社区（或全部引擎）推理配置，包含每百万 token 成本、每 GPU 吞吐、相对参照 GPU 或历史窗口的差值，以及胜出配置。与页面不同，无效参数会返回 400，而不是被静默归一化。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| compare | query | string | 可选 | 对比模式：hardware 表示与参照 GPU 对比；7d/30d/60d/90d 表示与相应天数之前的同一单元格对比。 | hardware |
| engine | query | string | 可选 | 推理引擎范围：仅社区框架，或包含厂商自研栈在内的全部引擎。 | community |
| format | query | string | 可选 | 响应格式。CSV 为每个「模型-场景-硬件」单元格返回一行平面数据。 | json |
| hwrows | query | string | 可选 | 硬件单元格范围：仅有定价测量值的单元格，或全部硬件列。 | all |
| models | query | string | 可选 | 模型范围：默认精选集合，或全部有数据的模型。 | default |
| ref | query | string | 可选 | compare=hardware 时用于计算差值的参照 GPU。 | b200 |
| rows | query | string | 可选 | 历史窗口下的行范围：仅窗口内发生变化的行，或全部行。 | all |
| tier | query | integer | 可选 | 交互性档位，单位为每用户每秒输出 token。所有单元格按该档位读取。 | 50 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/overview?tier=50&engine=community&compare=hardware&ref=b200'响应
OverviewView200
请求档位下的总览成本矩阵：每个「模型-场景」一行，每个硬件列一个单元格。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"overview"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"generatedAt": {
"type": [
"string",
"null"
],
"format": "date"
},
"params": {
"type": "object",
"properties": {
"tier": {
"type": "integer"
},
"engine": {
"type": "string"
},
"compare": {
"type": "string"
},
"ref": {
"type": "string"
},
"models": {
"type": "string"
},
"rows": {
"type": "string"
},
"hwrows": {
"type": "string"
},
"format": {
"type": "string",
"enum": [
"json",
"csv"
]
}
},
"required": [
"tier",
"engine",
"compare",
"ref",
"models",
"rows",
"hwrows",
"format"
],
"additionalProperties": false
},
"tiers": {
"type": "array",
"items": {
"type": "integer"
}
},
"scenarios": {
"type": "array",
"items": {
"type": "string"
}
},
"referenceHardware": {
"type": "string"
},
"historicalWindow": {
"type": [
"object",
"null"
],
"properties": {
"key": {
"type": "string"
},
"snapshotDate": {
"type": "string"
},
"targetDate": {
"type": "string"
},
"earliestDate": {
"type": "string"
}
},
"additionalProperties": true
},
"unchangedRowCount": {
"type": "integer"
},
"emptyRowCount": {
"type": "integer"
},
"rows": {
"type": "array",
"items": {
"type": "object",
"properties": {
"model": {
"type": "string"
},
"modelLabel": {
"type": "string"
},
"category": {
"type": "string"
},
"scenario": {
"type": "string",
"enum": [
"single_turn_8k1k",
"agentx"
]
},
"cells": {
"type": "array",
"items": {
"type": "object",
"properties": {
"hardware": {
"type": "string"
},
"hardwareLabel": {
"type": "string"
},
"costPerMtok": {
"type": [
"number",
"null"
]
},
"throughputPerGpu": {
"type": [
"number",
"null"
]
},
"estimated": {
"type": "boolean"
},
"deltaVsRefPct": {
"type": [
"number",
"null"
]
},
"missingReason": {
"type": [
"string",
"null"
]
},
"config": {
"type": [
"object",
"null"
],
"properties": {
"framework": {
"type": "string"
},
"frameworkLabel": {
"type": "string"
},
"precision": {
"type": "string"
},
"specMethod": {
"type": "string"
},
"specLabel": {
"type": [
"string",
"null"
]
},
"disagg": {
"type": "boolean"
},
"multinode": {
"type": "boolean"
},
"latestDate": {
"type": [
"string",
"null"
]
}
},
"additionalProperties": false
},
"history": {
"type": "object",
"properties": {
"status": {
"type": "string"
},
"baselineCostPerMtok": {
"type": [
"number",
"null"
]
},
"costDeltaPct": {
"type": [
"number",
"null"
]
},
"baselineDate": {
"type": [
"string",
"null"
]
}
},
"additionalProperties": false
}
},
"required": [
"hardware",
"hardwareLabel",
"costPerMtok",
"throughputPerGpu",
"estimated",
"deltaVsRefPct",
"missingReason",
"config"
],
"additionalProperties": false
}
}
},
"required": [
"model",
"modelLabel",
"category",
"scenario",
"cells"
],
"additionalProperties": false
}
}
},
"required": [
"view",
"apiVersion",
"generatedAt",
"params",
"tiers",
"scenarios",
"referenceHardware",
"historicalWindow",
"unchangedRowCount",
"emptyRowCount",
"rows"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "overview",
"apiVersion": "v1",
"generatedAt": "2026-08-20",
"params": {
"tier": 50,
"engine": "community",
"compare": "hardware",
"ref": "b200",
"models": "default",
"rows": "all",
"hwrows": "all",
"format": "json"
},
"tiers": [
30,
50,
75,
100,
150,
200
],
"scenarios": [
"single_turn_8k1k",
"agentx"
],
"referenceHardware": "b200",
"historicalWindow": null,
"unchangedRowCount": 0,
"emptyRowCount": 0,
"rows": [
{
"model": "DeepSeek-V4-Pro",
"modelLabel": "DeepSeekv4 Pro 0813 1.6T",
"category": "frontier",
"scenario": "agentx",
"cells": [
{
"hardware": "b200",
"hardwareLabel": "B200",
"costPerMtok": 0.42,
"throughputPerGpu": 1315.2,
"estimated": false,
"deltaVsRefPct": null,
"missingReason": null,
"config": {
"framework": "sglang",
"frameworkLabel": "SGLang",
"precision": "fp8",
"specMethod": "mtp",
"specLabel": "MTP",
"disagg": true,
"multinode": false,
"latestDate": "2026-08-20"
}
}
]
}
]
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
model,scenario,tier,hardware,cost_per_mtok,throughput_per_gpu,estimated,delta_vs_ref_pct,missing_reason,framework,precision,spec_method,disagg,multinode,history_status,baseline_cost_per_mtok,history_delta_pct,baseline_date
DeepSeek-V4-Pro,agentx,50,b200,0.42,1315.2,false,,,SGLang,fp8,mtp,true,false,,,,400
参数无效。响应体会指出参数名并列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown tier: 42",
"param": "tier",
"allowed": [
"30",
"50",
"75",
"100",
"150",
"200"
]
}500
总览数据组装失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/rankings获取 GPU 排名视图
以数据形式返回 /rankings 页面：按模型与场景，在主交互性档位下依最优社区推理配置对硬件排序 — fastest-gpu 按每 GPU tok/s，cheapest-gpu 按每百万 token 成本。每行包含胜出的框架、精度和 disagg 标志；芯片字段将各硬件对应到 /chips 注册表中的 slug。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| format | query | string | 可选 | 响应格式。CSV 为每个上榜硬件返回一行平面数据。 | json |
| kind | query | string | 可选 | 排名类型：fastest-gpu 按每 GPU tok/s 降序，cheapest-gpu 按每百万 token 成本升序。 | cheapest-gpu |
| model | query | string | 可选 | 展示模型名称（不区分大小写）或对比页 slug。默认为全部有排名的模型；无可测数据的模型在全量结果中会被省略，显式指定时则保留。 | DeepSeek-V4-Pro |
| scenario | query | string | 可选 | 工作负载场景。别名：8k-1k 对应 single_turn_8k1k，agentic 对应 agentx。默认为每个模型在 /overview 矩阵中精选的全部场景。 | agentx |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/rankings?kind=cheapest-gpu&model=DeepSeek-V4-Pro&scenario=agentx'响应
RankingsView200
主档位（每用户 50 tok/s）、社区引擎范围下，每个「模型-场景」的硬件排名。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"rankings"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"generatedAt": {
"type": [
"string",
"null"
],
"format": "date"
},
"params": {
"type": "object",
"properties": {
"kind": {
"type": "string"
},
"model": {
"type": "string"
},
"scenario": {
"type": "string"
},
"tier": {
"type": "integer"
},
"engine": {
"type": "string"
},
"format": {
"type": "string",
"enum": [
"json",
"csv"
]
}
},
"required": [
"kind",
"model",
"scenario",
"tier",
"engine",
"format"
],
"additionalProperties": false
},
"kind": {
"type": "string",
"enum": [
"fastest-gpu",
"cheapest-gpu"
]
},
"tier": {
"type": "integer"
},
"entries": {
"type": "array",
"items": {
"type": "object",
"properties": {
"model": {
"type": "string"
},
"modelSlug": {
"type": "string"
},
"modelLabel": {
"type": "string"
},
"scenario": {
"type": "string",
"enum": [
"single_turn_8k1k",
"agentx"
]
},
"rows": {
"type": "array",
"items": {
"type": "object",
"properties": {
"rank": {
"type": "integer"
},
"hardware": {
"type": "string"
},
"hardwareLabel": {
"type": "string"
},
"chip": {
"type": [
"string",
"null"
]
},
"value": {
"type": [
"number",
"null"
]
},
"unit": {
"type": "string",
"enum": [
"tokens_per_second_per_gpu",
"usd_per_million_tokens"
]
},
"framework": {
"type": [
"string",
"null"
]
},
"precision": {
"type": [
"string",
"null"
]
},
"disagg": {
"type": [
"boolean",
"null"
]
}
},
"required": [
"rank",
"hardware",
"hardwareLabel",
"chip",
"value",
"unit",
"framework",
"precision",
"disagg"
],
"additionalProperties": false
}
}
},
"required": [
"model",
"modelSlug",
"modelLabel",
"scenario",
"rows"
],
"additionalProperties": false
}
}
},
"required": [
"view",
"apiVersion",
"generatedAt",
"params",
"kind",
"tier",
"entries"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "rankings",
"apiVersion": "v1",
"generatedAt": "2026-08-20",
"params": {
"kind": "cheapest-gpu",
"model": "DeepSeek-V4-Pro",
"scenario": "agentx",
"tier": 50,
"engine": "community",
"format": "json"
},
"kind": "cheapest-gpu",
"tier": 50,
"entries": [
{
"model": "DeepSeek-V4-Pro",
"modelSlug": "deepseek-v4",
"modelLabel": "DeepSeekv4 Pro 0813 1.6T",
"scenario": "agentx",
"rows": [
{
"rank": 1,
"hardware": "b200",
"hardwareLabel": "B200",
"chip": "b200",
"value": 0.42,
"unit": "usd_per_million_tokens",
"framework": "SGLang",
"precision": "fp8",
"disagg": true
}
]
}
]
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
kind,model,model_slug,scenario,tier,rank,hardware,hardware_label,chip,value,unit,framework,precision,disagg
cheapest-gpu,DeepSeek-V4-Pro,deepseek-v4,agentx,50,1,b200,B200,b200,0.42,usd_per_million_tokens,SGLang,fp8,true400
kind、model、scenario 或 format 参数无效。响应体会指出参数名并列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown kind: slowest-gpu",
"param": "kind",
"allowed": [
"fastest-gpu",
"cheapest-gpu"
]
}500
排名数据查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/compare获取 GPU 组合对比视图
以数据形式返回 /compare 页面：对一个模型和两块 GPU，使用与页面相同的插值管线给出各交互性档位下的吞吐、成本和能效，并标注每档位胜者与整体对比摘要。支持自定义档位以及 per-dollar、precision、spec-decode 变体。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| format | query | string | 可选 | 响应格式。CSV 为每个档位返回一行平面数据。 | json |
| gpus | query | CSV GPU list | 可选 | 恰好 2 个不同的 GPU 基础键，以逗号分隔（例如 b200,mi355x）。未知键返回 400 并列出允许的取值。 | b200,mi355x |
| model | query | string | 可选 | 展示模型名称（不区分大小写）或对比页模型 slug。与 gpus 搭配使用，可替代 slug。 | DeepSeek-V4-Pro |
| scenario | query | string | 可选 | 工作负载序列。别名：8k-1k、1k-1k、1k-8k、agentic。默认为页面选取的组合默认值（AgentX 精选模型回退到 agentic-traces，其余为 8k/1k）。 | 8k/1k |
| slug | query | string | 可选 | 对比页 slug，格式为 <model>-<gpuA>-vs-<gpuB>。slug 与 model+gpus 二选一；GPU 顺序会像页面跳转一样归一化。 | deepseek-v4-b200-vs-mi355x |
| tiers | query | CSV number list | 可选 | 自定义交互性目标（每用户 tok/s），逗号分隔，最多 12 个。默认为页面在共同测量范围内选取的 3 个目标。超出测量范围的档位会被忽略。 | 25,50,75 |
| variant | query | string | 可选 | 视图变体。per-dollar 将胜负与差值的比较基准从吞吐切换为每百万 token 成本；precision 增加按精度的对比摘要；spec-decode 增加按投机解码方法的拆分（仅固定序列场景）。 | per-dollar |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/compare?slug=deepseek-v4-b200-vs-mi355x'响应
CompareView200
在生效场景与精度下该 GPU 组合的逐档位插值对比表，以及双方摘要。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"compare"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"generatedAt": {
"type": [
"string",
"null"
],
"format": "date"
},
"params": {
"type": "object",
"properties": {
"slug": {
"type": "string"
},
"model": {
"type": "string"
},
"gpus": {
"type": "array",
"items": {
"type": "string"
}
},
"scenario": {
"type": "string"
},
"variant": {
"type": "string"
},
"tiers": {
"oneOf": [
{
"type": "string",
"enum": [
"default"
]
},
{
"type": "array",
"items": {
"type": "number"
}
}
]
},
"format": {
"type": "string",
"enum": [
"json",
"csv"
]
}
},
"additionalProperties": false
},
"model": {
"type": "object",
"properties": {
"slug": {
"type": "string"
},
"displayName": {
"type": "string"
},
"label": {
"type": "string"
}
},
"required": [
"slug",
"displayName",
"label"
],
"additionalProperties": false
},
"gpus": {
"type": "array",
"items": {
"type": "string"
}
},
"scenario": {
"type": [
"string",
"null"
]
},
"precision": {
"type": [
"string",
"null"
]
},
"variant": {
"type": "string"
},
"tiers": {
"type": "array",
"items": {
"type": "number"
}
},
"interactivityRange": {
"type": "object",
"properties": {
"min": {
"type": "number"
},
"max": {
"type": "number"
}
},
"required": [
"min",
"max"
],
"additionalProperties": false
},
"dataRange": {
"type": "object",
"properties": {
"oldest": {
"type": [
"string",
"null"
]
},
"newest": {
"type": [
"string",
"null"
]
}
},
"required": [
"oldest",
"newest"
],
"additionalProperties": false
},
"table": {
"type": "array",
"items": {
"type": "object",
"properties": {
"tier": {
"type": "number"
},
"a": {
"type": [
"object",
"null"
],
"properties": {
"hardware": {
"type": "string"
},
"configKey": {
"type": "string"
},
"throughputPerGpu": {
"type": "number"
},
"inputThroughputPerGpu": {
"type": "number"
},
"outputThroughputPerGpu": {
"type": "number"
},
"costPerMtok": {
"type": "number"
},
"costPerMtokInput": {
"type": "number"
},
"costPerMtokOutput": {
"type": "number"
},
"throughputPerMw": {
"type": "number"
},
"concurrency": {
"type": "number"
},
"precision": {
"type": [
"string",
"null"
]
},
"clamped": {
"type": "boolean"
}
},
"additionalProperties": false
},
"b": {
"type": [
"object",
"null"
],
"properties": {
"hardware": {
"type": "string"
},
"configKey": {
"type": "string"
},
"throughputPerGpu": {
"type": "number"
},
"inputThroughputPerGpu": {
"type": "number"
},
"outputThroughputPerGpu": {
"type": "number"
},
"costPerMtok": {
"type": "number"
},
"costPerMtokInput": {
"type": "number"
},
"costPerMtokOutput": {
"type": "number"
},
"throughputPerMw": {
"type": "number"
},
"concurrency": {
"type": "number"
},
"precision": {
"type": [
"string",
"null"
]
},
"clamped": {
"type": "boolean"
}
},
"additionalProperties": false
},
"basis": {
"type": "string",
"enum": [
"throughputPerGpu",
"costPerMtok"
]
},
"deltaPct": {
"type": [
"number",
"null"
]
},
"winner": {
"type": [
"string",
"null"
]
}
},
"required": [
"tier",
"a",
"b",
"basis",
"deltaPct",
"winner"
],
"additionalProperties": false
}
},
"summary": {
"type": "object",
"properties": {
"a": {
"type": "object",
"properties": {
"hardware": {
"type": "string"
},
"configCount": {
"type": "integer"
},
"bestThroughputPerGpu": {
"type": [
"number",
"null"
]
},
"bestMedianTtft": {
"type": [
"number",
"null"
]
},
"bestMedianTpot": {
"type": [
"number",
"null"
]
}
},
"additionalProperties": true
},
"b": {
"type": "object",
"properties": {
"hardware": {
"type": "string"
},
"configCount": {
"type": "integer"
},
"bestThroughputPerGpu": {
"type": [
"number",
"null"
]
},
"bestMedianTtft": {
"type": [
"number",
"null"
]
},
"bestMedianTpot": {
"type": [
"number",
"null"
]
}
},
"additionalProperties": true
},
"headToHead": {
"type": [
"object",
"null"
],
"properties": {
"faster": {
"type": "string"
},
"slower": {
"type": "string"
},
"tputPct": {
"type": "number"
},
"cheaper": {
"type": "string"
},
"pricier": {
"type": "string"
},
"costPct": {
"type": "number"
}
},
"additionalProperties": false
},
"byPrecision": {
"type": "array",
"items": {
"type": "object",
"properties": {
"precision": {
"type": "string"
},
"tiers": {
"type": "array",
"items": {
"type": "number"
}
},
"headToHead": {
"type": [
"object",
"null"
],
"properties": {
"faster": {
"type": "string"
},
"slower": {
"type": "string"
},
"tputPct": {
"type": "number"
},
"cheaper": {
"type": "string"
},
"pricier": {
"type": "string"
},
"costPct": {
"type": "number"
}
},
"additionalProperties": false
}
},
"required": [
"precision",
"tiers",
"headToHead"
],
"additionalProperties": false
}
},
"bySpecDecode": {
"type": "array",
"items": {
"type": "object",
"properties": {
"specMethod": {
"type": "string"
},
"tier": {
"type": "number"
},
"a": {
"type": [
"object",
"null"
],
"properties": {
"hardware": {
"type": "string"
},
"configKey": {
"type": "string"
},
"throughputPerGpu": {
"type": "number"
},
"inputThroughputPerGpu": {
"type": "number"
},
"outputThroughputPerGpu": {
"type": "number"
},
"costPerMtok": {
"type": "number"
},
"costPerMtokInput": {
"type": "number"
},
"costPerMtokOutput": {
"type": "number"
},
"throughputPerMw": {
"type": "number"
},
"concurrency": {
"type": "number"
},
"precision": {
"type": [
"string",
"null"
]
},
"clamped": {
"type": "boolean"
}
},
"additionalProperties": false
},
"b": {
"type": [
"object",
"null"
],
"properties": {
"hardware": {
"type": "string"
},
"configKey": {
"type": "string"
},
"throughputPerGpu": {
"type": "number"
},
"inputThroughputPerGpu": {
"type": "number"
},
"outputThroughputPerGpu": {
"type": "number"
},
"costPerMtok": {
"type": "number"
},
"costPerMtokInput": {
"type": "number"
},
"costPerMtokOutput": {
"type": "number"
},
"throughputPerMw": {
"type": "number"
},
"concurrency": {
"type": "number"
},
"precision": {
"type": [
"string",
"null"
]
},
"clamped": {
"type": "boolean"
}
},
"additionalProperties": false
}
},
"required": [
"specMethod",
"tier",
"a",
"b"
],
"additionalProperties": false
}
}
},
"required": [
"a",
"b",
"headToHead"
],
"additionalProperties": false
}
},
"required": [
"view",
"apiVersion",
"generatedAt",
"params",
"model",
"gpus",
"scenario",
"precision",
"variant",
"tiers",
"interactivityRange",
"dataRange",
"table",
"summary"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"view": "compare",
"apiVersion": "v1",
"generatedAt": "2026-08-20",
"params": {
"slug": "deepseek-v4-b200-vs-mi355x",
"model": "DeepSeek-V4-Pro",
"gpus": [
"b200",
"mi355x"
],
"scenario": "auto",
"variant": "default",
"tiers": "default",
"format": "json"
},
"model": {
"slug": "deepseek-v4",
"displayName": "DeepSeek-V4-Pro",
"label": "DeepSeekv4 Pro 0813 1.6T"
},
"gpus": [
"b200",
"mi355x"
],
"scenario": "agentic-traces",
"precision": "fp8",
"variant": "default",
"tiers": [
21,
34,
47
],
"interactivityRange": {
"min": 12,
"max": 55
},
"dataRange": {
"oldest": "2026-05-02",
"newest": "2026-08-20"
},
"table": [
{
"tier": 34,
"a": {
"hardware": "b200",
"configKey": "b200_sglang",
"throughputPerGpu": 1315.2,
"inputThroughputPerGpu": 9821.4,
"outputThroughputPerGpu": 1315.2,
"costPerMtok": 0.42,
"costPerMtokInput": 0.06,
"costPerMtokOutput": 0.48,
"throughputPerMw": 985000,
"concurrency": 96,
"precision": "fp8",
"clamped": false
},
"b": {
"hardware": "mi355x",
"configKey": "mi355x_sglang",
"throughputPerGpu": 1104.7,
"inputThroughputPerGpu": 8455.1,
"outputThroughputPerGpu": 1104.7,
"costPerMtok": 0.47,
"costPerMtokInput": 0.07,
"costPerMtokOutput": 0.53,
"throughputPerMw": 912000,
"concurrency": 88,
"precision": "fp8",
"clamped": false
},
"basis": "throughputPerGpu",
"deltaPct": 19.1,
"winner": "b200"
}
],
"summary": {
"a": {
"hardware": "b200",
"configCount": 12,
"bestThroughputPerGpu": 1840.3,
"bestMedianTtft": 0.42,
"bestMedianTpot": 8.1
},
"b": {
"hardware": "mi355x",
"configCount": 9,
"bestThroughputPerGpu": 1512.8,
"bestMedianTtft": 0.51,
"bestMedianTpot": 9.4
},
"headToHead": {
"faster": "B200",
"slower": "MI355X",
"tputPct": 19,
"cheaper": "B200",
"pricier": "MI355X",
"costPct": 11
}
}
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
model,scenario,tier,basis,delta_pct,winner,a_hardware,a_throughput_per_gpu,a_cost_per_mtok,a_concurrency,a_clamped,b_hardware,b_throughput_per_gpu,b_cost_per_mtok,b_concurrency,b_clamped
DeepSeek-V4-Pro,agentic-traces,34,throughputPerGpu,19.1,b200,b200,1315.2,0.42,96,false,mi355x,1104.7,0.47,88,false400
slug、model、gpus、scenario、variant、tiers 或 format 参数无效。响应体会指出参数名，并在适用时列出允许的取值。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown compare slug: not-a-pair. Expected <model>-<gpuA>-vs-<gpuB>, e.g. deepseek-v4-b200-vs-mi355x.",
"param": "slug"
}500
对比数据组装失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/first-token首 token 达标配置
只读首 token 达标配置，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| caps | query | string | 可选 | 一至八个有限正数，表示首 token 时间上限（秒）；排序去重后使用，默认 2,5,10,15,20。任一值无效时返回 400。 | |
| costProvider | query | string | 可选 | costh 为自有成本，costr 为租赁成本。利润视图还支持 custom，需配合 customCosts。不支持 costn。 | |
| costType | query | string | 可选 | total（默认）、input 或 output token。分离式输入和输出速率保留各自的 prefill、decode 分母。 | |
| date | query | string | 可选 | 快照截止日期，格式为 YYYY-MM-DD。指定 runId 时改为读取该次运行的逻辑快照。 | |
| gpus | query | string | 可选 | 以逗号分隔的硬件或配置键；gpu-metrics 使用数字芯片索引。省略时选择全部。 | |
| minInteractivity | query | string | 可选 | 最低 tok/s/user，AgentX 默认 150，固定长度工作负载默认 35。 | |
| model | query | string | 必填 | 模型显示名称或比较页 slug，不区分大小写。基于基准测试的视图需要此参数。镜像视图还接受当前镜像列表中的模型名，去除首尾空白后匹配，默认 all；未知模型返回 400。 | DeepSeek-V4-Pro |
| percentile | query | string | 可选 | AgentX 延迟分位数为 p75 或 p90；CollectiveX 支持 p50、p95、p99。 | |
| precisions | query | string | 可选 | 以逗号分隔的精度键；省略时按可用测试曲线数量选择。计算器扩展视图选择官方数据中曲线最多的精度，并纳入 unofficial-run 叠加数据中的精度。 | |
| runId | query | string | 可选 | 正安全整数格式的工作流运行 ID。不填时选择默认运行；实时 GPU 指标必须填写。 | 123 |
| sequence | query | string | 可选 | 工作负载：1k/1k、1k/8k、8k/1k 或 agentic-traces。AgentX 扩展视图默认使用 agentic-traces。 | |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 | |
| unofficialrun | query | string | 可选 | 最多八个公开 CI 运行 ID，以逗号分隔。去除各项首尾空白和重复 ID 后，按剩余顺序分配运行索引。叠加结果与官方数据分开。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/first-token?model=DeepSeek-V4-Pro'响应
FirstTokenView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"first-token"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"data": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "first-token",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/cache-reuse缓存复用曲线
只读缓存复用曲线，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| config | query | string | 可选 | configurations 中的缓存复用配置键。省略时采用仪表板默认配置。 | |
| date | query | string | 可选 | 快照截止日期，格式为 YYYY-MM-DD。指定 runId 时改为读取该次运行的逻辑快照。 | |
| gpus | query | string | 可选 | 以逗号分隔的硬件或配置键；gpu-metrics 使用数字芯片索引。省略时选择全部。 | |
| model | query | string | 必填 | 模型显示名称或比较页 slug，不区分大小写。基于基准测试的视图需要此参数。镜像视图还接受当前镜像列表中的模型名，去除首尾空白后匹配，默认 all；未知模型返回 400。 | DeepSeek-V4-Pro |
| percentile | query | string | 可选 | AgentX 延迟分位数为 p75 或 p90；CollectiveX 支持 p50、p95、p99。 | |
| precisions | query | string | 可选 | 以逗号分隔的精度键；省略时按可用测试曲线数量选择。计算器扩展视图选择官方数据中曲线最多的精度，并纳入 unofficial-run 叠加数据中的精度。 | |
| runId | query | string | 可选 | 正安全整数格式的工作流运行 ID。不填时选择默认运行；实时 GPU 指标必须填写。 | 123 |
| sequence | query | string | 可选 | 工作负载：1k/1k、1k/8k、8k/1k 或 agentic-traces。AgentX 扩展视图默认使用 agentic-traces。 | |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 | |
| unofficialrun | query | string | 可选 | 最多八个公开 CI 运行 ID，以逗号分隔。去除各项首尾空白和重复 ID 后，按剩余顺序分配运行索引。叠加结果与官方数据分开。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/cache-reuse?model=DeepSeek-V4-Pro'响应
CacheReuseView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"cache-reuse"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"configurations": {
"type": "object",
"additionalProperties": true
},
"data": {
"type": [
"object",
"null"
],
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "cache-reuse",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/profit-estimator每芯片小时利润
只读每芯片小时利润，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| cachedInputPrice | query | string | 可选 | 自定义缓存输入价格，单位 USD/百万 token，默认 0.1。 | |
| costProvider | query | string | 可选 | costh 为自有成本，costr 为租赁成本。利润视图还支持 custom，需配合 customCosts。不支持 costn。 | |
| customCosts | query | string | 可选 | JSON 对象，将基础硬件键映射为有限非负美元/芯片小时，最多 100 项。 | |
| date | query | string | 可选 | 快照截止日期，格式为 YYYY-MM-DD。指定 runId 时改为读取该次运行的逻辑快照。 | |
| dates | query | string | 可选 | 最多十二个比较项，以逗号分隔，格式为 YYYY-MM-DD 或 YYYY-MM-DD~rRUN_ID。仅含日期时读取当天的逻辑快照，不按截止日期向前回溯；含运行 ID 时读取该次运行的逻辑快照。各快照独立计算。 | |
| end | query | string | 可选 | 比较范围结束日期 YYYY-MM-DD，不得早于 start。历史视图将其用作含终点的数据范围。 | |
| gpus | query | string | 可选 | 以逗号分隔的硬件或配置键；gpu-metrics 使用数字芯片索引。省略时选择全部。 | |
| inputPrice | query | string | 可选 | 自定义未缓存输入价格，单位 USD/百万 token，默认 1。 | |
| labCut | query | string | 可选 | 模型许可或收入分成百分比，范围 0 至 100，默认值随模型变化。 | |
| model | query | string | 必填 | 模型显示名称或比较页 slug，不区分大小写。基于基准测试的视图需要此参数。镜像视图还接受当前镜像列表中的模型名，去除首尾空白后匹配，默认 all；未知模型返回 400。 | DeepSeek-V4-Pro |
| outputPrice | query | string | 可选 | 自定义输出价格，单位 USD/百万 token，默认 1。 | |
| percentile | query | string | 可选 | AgentX 延迟分位数为 p75 或 p90；CollectiveX 支持 p50、p95、p99。 | |
| powerBasis | query | string | 可选 | provisioned（默认）、modeled 或 compare。建模功耗需要符合条件的实测数据行；由部分 GPU 的实测数据外推到整机的估算，会通过 powerLabel 标明。缺失数据不按零处理。 | |
| precisions | query | string | 可选 | 以逗号分隔的精度键；省略时按可用测试曲线数量选择。计算器扩展视图选择官方数据中曲线最多的精度，并纳入 unofficial-run 叠加数据中的精度。 | |
| priceSource | query | string | 可选 | 利润视图支持 list、openrouter、custom；推理和历史视图支持 normalized、openrouter。响应 pricing 记录实际使用的价格。 | |
| runId | query | string | 可选 | 正安全整数格式的工作流运行 ID。不填时选择默认运行；实时 GPU 指标必须填写。 | 123 |
| sequence | query | string | 可选 | 工作负载：1k/1k、1k/8k、8k/1k 或 agentic-traces。AgentX 扩展视图默认使用 agentic-traces。 | |
| start | query | string | 可选 | 比较范围起始日期 YYYY-MM-DD。与 end 一起只加入两个端点，不加入中间所有日期。历史视图将其用作含起点的数据范围。 | |
| target | query | string | 可选 | 正数工作点目标；交互性转吞吐量模式下单位为 tok/s/user。利润视图按模型设置默认值。 | |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 | |
| unofficialrun | query | string | 可选 | 最多八个公开 CI 运行 ID，以逗号分隔。去除各项首尾空白和重复 ID 后，按剩余顺序分配运行索引。叠加结果与官方数据分开。 | |
| utilization | query | string | 可选 | 利用率百分比，范围 0 至 100，默认 60。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/profit-estimator?model=DeepSeek-V4-Pro'响应
ProfitEstimatorView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"profit-estimator"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"pricing": {
"type": "object",
"additionalProperties": true
},
"data": {
"type": "object",
"additionalProperties": true
},
"overlays": {
"type": "object",
"additionalProperties": true
},
"comparisons": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "profit-estimator",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/profit-estimator-per-gigawatt每吉瓦年利润
只读每吉瓦年利润，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| cachedInputPrice | query | string | 可选 | 自定义缓存输入价格，单位 USD/百万 token，默认 0.1。 | |
| costProvider | query | string | 可选 | costh 为自有成本，costr 为租赁成本。利润视图还支持 custom，需配合 customCosts。不支持 costn。 | |
| customCosts | query | string | 可选 | JSON 对象，将基础硬件键映射为有限非负美元/芯片小时，最多 100 项。 | |
| date | query | string | 可选 | 快照截止日期，格式为 YYYY-MM-DD。指定 runId 时改为读取该次运行的逻辑快照。 | |
| dates | query | string | 可选 | 最多十二个比较项，以逗号分隔，格式为 YYYY-MM-DD 或 YYYY-MM-DD~rRUN_ID。仅含日期时读取当天的逻辑快照，不按截止日期向前回溯；含运行 ID 时读取该次运行的逻辑快照。各快照独立计算。 | |
| end | query | string | 可选 | 比较范围结束日期 YYYY-MM-DD，不得早于 start。历史视图将其用作含终点的数据范围。 | |
| gpus | query | string | 可选 | 以逗号分隔的硬件或配置键；gpu-metrics 使用数字芯片索引。省略时选择全部。 | |
| inputPrice | query | string | 可选 | 自定义未缓存输入价格，单位 USD/百万 token，默认 1。 | |
| labCut | query | string | 可选 | 模型许可或收入分成百分比，范围 0 至 100，默认值随模型变化。 | |
| model | query | string | 必填 | 模型显示名称或比较页 slug，不区分大小写。基于基准测试的视图需要此参数。镜像视图还接受当前镜像列表中的模型名，去除首尾空白后匹配，默认 all；未知模型返回 400。 | DeepSeek-V4-Pro |
| outputPrice | query | string | 可选 | 自定义输出价格，单位 USD/百万 token，默认 1。 | |
| percentile | query | string | 可选 | AgentX 延迟分位数为 p75 或 p90；CollectiveX 支持 p50、p95、p99。 | |
| powerBasis | query | string | 可选 | provisioned（默认）、modeled 或 compare。建模功耗需要符合条件的实测数据行；由部分 GPU 的实测数据外推到整机的估算，会通过 powerLabel 标明。缺失数据不按零处理。 | |
| precisions | query | string | 可选 | 以逗号分隔的精度键；省略时按可用测试曲线数量选择。计算器扩展视图选择官方数据中曲线最多的精度，并纳入 unofficial-run 叠加数据中的精度。 | |
| priceSource | query | string | 可选 | 利润视图支持 list、openrouter、custom；推理和历史视图支持 normalized、openrouter。响应 pricing 记录实际使用的价格。 | |
| runId | query | string | 可选 | 正安全整数格式的工作流运行 ID。不填时选择默认运行；实时 GPU 指标必须填写。 | 123 |
| sequence | query | string | 可选 | 工作负载：1k/1k、1k/8k、8k/1k 或 agentic-traces。AgentX 扩展视图默认使用 agentic-traces。 | |
| start | query | string | 可选 | 比较范围起始日期 YYYY-MM-DD。与 end 一起只加入两个端点，不加入中间所有日期。历史视图将其用作含起点的数据范围。 | |
| target | query | string | 可选 | 正数工作点目标；交互性转吞吐量模式下单位为 tok/s/user。利润视图按模型设置默认值。 | |
| tcoBasis | query | string | 可选 | internal（默认）或 external，使用与界面相同的自有或租赁成本口径。 | |
| unofficialrun | query | string | 可选 | 最多八个公开 CI 运行 ID，以逗号分隔。去除各项首尾空白和重复 ID 后，按剩余顺序分配运行索引。叠加结果与官方数据分开。 | |
| utilization | query | string | 可选 | 利用率百分比，范围 0 至 100，默认 60。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/profit-estimator-per-gigawatt?model=DeepSeek-V4-Pro'响应
ProfitEstimatorPerGigawattView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"profit-estimator-per-gigawatt"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"pricing": {
"type": "object",
"additionalProperties": true
},
"data": {
"type": "object",
"additionalProperties": true
},
"overlays": {
"type": "object",
"additionalProperties": true
},
"comparisons": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "profit-estimator-per-gigawatt",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/operatorxOperatorX 所选测试
只读OperatorX 所选测试，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| backend | query | string | 可选 | 后端筛选；省略时选择全部。 | |
| cluster | query | string | 可选 | OperatorX 集群筛选；省略时选择全部。 | |
| metric | query | string | 可选 | 各视图对应的指标键。OperatorX 支持 tflops、latency；GPU 指标支持功耗、温度、时钟、利用率及可用 AMD 指标。 | |
| operator | query | string | 可选 | gemm、attention_mha、attention_mla 或 moe_gemm；默认首个可用算子。 | |
| page | query | string | 可选 | OperatorX 表格页码从 0 开始；视频 CI 发现页码从 1 开始。 | |
| precision | query | string | 可选 | 精度键；CollectiveX 有 fp8 时默认使用 fp8。镜像视图去除首尾空白、不区分大小写，默认 all。 | |
| runId | query | string | 可选 | 正安全整数格式的工作流运行 ID。不填时选择默认运行；实时 GPU 指标必须填写。 | 123 |
| shape | query | string | 可选 | 响应 options 中的 OperatorX 形状键。 | |
| status | query | string | 可选 | OperatorX 状态：ok（默认）、unsupported、error、missing 或 all。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/operatorx'响应
OperatorxView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"operatorx"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"run": {
"type": [
"object",
"null"
],
"additionalProperties": true
},
"rows": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"points": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"options": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "operatorx",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/collectivexCollectiveX EP、KV 与 swap 视图
只读CollectiveX EP、KV 与 swap 视图，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| activeSeries | query | string | 可选 | 以逗号分隔、带运行命名空间的 EP 曲线 ID。省略时选择全部。 | |
| kvSeries | query | string | 可选 | 以逗号分隔的 KV run:case ID。省略时选择全部。 | |
| swapSeries | query | string | 可选 | 以逗号分隔的 swap 曲线 ID。省略时选择全部。 | |
| backend | query | string | 可选 | 后端筛选；省略时选择全部。 | |
| epSize | query | string | 可选 | EP 大小，有 8 时默认选 8，否则选首个可用值。 | |
| kvOp | query | string | 可选 | KV 操作：pull（默认）或 push。 | |
| kvX | query | string | 可选 | KV 展示方式：isl（默认）、batch、frontier 或 overlap。 | |
| kvY | query | string | 可选 | KV 指标：bandwidth（默认）或 latency。 | |
| modes | query | string | 可选 | 以逗号分隔的 EP 模式键，默认选择全部可用模式。 | |
| operation | query | string | 可选 | EP 操作：roundtrip（默认）、dispatch 或 combine。 | |
| overlapIsl | query | string | 可选 | 重叠测试输入长度：max（默认）或正整数。 | |
| pageTokens | query | string | 可选 | KV 页大小，单位 token，必须为正数；默认首个可用值。 | |
| percentile | query | string | 可选 | AgentX 延迟分位数为 p75 或 p90；CollectiveX 支持 p50、p95、p99。 | |
| phase | query | string | 可选 | CollectiveX 阶段，默认 decode；视频阶段为 measurement、startup 或 warmup。 | |
| precision | query | string | 可选 | 精度键；CollectiveX 有 fp8 时默认使用 fp8。镜像视图去除首尾空白、不区分大小写，默认 all。 | |
| runs | query | string | 可选 | 按顺序排列的运行 ID，以逗号分隔，最多八个。省略时选择最新有实测数据的运行；空值表示不选。 | |
| sku | query | string | 可选 | CollectiveX 芯片 SKU 筛选，默认 all。 | |
| suite | query | string | 可选 | 运行列表筛选：all、ep、kv 或 swap。 | |
| swapDirection | query | string | 可选 | h2d（默认）、d2h 或 d2d。 | |
| swapLayout | query | string | 可选 | contiguous（默认）或 random。 | |
| swapMetric | query | string | 可选 | bandwidth（默认）或 latency。 | |
| swapPercentile | query | string | 可选 | p50（默认）、p95 或 p99。 | |
| version | query | string | 可选 | CollectiveX 数据集 schema 版本，默认 1。 | |
| yAxis | query | string | 可选 | CollectiveX 支持 latency、tokens-per-second、activation-rate、payload-rate；视频支持 dollar、clipsGpu、secondsGpu、clipsAllocatedGpu、secondsAllocatedGpu、energy。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/collectivex'响应
CollectivexView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"collectivex"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"runs": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"ep": {
"type": "object",
"additionalProperties": true
},
"kv": {
"type": "object",
"additionalProperties": true
},
"swap": {
"type": "object",
"additionalProperties": true
},
"options": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "collectivex",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/submissions提交表格与每周数量
只读提交表格与每周数量，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| direction | query | string | 可选 | asc 或 desc。提交记录默认 desc，GPU 统计默认 asc。 | |
| limit | query | string | 可选 | 提交表格行数上限，默认 100，最大 10000。 | |
| lines | query | string | 可选 | 提交图曲线：nvidia、amd、total，以逗号分隔；amd 与界面一致，包含非 NVIDIA 行。 | |
| mode | query | string | 可选 | 提交图支持 weekly（默认）、cumulative；计算器支持 interactivity_to_throughput、throughput_to_interactivity。 | |
| offset | query | string | 可选 | 提交表格偏移量，默认 0。 | |
| onChangeOnly | query | string | 可选 | 布尔值，默认 true。仅周图按仪表板规则应用按变更运行的统计起点。 | |
| search | query | string | 可选 | 提交记录搜索，不区分大小写，覆盖芯片、模型、框架、精度、投机解码及厂商。 | |
| sort | query | string | 可选 | 表格排序列；提交记录默认 date，GPU 统计默认 gpuIndex。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/submissions'响应
SubmissionsView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"submissions"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"rows": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"stats": {
"type": "object",
"additionalProperties": true
},
"series": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "submissions",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/current-inferencex-image当前推理镜像
只读当前推理镜像，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| asOf | query | string | 可选 | 用于复现滚动可靠性或镜像日期差计算的参考日期 YYYY-MM-DD。 | |
| frameworks | query | string | 可选 | 以逗号分隔的框架系列键；省略时选择全部。 | |
| hardware | query | string | 可选 | 镜像视图硬件键，去除首尾空白、不区分大小写，默认 all。 | |
| model | query | string | 可选 | 模型显示名称或比较页 slug，不区分大小写。基于基准测试的视图需要此参数。镜像视图还接受当前镜像列表中的模型名，去除首尾空白后匹配，默认 all；未知模型返回 400。 | DeepSeek-V4-Pro |
| nodeType | query | string | 可选 | 镜像部署类型：single（默认）、disagg 或 all。 | |
| precision | query | string | 可选 | 精度键；CollectiveX 有 fp8 时默认使用 fp8。镜像视图去除首尾空白、不区分大小写，默认 all。 | |
| sequence | query | string | 可选 | 工作负载：1k/1k、1k/8k、8k/1k 或 agentic-traces。AgentX 扩展视图默认使用 agentic-traces。 | |
| spec | query | string | 可选 | 投机解码筛选；镜像视图使用单个值，去除首尾空白、不区分大小写，默认 all。推理视图使用逗号分隔列表。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/current-inferencex-image'响应
CurrentInferencexImageView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"current-inferencex-image"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"rows": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"options": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "current-inferencex-image",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/gpu-metrics实时 GPU 指标与统计
只读实时 GPU 指标与统计，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。 实时产物读取不缓存；统计量使用所有芯片的未降采样值，图表行则按芯片索引筛选。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| artifact | query | string | 可选 | GPU 指标产物名称，或配合 run 使用的视频数字产物 ID。 | |
| chartView | query | string | 可选 | chart（默认）或 correlation，两者均返回未降采样来源行。 | |
| corrXMetric | query | string | 可选 | 相关性图 x 轴 GPU 指标，默认 power。 | |
| corrYMetric | query | string | 可选 | 相关性图 y 轴 GPU 指标，默认 temperature。 | |
| direction | query | string | 可选 | asc 或 desc。提交记录默认 desc，GPU 统计默认 asc。 | |
| downsample | query | string | 可选 | 布尔值，默认 true，指定界面 2000 个交互点的渲染上限。返回的原始行和统计量不降采样。 | |
| gpus | query | string | 可选 | 以逗号分隔的硬件或配置键；gpu-metrics 使用数字芯片索引。省略时选择全部。 | |
| metric | query | string | 可选 | 各视图对应的指标键。OperatorX 支持 tflops、latency；GPU 指标支持功耗、温度、时钟、利用率及可用 AMD 指标。 | |
| runId | query | string | 必填 | 正安全整数格式的工作流运行 ID。不填时选择默认运行；实时 GPU 指标必须填写。 | 123 |
| sort | query | string | 可选 | 表格排序列；提交记录默认 date，GPU 统计默认 gpuIndex。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/gpu-metrics?runId=123'响应
GpuMetricsView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"gpu-metrics"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"runInfo": {
"type": "object",
"additionalProperties": true
},
"artifacts": {
"type": "array",
"items": {
"type": "string"
}
},
"rows": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"stats": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"rendering": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "gpu-metrics",
"apiVersion": "v1",
"params": {}
}404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/views/video已发布视频证据与权衡数据
只读已发布视频证据与权衡数据，使用仪表板的数据读取和计算函数。未知或重复查询键返回 400；响应包含解析后的参数，保留缺失数据。仅影响样式的控件不作为 API 参数。 仅读取已发布产物。cell、阶段、slot 和 GPU 口径选择对应结果证据，并计算 serving 归一化速率；x/y、成本及工作负载筛选生成权衡图数据点。不读取本地数据包或任意 URL。响应不缓存。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| artifact | query | string | 可选 | GPU 指标产物名称，或配合 run 使用的视频数字产物 ID。 | |
| cell | query | string | 可选 | 与已发布证据一起保留的 serving cell 选择。 | |
| compare | query | string | 可选 | 视频：最多八组已发布证据的 run:artifact，以逗号分隔。 | |
| costs | query | string | 可选 | JSON 对象，将视频数据点 ID 映射为 {hourly,source,date} 字符串；hourly 为非负 USD/deployment-hour。 | |
| gpuBasis | query | string | 可选 | 视频分母：participating（默认）或 allocated GPU。 | |
| page | query | string | 可选 | OperatorX 表格页码从 0 开始；视频 CI 发现页码从 1 开始。 | |
| phase | query | string | 可选 | CollectiveX 阶段，默认 decode；视频阶段为 measurement、startup 或 warmup。 | |
| run | query | string | 可选 | 公开视频 CI 运行 ID。省略时列出运行。 | |
| selected | query | string | 可选 | 选中的视频权衡图数据点 ID。 | |
| slot | query | string | 可选 | 与已发布证据一起保留的媒体或保真度 slot 选择。 | |
| source | query | string | 可选 | 已发布视频来源 ID，默认首个来源。 | |
| view | query | string | 可选 | 视频 results（默认）或 tradeoff。 | |
| workload | query | string | 可选 | 视频 workloads 中的工作负载分组键。不同工作负载不合并比较。 | |
| xAxis | query | string | 可选 | 视频延迟：p90 或 median。serving 仅在 p90 不可用时默认 median。 | |
| yAxis | query | string | 可选 | CollectiveX 支持 latency、tokens-per-second、activation-rate、payload-rate；视频支持 dollar、clipsGpu、secondsGpu、clipsAllocatedGpu、secondsAllocatedGpu、energy。 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/views/video'响应
VideoView200
解析后的选择与公开视图数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"view": {
"type": "string",
"enum": [
"video"
]
},
"apiVersion": {
"type": "string",
"enum": [
"v1"
]
},
"params": {
"type": "object",
"additionalProperties": true
},
"sources": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"points": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"curves": {
"type": "object",
"additionalProperties": true
},
"evidence": {
"type": [
"object",
"null"
],
"additionalProperties": true
},
"discovery": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"view",
"apiVersion",
"params"
],
"additionalProperties": true
}滚动查看完整示例。
响应示例
代码
{
"view": "video",
"apiVersion": "v1",
"params": {}
}204
暂无已发布的视频产物，响应不含正文。
响应结构
代码
{
"type": "null"
}响应示例
代码
null404
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}429
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}503
保留上游状态码，移除内部详情，失败响应不缓存。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Source data unavailable"
}400
查询无效或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid parameter",
"param": "model"
}500
数据读取或视图计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}核心基准数据
基准结果、可用配置、工作流来源、评估与可靠性数据。
GET稳定/api/v1/availability列出可用的基准配置
返回已有基准数据的模型、序列、精度、硬件、框架、投机解码方式、基准类型和日期组合。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/availability'响应
AvailabilityRows200
可用配置行。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "object",
"properties": {
"model": {
"type": "string"
},
"isl": {
"type": [
"number",
"null"
]
},
"osl": {
"type": [
"number",
"null"
]
},
"precision": {
"type": "string"
},
"hardware": {
"type": "string"
},
"framework": {
"type": "string"
},
"spec_method": {
"type": "string"
},
"disagg": {
"type": "boolean"
},
"benchmark_type": {
"type": "string"
},
"date": {
"type": "string",
"format": "date"
}
},
"required": [
"model",
"isl",
"osl",
"precision",
"hardware",
"framework",
"spec_method",
"disagg",
"benchmark_type",
"date"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
[
{
"model": "dsr1",
"isl": 1024,
"osl": 1024,
"precision": "fp8",
"hardware": "h200_sxm",
"framework": "vllm",
"spec_method": "none",
"disagg": false,
"benchmark_type": "single_turn",
"date": "2026-08-08"
}
]滚动查看完整示例。
500
可用配置查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/benchmarks读取基准结果
返回指定展示模型的原始基准测试数据行。使用 date 可获取截至指定日期的快照；exact=true 仅返回该日期的数据；runId 用于限定最新结果的查询范围；将 exactRun=true 与数值型 runId 搭配使用，可获取该次运行对应的逻辑快照。AgentX 按模型、硬件、框架、精度和工作负载划分曲线；常规运行会整体替换同一曲线中此前的所有拓扑、推测解码和 offload 变体。显式标记为 append-only 的运行可继承此前使用相同镜像的快照，并保留各数据点来源运行的 ID 和 URL。历史快照仍可查询。view=calculator 返回页面专用的裁剪投影（会移除实测功率指标和 workers，其允许列表可能变化）。powerValid=strictV2 仅返回采用 schema v2 且功率测量通过验证的数据行，不能与 view=calculator 组合使用。省略 powerValid 则保留常规基准测试结果，不按功率有效性筛选。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| model | query | string | 必填 | 展示模型名称。 | DeepSeek-R1-0528 |
| date | query | date | 可选 | YYYY-MM-DD 当日或之前的最新数据，exact 为 true 时仅限当日。 | 2026-08-08 |
| exact | query | boolean | 可选 | 设为 true 时严格匹配所给日期。 | false |
| runId | query | integer | 可选 | GitHub Actions 数字运行 ID。非数字值会被忽略。 | 123456789 |
| exactRun | query | boolean | 可选 | 与数字 runId 一起使用时，返回该次运行对应的逻辑快照；append-only 运行的快照包含此前使用相同镜像的数据。 | false |
| view | query | enum | 可选 | calculator 会将每行裁剪为吞吐量计算器所需的页面专用指标允许列表并移除 workers；此视图不包含实测功率指标。需要同时提供 sequence。省略则返回全部已存储指标，包括实测功率。 | calculator |
| sequence | query | enum | 可选 | 当 view=calculator 时必填，其余情况会被忽略。未知值返回 400 Unknown calculator sequence。 | 1k/1k |
| powerValid | query | enum | 可选 | 仅接受 strictV2：保留 metrics.power_valid 为数字 1、且 metrics.power_metric_schema_version 为数字 2 的数据行，其能耗指标采用整个部署的统计口径。省略此参数则不按功率筛选，即使功率缺失或无效，也会保留吞吐量和延迟结果。其他取值（包括空值）返回 400 Unknown powerValid filter。不能与 view=calculator 组合使用。 | strictV2 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/benchmarks?model=DeepSeek-R1-0528'响应
BenchmarkRows200
基准行，标量指标位于 metrics 对象中。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"hardware": {
"type": "string"
},
"framework": {
"type": "string"
},
"model": {
"type": "string"
},
"precision": {
"type": "string"
},
"spec_method": {
"type": "string"
},
"disagg": {
"type": "boolean"
},
"is_multinode": {
"type": "boolean"
},
"prefill_tp": {
"type": "integer"
},
"prefill_ep": {
"type": "integer"
},
"prefill_dp_attention": {
"type": "boolean"
},
"prefill_num_workers": {
"type": "integer"
},
"decode_tp": {
"type": "integer"
},
"decode_ep": {
"type": "integer"
},
"decode_dp_attention": {
"type": "boolean"
},
"decode_num_workers": {
"type": "integer"
},
"num_prefill_gpu": {
"type": "integer",
"description": "Physical prefill chips; aggregate engines may mirror their single chip count in both role columns."
},
"num_decode_gpu": {
"type": "integer",
"description": "Physical decode chips, independent of logical TP and DP. Sum role counts only for disaggregated engines."
},
"benchmark_type": {
"type": "string"
},
"isl": {
"type": [
"number",
"null"
]
},
"osl": {
"type": [
"number",
"null"
]
},
"conc": {
"type": "integer"
},
"offload_mode": {
"type": "string"
},
"image": {
"type": [
"string",
"null"
]
},
"recipe_fingerprint": {
"type": [
"string",
"null"
]
},
"metrics": {
"type": "object",
"additionalProperties": {
"type": "number"
},
"description": "Scalar metric map. Time metrics, including p99_itl and p99_tpot, are in seconds. p99_itl measures inter-token latency; p99_tpot measures per-request time per output token. Use the actual p99_itl field for an inter-token latency requirement, not the reciprocal of p99_intvty. Throughput metrics use tokens per second per GPU unless their name states otherwise; output_tput_per_gpu counts output tokens. Keys evolve independently; measured power / energy / GPU-telemetry keys are typed below.",
"properties": {
"power_valid": {
"type": "number",
"description": "Publication verdict: 1 = validated measurement window; 0 = failed validation — measured power/energy values are withheld from this row end-to-end, so treat any that remain as unreliable; absent = no validation verdict is available in this response. Absence alone establishes neither the reason, the measurement age, nor invalidity."
},
"power_metric_schema_version": {
"type": "number",
"description": "Power schema version. Version 2 defines every unprefixed joules_per_* field as whole-deployment energy, including on disaggregated runs."
},
"avg_power_w": {
"type": "number",
"description": "Mean per-GPU power draw in watts during the measured load window."
},
"avg_total_gpu_power_w": {
"type": "number",
"description": "Mean total GPU power draw in watts across the measured deployment."
},
"total_gpu_energy_j": {
"type": "number",
"description": "Total GPU energy integrated over the measured deployment load window, in joules."
},
"p75_power_w": {
"type": "number",
"description": "Time-weighted P75 of synchronized total GPU-board watts, divided by participating GPU count, over the validated benchmark window with piecewise-linear interpolation. Not a percentile of individual-device percentiles; absent when not measured."
},
"p75_total_gpu_power_w": {
"type": "number",
"description": "Time-weighted P75 of synchronized total GPU-board watts over the validated benchmark window with piecewise-linear interpolation. Accelerator boards only, not chassis or facility power."
},
"p90_power_w": {
"type": "number",
"description": "Time-weighted P90 of synchronized total GPU-board watts, divided by participating GPU count, over the validated benchmark window with piecewise-linear interpolation. Not a percentile of individual-device percentiles; absent when not measured."
},
"p90_total_gpu_power_w": {
"type": "number",
"description": "Time-weighted P90 of synchronized total GPU-board watts over the validated benchmark window with piecewise-linear interpolation. Accelerator boards only, not chassis or facility power."
},
"joules_per_successful_query": {
"type": "number",
"description": "Whole-deployment energy in joules divided by successful requests."
},
"joules_per_output_token": {
"type": "number",
"description": "Energy per generated output token in joules; cluster-wide on schema-version-2 rows, including disaggregated runs."
},
"joules_per_total_token": {
"type": "number",
"description": "Total system energy divided by input plus output tokens; a workload-shape-fair view that does not treat prompt tokens as free."
},
"prefill_avg_power_w": {
"type": "number",
"description": "Mean per-GPU power draw in watts across prefill workers; emitted only for deployments with distinct prefill and decode roles."
},
"decode_avg_power_w": {
"type": "number",
"description": "Mean per-GPU power draw in watts across decode workers; emitted only for deployments with distinct prefill and decode roles."
},
"joules_per_input_token": {
"type": "number",
"description": "Energy per input token in joules; cluster-wide on schema-version-2 rows."
},
"prefill_joules_per_input_token": {
"type": "number",
"description": "Role-local prefill energy per input token in joules."
},
"decode_joules_per_output_token": {
"type": "number",
"description": "Role-local decode energy per generated output token in joules."
},
"avg_temp_c": {
"type": "number",
"description": "Mean per-GPU temperature in degrees Celsius during the load window."
},
"peak_temp_c": {
"type": "number",
"description": "Maximum instantaneous per-GPU temperature in degrees Celsius during the load window."
},
"avg_util_pct": {
"type": "number",
"description": "Mean per-GPU utilization percentage (0-100) during the load window."
},
"avg_mem_used_mb": {
"type": "number",
"description": "Mean per-GPU memory used in MB during the load window."
}
}
},
"workers": {
"type": "array",
"items": {
"type": "object",
"properties": {
"role": {
"type": "string"
},
"worker_idx": {
"type": "integer"
},
"hosts": {
"type": "array",
"items": {
"type": "string"
}
},
"num_gpus": {
"type": "integer"
},
"avg_power_w": {
"type": "number"
},
"avg_temp_c": {
"type": "number"
},
"peak_temp_c": {
"type": "number"
},
"avg_util_pct": {
"type": "number"
},
"avg_mem_used_mb": {
"type": "number"
}
},
"required": [
"role",
"worker_idx",
"num_gpus",
"avg_power_w"
],
"additionalProperties": false
}
},
"power_invalid_reasons": {
"type": "array",
"items": {
"type": "string"
},
"description": "Producer snake_case reason codes explaining a withheld measurement, present when metrics.power_valid == 0. Absent on legacy rows and validated rows."
},
"power_audit": {
"type": "object",
"properties": {
"window_start_unix": {
"type": "number"
},
"window_end_unix": {
"type": "number"
},
"expected_gpu_count": {
"type": "integer"
},
"observed_gpu_count": {
"type": "integer"
},
"sample_count": {
"type": "integer"
},
"max_sample_gap_s": {
"type": "number"
},
"producer_sha": {
"type": [
"string",
"null"
]
},
"exporter_image_sha256": {
"type": [
"string",
"null"
]
},
"source": {
"type": "string"
},
"observed_gpu_ids": {
"type": "array",
"items": {
"type": "string"
}
}
},
"additionalProperties": true,
"description": "Compact power measurement-window audit emitted alongside the power_valid verdict: window bounds, expected vs. observed GPU counts, sample statistics, and producer identity (producer_sha / exporter_image_sha256 are null for single-node telemetry without an srt-slurm producer). source is a relative path within the source run artifact bundle; observed_gpu_ids contains producer device identifiers, which may be indices rather than physical UUIDs. Present on valid and invalid rows when emitted; absence alone does not establish age or validity."
},
"date": {
"type": "string",
"format": "date"
},
"workflow_run_id": {
"type": "integer"
},
"run_started_at": {
"type": [
"string",
"null"
],
"format": "date-time"
},
"run_url": {
"type": [
"string",
"null"
]
}
},
"required": [
"id",
"hardware",
"framework",
"model",
"precision",
"spec_method",
"disagg",
"is_multinode",
"prefill_tp",
"prefill_ep",
"prefill_dp_attention",
"prefill_num_workers",
"decode_tp",
"decode_ep",
"decode_dp_attention",
"decode_num_workers",
"num_prefill_gpu",
"num_decode_gpu",
"benchmark_type",
"isl",
"osl",
"conc",
"offload_mode",
"image",
"recipe_fingerprint",
"metrics",
"date",
"run_url"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
[
{
"id": 421,
"hardware": "h200_sxm",
"framework": "vllm",
"model": "dsr1",
"precision": "fp8",
"spec_method": "none",
"disagg": false,
"is_multinode": false,
"prefill_tp": 8,
"prefill_ep": 1,
"prefill_dp_attention": false,
"prefill_num_workers": 1,
"decode_tp": 8,
"decode_ep": 1,
"decode_dp_attention": false,
"decode_num_workers": 1,
"num_prefill_gpu": 0,
"num_decode_gpu": 8,
"benchmark_type": "single_turn",
"isl": 1024,
"osl": 1024,
"conc": 32,
"offload_mode": "off",
"image": "vllm/vllm-openai:v0.10.2",
"recipe_fingerprint": "7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d",
"metrics": {
"median_ttft": 0.42,
"median_tpot": 0.018,
"tput_per_gpu": 128.4,
"power_valid": 1,
"power_metric_schema_version": 2,
"avg_power_w": 678.5,
"joules_per_output_token": 5.3,
"joules_per_total_token": 2.65,
"avg_temp_c": 61.2
},
"date": "2026-08-08",
"run_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789"
}
]滚动查看完整示例。
400
模型缺失或不受支持、计算器序列未知、提供的 powerValid 取值不是 strictV2，或 powerValid=strictV2 与 view=calculator 组合使用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown model"
}500
基准查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/benchmarks/history读取基准历史
返回指定模型在固定输入/输出 token 组合或 Agentic Traces 条件下的历史逻辑快照。被替换的 AgentX 变体仍保留在此前的快照中。append-only 快照包含继承的数据点，并分别提供各点的原始来源运行元数据和曲线快照元数据。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| model | query | string | 必填 | 展示模型名称。 | DeepSeek-R1-0528 |
| isl | query | integer | 可选 | 正整数输入序列长度，单位为 token；除非 benchmarkType=agentic_traces，否则必填。 | 1024 |
| osl | query | integer | 可选 | 正整数输出序列长度，单位为 token；除非 benchmarkType=agentic_traces，否则必填。 | 1024 |
| benchmarkType | query | string | 可选 | 设为 agentic_traces 可在不提供 ISL/OSL 的情况下读取 Agentic Traces 历史。 | agentic_traces |
| view | query | enum | 可选 | calculator 会将每行裁剪为吞吐量计算器所需的指标，以减小响应体积。省略后会保留历史接口提供的其他指标，包括已记录的实测功率。两种视图都不返回 ttft、tpot、itl、e2el 和 intvty 的 mean_* 与 std_* 统计值。 | calculator |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/benchmarks/history?model=DeepSeek-R1-0528&isl=1024&osl=1024'响应
BenchmarkRows200
历史基准行。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"hardware": {
"type": "string"
},
"framework": {
"type": "string"
},
"model": {
"type": "string"
},
"precision": {
"type": "string"
},
"spec_method": {
"type": "string"
},
"disagg": {
"type": "boolean"
},
"is_multinode": {
"type": "boolean"
},
"prefill_tp": {
"type": "integer"
},
"prefill_ep": {
"type": "integer"
},
"prefill_dp_attention": {
"type": "boolean"
},
"prefill_num_workers": {
"type": "integer"
},
"decode_tp": {
"type": "integer"
},
"decode_ep": {
"type": "integer"
},
"decode_dp_attention": {
"type": "boolean"
},
"decode_num_workers": {
"type": "integer"
},
"num_prefill_gpu": {
"type": "integer",
"description": "Physical prefill chips; aggregate engines may mirror their single chip count in both role columns."
},
"num_decode_gpu": {
"type": "integer",
"description": "Physical decode chips, independent of logical TP and DP. Sum role counts only for disaggregated engines."
},
"benchmark_type": {
"type": "string"
},
"isl": {
"type": [
"number",
"null"
]
},
"osl": {
"type": [
"number",
"null"
]
},
"conc": {
"type": "integer"
},
"offload_mode": {
"type": "string"
},
"image": {
"type": [
"string",
"null"
]
},
"recipe_fingerprint": {
"type": [
"string",
"null"
]
},
"metrics": {
"type": "object",
"additionalProperties": {
"type": "number"
},
"description": "Scalar metric map. Time metrics, including p99_itl and p99_tpot, are in seconds. p99_itl measures inter-token latency; p99_tpot measures per-request time per output token. Use the actual p99_itl field for an inter-token latency requirement, not the reciprocal of p99_intvty. Throughput metrics use tokens per second per GPU unless their name states otherwise; output_tput_per_gpu counts output tokens. Keys evolve independently; measured power / energy / GPU-telemetry keys are typed below.",
"properties": {
"power_valid": {
"type": "number",
"description": "Publication verdict: 1 = validated measurement window; 0 = failed validation — measured power/energy values are withheld from this row end-to-end, so treat any that remain as unreliable; absent = no validation verdict is available in this response. Absence alone establishes neither the reason, the measurement age, nor invalidity."
},
"power_metric_schema_version": {
"type": "number",
"description": "Power schema version. Version 2 defines every unprefixed joules_per_* field as whole-deployment energy, including on disaggregated runs."
},
"avg_power_w": {
"type": "number",
"description": "Mean per-GPU power draw in watts during the measured load window."
},
"avg_total_gpu_power_w": {
"type": "number",
"description": "Mean total GPU power draw in watts across the measured deployment."
},
"total_gpu_energy_j": {
"type": "number",
"description": "Total GPU energy integrated over the measured deployment load window, in joules."
},
"p75_power_w": {
"type": "number",
"description": "Time-weighted P75 of synchronized total GPU-board watts, divided by participating GPU count, over the validated benchmark window with piecewise-linear interpolation. Not a percentile of individual-device percentiles; absent when not measured."
},
"p75_total_gpu_power_w": {
"type": "number",
"description": "Time-weighted P75 of synchronized total GPU-board watts over the validated benchmark window with piecewise-linear interpolation. Accelerator boards only, not chassis or facility power."
},
"p90_power_w": {
"type": "number",
"description": "Time-weighted P90 of synchronized total GPU-board watts, divided by participating GPU count, over the validated benchmark window with piecewise-linear interpolation. Not a percentile of individual-device percentiles; absent when not measured."
},
"p90_total_gpu_power_w": {
"type": "number",
"description": "Time-weighted P90 of synchronized total GPU-board watts over the validated benchmark window with piecewise-linear interpolation. Accelerator boards only, not chassis or facility power."
},
"joules_per_successful_query": {
"type": "number",
"description": "Whole-deployment energy in joules divided by successful requests."
},
"joules_per_output_token": {
"type": "number",
"description": "Energy per generated output token in joules; cluster-wide on schema-version-2 rows, including disaggregated runs."
},
"joules_per_total_token": {
"type": "number",
"description": "Total system energy divided by input plus output tokens; a workload-shape-fair view that does not treat prompt tokens as free."
},
"prefill_avg_power_w": {
"type": "number",
"description": "Mean per-GPU power draw in watts across prefill workers; emitted only for deployments with distinct prefill and decode roles."
},
"decode_avg_power_w": {
"type": "number",
"description": "Mean per-GPU power draw in watts across decode workers; emitted only for deployments with distinct prefill and decode roles."
},
"joules_per_input_token": {
"type": "number",
"description": "Energy per input token in joules; cluster-wide on schema-version-2 rows."
},
"prefill_joules_per_input_token": {
"type": "number",
"description": "Role-local prefill energy per input token in joules."
},
"decode_joules_per_output_token": {
"type": "number",
"description": "Role-local decode energy per generated output token in joules."
},
"avg_temp_c": {
"type": "number",
"description": "Mean per-GPU temperature in degrees Celsius during the load window."
},
"peak_temp_c": {
"type": "number",
"description": "Maximum instantaneous per-GPU temperature in degrees Celsius during the load window."
},
"avg_util_pct": {
"type": "number",
"description": "Mean per-GPU utilization percentage (0-100) during the load window."
},
"avg_mem_used_mb": {
"type": "number",
"description": "Mean per-GPU memory used in MB during the load window."
}
}
},
"workers": {
"type": "array",
"items": {
"type": "object",
"properties": {
"role": {
"type": "string"
},
"worker_idx": {
"type": "integer"
},
"hosts": {
"type": "array",
"items": {
"type": "string"
}
},
"num_gpus": {
"type": "integer"
},
"avg_power_w": {
"type": "number"
},
"avg_temp_c": {
"type": "number"
},
"peak_temp_c": {
"type": "number"
},
"avg_util_pct": {
"type": "number"
},
"avg_mem_used_mb": {
"type": "number"
}
},
"required": [
"role",
"worker_idx",
"num_gpus",
"avg_power_w"
],
"additionalProperties": false
}
},
"power_invalid_reasons": {
"type": "array",
"items": {
"type": "string"
},
"description": "Producer snake_case reason codes explaining a withheld measurement, present when metrics.power_valid == 0. Absent on legacy rows and validated rows."
},
"power_audit": {
"type": "object",
"properties": {
"window_start_unix": {
"type": "number"
},
"window_end_unix": {
"type": "number"
},
"expected_gpu_count": {
"type": "integer"
},
"observed_gpu_count": {
"type": "integer"
},
"sample_count": {
"type": "integer"
},
"max_sample_gap_s": {
"type": "number"
},
"producer_sha": {
"type": [
"string",
"null"
]
},
"exporter_image_sha256": {
"type": [
"string",
"null"
]
},
"source": {
"type": "string"
},
"observed_gpu_ids": {
"type": "array",
"items": {
"type": "string"
}
}
},
"additionalProperties": true,
"description": "Compact power measurement-window audit emitted alongside the power_valid verdict: window bounds, expected vs. observed GPU counts, sample statistics, and producer identity (producer_sha / exporter_image_sha256 are null for single-node telemetry without an srt-slurm producer). source is a relative path within the source run artifact bundle; observed_gpu_ids contains producer device identifiers, which may be indices rather than physical UUIDs. Present on valid and invalid rows when emitted; absence alone does not establish age or validity."
},
"date": {
"type": "string",
"format": "date"
},
"workflow_run_id": {
"type": "integer"
},
"run_started_at": {
"type": [
"string",
"null"
],
"format": "date-time"
},
"run_url": {
"type": [
"string",
"null"
]
}
},
"required": [
"id",
"hardware",
"framework",
"model",
"precision",
"spec_method",
"disagg",
"is_multinode",
"prefill_tp",
"prefill_ep",
"prefill_dp_attention",
"prefill_num_workers",
"decode_tp",
"decode_ep",
"decode_dp_attention",
"decode_num_workers",
"num_prefill_gpu",
"num_decode_gpu",
"benchmark_type",
"isl",
"osl",
"conc",
"offload_mode",
"image",
"recipe_fingerprint",
"metrics",
"date",
"run_url"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
[
{
"id": 421,
"hardware": "h200_sxm",
"framework": "vllm",
"model": "dsr1",
"precision": "fp8",
"spec_method": "none",
"disagg": false,
"is_multinode": false,
"prefill_tp": 8,
"prefill_ep": 1,
"prefill_dp_attention": false,
"prefill_num_workers": 1,
"decode_tp": 8,
"decode_ep": 1,
"decode_dp_attention": false,
"decode_num_workers": 1,
"num_prefill_gpu": 0,
"num_decode_gpu": 8,
"benchmark_type": "single_turn",
"isl": 1024,
"osl": 1024,
"conc": 32,
"offload_mode": "off",
"image": "vllm/vllm-openai:v0.10.2",
"recipe_fingerprint": "7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d7d72a33d",
"metrics": {
"median_ttft": 0.42,
"median_tpot": 0.018,
"tput_per_gpu": 128.4,
"power_valid": 1,
"power_metric_schema_version": 2,
"avg_power_w": 678.5,
"joules_per_output_token": 5.3,
"joules_per_total_token": 2.65,
"avg_temp_c": 61.2
},
"date": "2026-08-08",
"run_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789"
}
]滚动查看完整示例。
400
必填参数缺失或模型不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "model, isl, and osl are required"
}500
历史查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/workflow-info读取工作流溯源信息
返回工作流运行、变更记录、可用配置，以及各次运行涵盖的配置。省略 date 时返回所有日期的数据。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| date | query | date | 可选 | 可选的 YYYY-MM-DD 筛选条件。 | 2026-08-08 |
| benchmarkType | query | string | 可选 | 设为 agentic_traces 可将每次运行的配置覆盖限定为 Agentic Traces。 | agentic_traces |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/workflow-info?date=2026-08-08'响应
WorkflowInfo200
工作流溯源信息，分为四个数组。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"runs": {
"type": "array",
"items": {
"type": "object",
"properties": {
"github_run_id": {
"type": "integer"
},
"name": {
"type": "string"
},
"conclusion": {
"type": [
"string",
"null"
]
},
"run_attempt": {
"type": "integer"
},
"html_url": {
"type": [
"string",
"null"
]
},
"created_at": {
"type": "string",
"format": "date-time"
},
"date": {
"type": "string",
"format": "date"
}
},
"required": [
"github_run_id",
"name",
"conclusion",
"run_attempt",
"html_url",
"created_at",
"date"
],
"additionalProperties": false
}
},
"changelogs": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"configs": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"runConfigs": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"runs",
"changelogs",
"configs",
"runConfigs"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"runs": [
{
"github_run_id": 123456789,
"name": "nightly-h200",
"conclusion": "success",
"run_attempt": 1,
"html_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789",
"created_at": "2026-08-08T03:00:00Z",
"date": "2026-08-08"
}
],
"changelogs": [],
"configs": [],
"runConfigs": []
}滚动查看完整示例。
400
date 不是 YYYY-MM-DD。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid date format (YYYY-MM-DD required)"
}500
工作流查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/evaluations列出评估汇总
返回最新尝试的评估结果，包含配置、任务、来源和指标值。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/evaluations'响应
EvaluationRows200
评估结果行。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"config_id": {
"type": "integer"
},
"hardware": {
"type": "string"
},
"framework": {
"type": "string"
},
"model": {
"type": "string"
},
"precision": {
"type": "string"
},
"spec_method": {
"type": "string"
},
"disagg": {
"type": "boolean"
},
"is_multinode": {
"type": "boolean"
},
"prefill_tp": {
"type": "integer"
},
"prefill_ep": {
"type": "integer"
},
"prefill_dp_attention": {
"type": "boolean"
},
"prefill_num_workers": {
"type": "integer"
},
"decode_tp": {
"type": "integer"
},
"decode_ep": {
"type": "integer"
},
"decode_dp_attention": {
"type": "boolean"
},
"decode_num_workers": {
"type": "integer"
},
"num_prefill_gpu": {
"type": "integer",
"description": "Physical prefill chips; aggregate engines may mirror their single chip count in both role columns."
},
"num_decode_gpu": {
"type": "integer",
"description": "Physical decode chips, independent of logical TP and DP. Sum role counts only for disaggregated engines."
},
"task": {
"type": "string"
},
"date": {
"type": "string",
"format": "date"
},
"conc": {
"type": [
"number",
"null"
]
},
"metrics": {
"type": "object",
"additionalProperties": {
"type": "number"
}
},
"timestamp": {
"type": "string",
"format": "date-time"
},
"run_url": {
"type": [
"string",
"null"
]
}
},
"required": [
"id",
"config_id",
"hardware",
"framework",
"model",
"precision",
"spec_method",
"disagg",
"is_multinode",
"prefill_tp",
"prefill_ep",
"prefill_dp_attention",
"prefill_num_workers",
"decode_tp",
"decode_ep",
"decode_dp_attention",
"decode_num_workers",
"num_prefill_gpu",
"num_decode_gpu",
"task",
"date",
"conc",
"metrics",
"timestamp",
"run_url"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
[
{
"id": 72,
"config_id": 11,
"hardware": "h200_sxm",
"framework": "vllm",
"model": "dsr1",
"precision": "fp8",
"spec_method": "none",
"disagg": false,
"is_multinode": false,
"prefill_tp": 8,
"prefill_ep": 1,
"prefill_dp_attention": false,
"prefill_num_workers": 1,
"decode_tp": 8,
"decode_ep": 1,
"decode_dp_attention": false,
"decode_num_workers": 1,
"num_prefill_gpu": 0,
"num_decode_gpu": 8,
"task": "gpqa",
"date": "2026-08-08",
"conc": null,
"metrics": {
"accuracy": 0.78
},
"timestamp": "2026-08-08T03:00:00Z",
"run_url": null
}
]滚动查看完整示例。
500
评估查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/reliability列出基准可靠性
按硬件和日期返回成功运行数与总运行数。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/reliability'响应
ReliabilityRows200
可靠性计数行。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "object",
"properties": {
"hardware": {
"type": "string"
},
"date": {
"type": "string",
"format": "date"
},
"n_success": {
"type": "integer"
},
"total": {
"type": "integer"
}
},
"required": [
"hardware",
"date",
"n_success",
"total"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
[
{
"hardware": "h200_sxm",
"date": "2026-08-08",
"n_success": 18,
"total": 20
}
]500
可靠性查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}外部数据源
面向电子表格、版本跟踪、提交记录和运行镜像的稳定数据源。
GET稳定/api/v1/tco-feed计算 TCO 数据源
为电子表格中的 TCO 模型计算帕累托前沿上的吞吐量数据点或加权分数。所有评分假设都编码在 URL 中。CSV 会以扁平表格形式返回当前所选视图中的相同数据。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| model | query | string | 可选 | 数据库模型键或展示模型名称。 | dsv4 |
| workloads | query | CSV workload list | 可选 | 以逗号分隔的 <isl>x<osl> token 组合。 | 1024x1024,8192x1024 |
| tiers | query | CSV number list | 可选 | 正数交互性目标，单位为每用户每秒输出 token。 | 30,50,75,100 |
| date | query | date | 可选 | 使用 YYYY-MM-DD 当日或之前的数据。省略则使用最新数据。 | 2026-08-08 |
| format | query | enum | 可选 | 响应编码。 | json |
| view | query | enum | 可选 | points 针对每个硬件、工作负载与档位的组合返回一行；scores 针对每个硬件返回一行。 | points |
| weights | query | CSV number list | 可选 | 仅用于 scores。每个档位一个非负权重，并归一化为总和 1。 | 0.35,0.4,0.2,0.05 |
| workload_weights | query | CSV number list | 可选 | 仅用于 scores。每个工作负载对应一个非负权重；所有权重归一化后总和为 1，默认使用等权重。 | 0.5,0.5 |
| alpha | query | number | 可选 | 仅用于 scores。输入 token 价值比，范围为 [0, 10]。 | 0.25 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/tco-feed?model=dsv4&workloads=1024x1024,8192x1024&tiers=30,50,75,100&view=points&format=json'响应
TcoFeed200
所选 points 或 scores 视图的响应对象。
媒体类型: application/json响应结构
代码
{
"oneOf": [
{
"type": "object",
"properties": {
"model": {
"type": "string"
},
"db_model_keys": {
"type": "array",
"items": {
"type": "string"
}
},
"date": {
"type": [
"string",
"null"
],
"format": "date"
},
"workloads": {
"type": "array",
"items": {
"type": "string"
}
},
"tiers": {
"type": "array",
"items": {
"type": "number"
}
},
"rows": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"model",
"db_model_keys",
"date",
"workloads",
"tiers",
"rows"
],
"additionalProperties": false
},
{
"type": "object",
"properties": {
"model": {
"type": "string"
},
"db_model_keys": {
"type": "array",
"items": {
"type": "string"
}
},
"date": {
"type": [
"string",
"null"
],
"format": "date"
},
"workloads": {
"type": "array",
"items": {
"type": "string"
}
},
"tiers": {
"type": "array",
"items": {
"type": "number"
}
},
"weights": {
"type": "array",
"items": {
"type": "number"
}
},
"workload_weights": {
"type": "array",
"items": {
"type": "number"
}
},
"alpha": {
"type": "number"
},
"rows": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"model",
"db_model_keys",
"date",
"workloads",
"tiers",
"weights",
"workload_weights",
"alpha",
"rows"
],
"additionalProperties": false
}
]
}滚动查看完整示例。
响应示例
代码
{
"model": "dsv4",
"db_model_keys": [
"dsv4"
],
"date": null,
"workloads": [
"1024x1024"
],
"tiers": [
50
],
"rows": [
{
"hardware": "h200_sxm",
"workload": "1024x1024",
"tier": 50,
"output_tput_per_gpu": 118.2,
"boundary": "interpolated",
"is_interpolated": true,
"frontier_points": 3,
"frontier_min_interactivity": 30,
"frontier_max_interactivity": 75,
"latest_date": "2026-08-08",
"oldest_frontier_date": "2026-08-06",
"evidence_date": {
"from": "2026-08-06",
"to": "2026-08-08"
}
}
]
}滚动查看完整示例。
其他表示格式: text/csv
响应结构
代码
{
"type": "string"
}响应示例
代码
hardware,workload,tier,output_tput_per_gpu,boundary,frontier_points,frontier_min_interactivity,frontier_max_interactivity,latest_date,oldest_frontier_date
h200_sxm,1024x1024,50,118.2,interpolated,3,30,75,2026-08-08,2026-08-06
400
模型、日期、视图、格式、负载、档位、权重或 alpha 值无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid tiers: expected comma-separated positive numbers"
}500
TCO 计算失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/submissions读取提交覆盖
返回配置级提交汇总和每日硬件提交量。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/submissions'响应
Submissions200
提交汇总和数量数组。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"summary": {
"type": "array",
"items": {
"type": "object",
"properties": {
"model": {
"type": "string"
},
"hardware": {
"type": "string"
},
"framework": {
"type": "string"
},
"precision": {
"type": "string"
},
"spec_method": {
"type": "string"
},
"disagg": {
"type": "boolean"
},
"is_multinode": {
"type": "boolean"
},
"num_prefill_gpu": {
"type": "integer",
"description": "Physical prefill chips; aggregate engines may mirror their single chip count in both role columns."
},
"num_decode_gpu": {
"type": "integer",
"description": "Physical decode chips, independent of logical TP and DP. Sum role counts only for disaggregated engines."
},
"prefill_tp": {
"type": "integer"
},
"prefill_ep": {
"type": "integer"
},
"decode_tp": {
"type": "integer"
},
"decode_ep": {
"type": "integer"
},
"date": {
"type": "string",
"format": "date"
},
"total_datapoints": {
"type": "integer"
},
"distinct_sequences": {
"type": "integer"
},
"distinct_concurrencies": {
"type": "integer"
},
"max_concurrency": {
"type": "integer"
},
"image": {
"type": [
"string",
"null"
]
}
},
"required": [
"model",
"hardware",
"framework",
"precision",
"spec_method",
"disagg",
"is_multinode",
"num_prefill_gpu",
"num_decode_gpu",
"prefill_tp",
"prefill_ep",
"decode_tp",
"decode_ep",
"date",
"total_datapoints",
"distinct_sequences",
"distinct_concurrencies",
"max_concurrency",
"image"
],
"additionalProperties": false
}
},
"volume": {
"type": "array",
"items": {
"type": "object",
"properties": {
"date": {
"type": "string",
"format": "date"
},
"hardware": {
"type": "string"
},
"datapoints": {
"type": "integer"
}
},
"required": [
"date",
"hardware",
"datapoints"
],
"additionalProperties": false
}
}
},
"required": [
"summary",
"volume"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"summary": [
{
"model": "dsr1",
"hardware": "h200_sxm",
"framework": "vllm",
"precision": "fp8",
"spec_method": "none",
"disagg": false,
"is_multinode": false,
"num_prefill_gpu": 0,
"num_decode_gpu": 8,
"prefill_tp": 1,
"prefill_ep": 1,
"decode_tp": 8,
"decode_ep": 1,
"date": "2026-08-08",
"total_datapoints": 24,
"distinct_sequences": 3,
"distinct_concurrencies": 8,
"max_concurrency": 256,
"image": "vllm/vllm-openai:v0.10.2"
}
],
"volume": [
{
"date": "2026-08-08",
"hardware": "h200_sxm",
"datapoints": 24
}
]
}滚动查看完整示例。
500
提交查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/framework-releases读取最新框架版本
返回 vLLM 和 SGLang 最新的非草稿、非预发布 GitHub 版本标签。null 表示上游查询没有可用版本。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/framework-releases'响应
FrameworkReleases200
框架键映射到版本标签或 null。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": {
"type": [
"string",
"null"
]
}
}响应示例
代码
{
"vllm": "v0.10.2",
"sglang": "v0.4.10"
}500
版本查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/latest-images读取最新运行镜像
返回每个基准配置和序列最近观测到的容器镜像。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/latest-images'响应
LatestImageRows200
最新镜像行。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "object",
"properties": {
"model": {
"type": "string"
},
"hardware": {
"type": "string"
},
"framework": {
"type": "string"
},
"precision": {
"type": "string"
},
"spec_method": {
"type": "string"
},
"disagg": {
"type": "boolean"
},
"isl": {
"type": [
"number",
"null"
]
},
"osl": {
"type": [
"number",
"null"
]
},
"benchmark_type": {
"type": "string"
},
"image": {
"type": "string"
},
"date": {
"type": "string",
"format": "date"
}
},
"required": [
"model",
"hardware",
"framework",
"precision",
"spec_method",
"disagg",
"isl",
"osl",
"benchmark_type",
"image",
"date"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
[
{
"model": "dsr1",
"hardware": "h200_sxm",
"framework": "vllm",
"precision": "fp8",
"spec_method": "none",
"disagg": false,
"isl": 1024,
"osl": 1024,
"benchmark_type": "single_turn",
"image": "vllm/vllm-openai:v0.10.2",
"date": "2026-08-08"
},
{
"model": "dsr1",
"hardware": "h200_sxm",
"framework": "vllm",
"precision": "fp8",
"spec_method": "none",
"disagg": false,
"isl": null,
"osl": null,
"benchmark_type": "agentic_traces",
"image": "vllm/vllm-openai:v0.10.2",
"date": "2026-08-08"
}
]滚动查看完整示例。
500
镜像查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}数据集
数据集目录、元数据、会话索引与会话结构。
GET稳定/api/v1/datasets列出已导入的数据集
返回数据集目录卡片，不包含较大的 chart_data 字段。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets'响应
DatasetRecords200
数据集目录记录。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"slug": {
"type": "string"
},
"label": {
"type": "string"
},
"variant": {
"type": "string"
},
"description": {
"type": [
"string",
"null"
]
},
"hf_url": {
"type": [
"string",
"null"
]
},
"license": {
"type": [
"string",
"null"
]
},
"conversation_count": {
"type": "integer"
},
"summary": {
"type": "object",
"additionalProperties": true
},
"ingested_at": {
"type": "string",
"format": "date-time"
}
},
"required": [
"id",
"slug",
"label",
"variant",
"description",
"hf_url",
"license",
"conversation_count",
"summary",
"ingested_at"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
[
{
"id": "ds_01",
"slug": "cc-traces-weka",
"label": "CC Traces Weka",
"variant": "default",
"description": "Agentic coding traces",
"hf_url": "https://huggingface.co/datasets/example/cc-traces-weka",
"license": "Apache-2.0",
"conversation_count": 1200,
"summary": {
"totalIn": 8200000,
"totalOut": 1700000
},
"ingested_at": "2026-08-08T03:00:00Z"
}
]滚动查看完整示例。
500
数据集目录查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/datasets/{slug}读取数据集详情
返回一条数据集目录记录及其预计算的 chart_data 分布。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| slug | path | string | 必填 | 目录中的数据集 slug。 | cc-traces-weka |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets/cc-traces-weka'响应
DatasetDetail200
包含 chart_data 的数据集元数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"id": {
"type": "string"
},
"slug": {
"type": "string"
},
"label": {
"type": "string"
},
"variant": {
"type": "string"
},
"description": {
"type": [
"string",
"null"
]
},
"hf_url": {
"type": [
"string",
"null"
]
},
"license": {
"type": [
"string",
"null"
]
},
"conversation_count": {
"type": "integer"
},
"summary": {
"type": "object",
"additionalProperties": true
},
"ingested_at": {
"type": "string",
"format": "date-time"
},
"chart_data": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"id",
"slug",
"label",
"variant",
"description",
"hf_url",
"license",
"conversation_count",
"summary",
"ingested_at",
"chart_data"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"id": "ds_01",
"slug": "cc-traces-weka",
"label": "CC Traces Weka",
"variant": "default",
"description": "Agentic coding traces",
"hf_url": null,
"license": "Apache-2.0",
"conversation_count": 1200,
"summary": {},
"ingested_at": "2026-08-08T03:00:00Z",
"chart_data": {
"tokens": {
"bins": [
0,
1000,
2000
],
"counts": [
140,
320
]
}
}
}滚动查看完整示例。
404
没有使用此 slug 的数据集。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
数据集查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/datasets/{slug}/conversations列出数据集会话
返回可搜索、排序和分页的会话索引。只包含计数，不包含完整会话结构。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| slug | path | string | 必填 | 目录中的数据集 slug。 | cc-traces-weka |
| search | query | string | 可选 | 按会话 ID 搜索，会先去除首尾空格，最多 100 个字符。 | trace-018 |
| limit | query | integer | 可选 | 每页数量；小于 1 时按 1 处理，大于 200 时按 200 处理。 | 50 |
| offset | query | integer | 可选 | 从 0 开始的行偏移。负数会变为 0。 | 0 |
| sort | query | enum | 可选 | 按 tokens、turns、subagents 或 id 排序。未知值回退到 tokens。 | tokens |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets/cc-traces-weka/conversations?limit=50&offset=0&sort=tokens'响应
ConversationList200
总数和会话索引项。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"total": {
"type": "integer"
},
"items": {
"type": "array",
"items": {
"type": "object",
"properties": {
"conv_id": {
"type": "string"
},
"models": {
"type": "array",
"items": {
"type": "string"
}
},
"num_turns": {
"type": "integer"
},
"num_subagent_groups": {
"type": "integer"
},
"total_in": {
"type": "integer"
},
"total_out": {
"type": "integer"
},
"total_cached": {
"type": "integer"
}
},
"required": [
"conv_id",
"models",
"num_turns",
"num_subagent_groups",
"total_in",
"total_out",
"total_cached"
],
"additionalProperties": false
}
}
},
"required": [
"total",
"items"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"total": 1200,
"items": [
{
"conv_id": "trace-018",
"models": [
"claude-sonnet-4"
],
"num_turns": 42,
"num_subagent_groups": 3,
"total_in": 18200,
"total_out": 4200,
"total_cached": 9600
}
]
}滚动查看完整示例。
400
search 超过 100 个字符。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "search too long"
}404
没有使用此 slug 的数据集。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
会话查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET稳定/api/v1/datasets/{slug}/conversations/{convId}读取会话结构
返回单个会话及可用于火焰图的嵌套结构。App Router 对每个路径值解码一次。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| slug | path | string | 必填 | 目录中的数据集 slug。 | cc-traces-weka |
| convId | path | string | 必填 | 会话 ID，必须与会话索引中列出的值完全一致。 | trace-018 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets/cc-traces-weka/conversations/trace-018'响应
ConversationDetail200
会话计数和嵌套结构。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"conv_id": {
"type": "string"
},
"models": {
"type": "array",
"items": {
"type": "string"
}
},
"num_turns": {
"type": "integer"
},
"num_subagent_groups": {
"type": "integer"
},
"total_in": {
"type": "integer"
},
"total_out": {
"type": "integer"
},
"total_cached": {
"type": "integer"
},
"structure": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"conv_id",
"models",
"num_turns",
"num_subagent_groups",
"total_in",
"total_out",
"total_cached",
"structure"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"conv_id": "trace-018",
"models": [
"claude-sonnet-4"
],
"num_turns": 42,
"num_subagent_groups": 3,
"total_in": 18200,
"total_out": 4200,
"total_cached": 9600,
"structure": {
"name": "trace-018",
"children": []
}
}滚动查看完整示例。
404
数据集或会话不存在。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
会话查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}CollectiveX
带版本的集合通信扫描结果与运行发现数据。
GET测试版/api/v1/collectivex/latest读取最新 CollectiveX 数据集
按需发现并导入最新扫描，然后返回带版本的中立数据集。若刷新失败，会返回已存储的运行。可选的 swap_blocks 结果包含校验通过的复制延迟（微秒）和有效载荷 GB/s（字节数仅计算一次），并保留 block_bytes、num_blocks、运行环境来源及未测量组合数。多平台扫描分别保留各 GPU 池的独立结果。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| version | query | enum | 必填 | CollectiveX 契约版本。 | 1 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/collectivex/latest?version=1'响应
CollectiveXDataset200
最新的 CollectiveX 运行记录、覆盖情况、序列，以及可能存在的 KV 测试用例。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"version": {
"type": "integer"
},
"run": {
"type": "object",
"properties": {
"run_id": {
"type": "string"
},
"run_attempt": {
"type": "integer"
},
"generated_at": {
"type": "string",
"format": "date-time"
},
"conclusion": {
"type": [
"string",
"null"
]
},
"source_sha": {
"type": "string"
},
"requested_cases": {
"type": "integer"
},
"terminal_cases": {
"type": "integer"
},
"measured_cases": {
"type": "integer"
},
"unsupported_cases": {
"type": "integer"
},
"failed_cases": {
"type": "integer"
},
"requested_points": {
"type": "integer"
},
"terminal_points": {
"type": "integer"
},
"measured_points": {
"type": "integer"
},
"covered_skus": {
"type": "array",
"items": {
"type": "string"
}
},
"swap_requested_cases": {
"type": "integer"
},
"swap_measured_cases": {
"type": "integer"
},
"kv_requested_cases": {
"type": "integer"
},
"kv_measured_cases": {
"type": "integer"
}
},
"required": [
"run_id",
"run_attempt",
"generated_at",
"conclusion",
"source_sha",
"requested_cases",
"terminal_cases",
"measured_cases",
"unsupported_cases",
"failed_cases",
"requested_points",
"terminal_points",
"measured_points",
"covered_skus"
],
"additionalProperties": false
},
"coverage": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"series": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"kv": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"swap_blocks": {
"type": "array",
"items": {
"type": "object",
"properties": {
"result_id": {
"type": "string"
},
"sku": {
"type": "string"
},
"runtime": {
"type": "object",
"additionalProperties": true
},
"timing": {
"type": "string"
},
"warmup": {
"type": "integer"
},
"iterations": {
"type": "integer"
},
"max_payload_bytes": {
"oneOf": [
{
"type": "integer"
},
{
"type": "null"
}
]
},
"skipped_points": {
"type": "integer"
},
"points": {
"type": "array",
"items": {
"type": "object",
"properties": {
"direction": {
"type": "string",
"enum": [
"h2d",
"d2h",
"d2d"
]
},
"layout": {
"type": "string",
"enum": [
"contiguous",
"random"
]
},
"block_bytes": {
"type": "integer"
},
"num_blocks": {
"type": "integer"
},
"payload_bytes": {
"type": "integer"
},
"seed": {
"type": "integer"
},
"host_memory": {
"type": "string"
},
"api": {
"type": "string"
},
"sample_count": {
"type": "integer"
},
"latency_us": {
"type": "object",
"additionalProperties": true
},
"payload_gbps_at_latency_percentile": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"direction",
"layout",
"block_bytes",
"num_blocks",
"payload_bytes",
"seed",
"host_memory",
"api",
"sample_count",
"latency_us",
"payload_gbps_at_latency_percentile"
],
"additionalProperties": false
}
}
},
"required": [
"result_id",
"sku",
"runtime",
"timing",
"warmup",
"iterations",
"max_payload_bytes",
"skipped_points",
"points"
],
"additionalProperties": false
}
}
},
"required": [
"version",
"run",
"coverage",
"series"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"version": 1,
"run": {
"run_id": "123456789",
"run_attempt": 1,
"generated_at": "2026-08-08T03:00:00Z",
"conclusion": "success",
"source_sha": "0123456789abcdef",
"requested_cases": 12,
"terminal_cases": 12,
"measured_cases": 10,
"unsupported_cases": 2,
"failed_cases": 0,
"requested_points": 48,
"terminal_points": 48,
"measured_points": 40,
"covered_skus": [
"h200_sxm"
],
"kv_requested_cases": 4,
"kv_measured_cases": 4
},
"coverage": [],
"series": [],
"kv": [],
"swap_blocks": []
}滚动查看完整示例。
400
version 缺失或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown version"
}404
没有已存储或可发现的运行。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}502
上游扫描发现不可用，且没有已存储的回退数据。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unavailable"
}503
上游扫描处理暂时不可用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unavailable"
}500
已存储运行查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/collectivex/runs列出 CollectiveX 运行
返回逐步发现的运行汇总。discovery_complete=false 表示仍在发现更早的运行，客户端可以轮询。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| version | query | enum | 必填 | CollectiveX 契约版本。 | 1 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/collectivex/runs?version=1'响应
CollectiveXRunList200
版本、运行汇总和发现状态。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"version": {
"type": "integer"
},
"runs": {
"type": "array",
"items": {
"type": "object",
"properties": {
"run_id": {
"type": "string"
},
"run_attempt": {
"type": "integer"
},
"generated_at": {
"type": "string",
"format": "date-time"
},
"conclusion": {
"type": [
"string",
"null"
]
},
"covered_skus": {
"type": "array",
"items": {
"type": "string"
}
},
"requested_cases": {
"type": "integer"
},
"measured_cases": {
"type": "integer"
},
"requested_points": {
"type": "integer"
},
"terminal_points": {
"type": "integer"
},
"terminal_counts": {
"type": "object",
"properties": {
"measured": {
"type": "integer"
},
"unsupported": {
"type": "integer"
},
"failed": {
"type": "integer"
}
},
"required": [
"measured",
"unsupported",
"failed"
],
"additionalProperties": false
},
"swap_cases": {
"type": "object",
"properties": {
"requested": {
"type": "integer"
},
"measured": {
"type": "integer"
}
},
"required": [
"requested",
"measured"
],
"additionalProperties": false
},
"kv_cases": {
"type": "object",
"properties": {
"requested": {
"type": "integer"
},
"measured": {
"type": "integer"
}
},
"required": [
"requested",
"measured"
],
"additionalProperties": false
}
},
"required": [
"run_id",
"run_attempt",
"generated_at",
"conclusion",
"covered_skus",
"requested_cases",
"measured_cases",
"requested_points",
"terminal_points",
"terminal_counts"
],
"additionalProperties": false
}
},
"discovery_complete": {
"type": "boolean"
}
},
"required": [
"version",
"runs",
"discovery_complete"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"version": 1,
"runs": [
{
"run_id": "123456789",
"run_attempt": 1,
"generated_at": "2026-08-08T03:00:00Z",
"conclusion": "success",
"covered_skus": [
"h200_sxm"
],
"requested_cases": 12,
"measured_cases": 10,
"requested_points": 48,
"terminal_points": 48,
"terminal_counts": {
"measured": 40,
"unsupported": 8,
"failed": 0
},
"kv_cases": {
"requested": 4,
"measured": 4
}
}
],
"discovery_complete": true
}滚动查看完整示例。
400
version 缺失或不受支持。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown version"
}502
发现失败，且没有已存储的运行列表。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unavailable"
}503
发现暂时不可用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unavailable"
}500
已存储运行列表查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/collectivex/runs/{runId}读取 CollectiveX 运行
按正整数运行 ID 返回带版本的 CollectiveX 数据集，并在可能时按需发现和导入。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| runId | path | integer | 必填 | GitHub Actions 正整数运行 ID。 | 123456789 |
| version | query | enum | 必填 | CollectiveX 契约版本。 | 1 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/collectivex/runs/123456789?version=1'响应
CollectiveXDataset200
请求的 CollectiveX 数据集。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"version": {
"type": "integer"
},
"run": {
"type": "object",
"properties": {
"run_id": {
"type": "string"
},
"run_attempt": {
"type": "integer"
},
"generated_at": {
"type": "string",
"format": "date-time"
},
"conclusion": {
"type": [
"string",
"null"
]
},
"source_sha": {
"type": "string"
},
"requested_cases": {
"type": "integer"
},
"terminal_cases": {
"type": "integer"
},
"measured_cases": {
"type": "integer"
},
"unsupported_cases": {
"type": "integer"
},
"failed_cases": {
"type": "integer"
},
"requested_points": {
"type": "integer"
},
"terminal_points": {
"type": "integer"
},
"measured_points": {
"type": "integer"
},
"covered_skus": {
"type": "array",
"items": {
"type": "string"
}
},
"swap_requested_cases": {
"type": "integer"
},
"swap_measured_cases": {
"type": "integer"
},
"kv_requested_cases": {
"type": "integer"
},
"kv_measured_cases": {
"type": "integer"
}
},
"required": [
"run_id",
"run_attempt",
"generated_at",
"conclusion",
"source_sha",
"requested_cases",
"terminal_cases",
"measured_cases",
"unsupported_cases",
"failed_cases",
"requested_points",
"terminal_points",
"measured_points",
"covered_skus"
],
"additionalProperties": false
},
"coverage": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"series": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"kv": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"swap_blocks": {
"type": "array",
"items": {
"type": "object",
"properties": {
"result_id": {
"type": "string"
},
"sku": {
"type": "string"
},
"runtime": {
"type": "object",
"additionalProperties": true
},
"timing": {
"type": "string"
},
"warmup": {
"type": "integer"
},
"iterations": {
"type": "integer"
},
"max_payload_bytes": {
"oneOf": [
{
"type": "integer"
},
{
"type": "null"
}
]
},
"skipped_points": {
"type": "integer"
},
"points": {
"type": "array",
"items": {
"type": "object",
"properties": {
"direction": {
"type": "string",
"enum": [
"h2d",
"d2h",
"d2d"
]
},
"layout": {
"type": "string",
"enum": [
"contiguous",
"random"
]
},
"block_bytes": {
"type": "integer"
},
"num_blocks": {
"type": "integer"
},
"payload_bytes": {
"type": "integer"
},
"seed": {
"type": "integer"
},
"host_memory": {
"type": "string"
},
"api": {
"type": "string"
},
"sample_count": {
"type": "integer"
},
"latency_us": {
"type": "object",
"additionalProperties": true
},
"payload_gbps_at_latency_percentile": {
"type": "object",
"additionalProperties": true
}
},
"required": [
"direction",
"layout",
"block_bytes",
"num_blocks",
"payload_bytes",
"seed",
"host_memory",
"api",
"sample_count",
"latency_us",
"payload_gbps_at_latency_percentile"
],
"additionalProperties": false
}
}
},
"required": [
"result_id",
"sku",
"runtime",
"timing",
"warmup",
"iterations",
"max_payload_bytes",
"skipped_points",
"points"
],
"additionalProperties": false
}
}
},
"required": [
"version",
"run",
"coverage",
"series"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"version": 1,
"run": {
"run_id": "123456789",
"run_attempt": 1,
"generated_at": "2026-08-08T03:00:00Z",
"conclusion": "success",
"source_sha": "0123456789abcdef",
"requested_cases": 12,
"terminal_cases": 12,
"measured_cases": 10,
"unsupported_cases": 2,
"failed_cases": 0,
"requested_points": 48,
"terminal_points": 48,
"measured_points": 40,
"covered_skus": [
"h200_sxm"
],
"kv_requested_cases": 4,
"kv_measured_cases": 4
},
"coverage": [],
"series": [],
"kv": [],
"swap_blocks": []
}滚动查看完整示例。
400
version 或 runId 无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unknown version or run id"
}404
该运行不存在。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}502
无法从上游来源获取该运行。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unavailable"
}503
上游处理暂时不可用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Unavailable"
}500
运行查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}OperatorX
GEMM、attention 和路由 MoE 实测数据及完整运行覆盖情况。
GET测试版/api/v1/operatorx/runs列出 OperatorX 运行
列出已存储的手动 OperatorX 运行，按运行 ID 从新到旧排序，不限制分支。每次请求最多从最近 44 天的记录导入四次运行；discovery_complete=false 表示需要继续获取。原始文档在产物过期后仍会保留。列出运行时，根据已保存文档重建读取器版本 3 之前的摘要缓存。发现完成时缓存 60 秒，未完成时不缓存。服务端需要 GitHub 访问权限和 DATABASE_OPERATORX_WRITE_URL。本机开发环境可通过 OPERATORX_LOCAL_ARTIFACT_DIR 显式读取已下载的数据；生产环境不读取本地文件。
参数
无需参数。
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/operatorx/runs'响应
OperatorXRunList200
运行摘要。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"runs": {
"type": "array",
"items": {
"type": "object",
"properties": {
"run_id": {
"type": "string"
},
"run_attempt": {
"type": "number"
},
"source_sha": {
"type": "string"
},
"source_branch": {
"type": [
"string",
"null"
]
},
"generated_at": {
"type": "string"
},
"conclusion": {
"type": [
"string",
"null"
]
},
"requested": {
"type": "number"
},
"measured": {
"type": "number"
},
"unsupported": {
"type": "number"
},
"failed": {
"type": "number"
},
"missing": {
"type": "number"
},
"clusters": {
"type": "array",
"items": {
"type": "string"
}
},
"testlists": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"run_id",
"run_attempt",
"source_sha",
"source_branch",
"generated_at",
"conclusion",
"requested",
"measured",
"unsupported",
"failed",
"missing",
"clusters",
"testlists"
],
"additionalProperties": false
}
},
"discovery_complete": {
"type": "boolean"
}
},
"required": [
"runs",
"discovery_complete"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"runs": [
{
"run_id": "123456789",
"run_attempt": 1,
"source_sha": "0123456789abcdef",
"source_branch": "example",
"generated_at": "2026-09-16T12:00:00Z",
"conclusion": "success",
"requested": 1,
"measured": 1,
"unsupported": 0,
"failed": 0,
"missing": 0,
"clusters": [
"h100_dgxc_8x"
],
"testlists": [
"gemm"
]
}
],
"discovery_complete": true
}滚动查看完整示例。
404
工作流不可用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX unavailable"
}409
运行尚未结束。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX unavailable"
}502
GitHub 来源不可用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX unavailable"
}503
存储或配置不可用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX unavailable"
}GET测试版/api/v1/operatorx/runs/{runId}读取 OperatorX 运行
按执行清单读取 GEMM、MHA/GQA、物化 MLA 和路由 MoE 测试。版本 3 增加 moe_gemm 及可空的 moe 对象，保留本地/全局维度、EP/TP、top-k、路由分布和精度。不适用的 GEMM、attention 和 MoE 字段为 null。MoE TFLOPS = 6*T*H*(top_k*local_intermediate+n_shared_experts*intermediate/shared_tensor_parallel_size)/(latency_us*1e6)，其中 local_intermediate=intermediate/routed_tensor_parallel_size，不再除以 EP。Kimi K3 vLLM benchmark profile 测量通用 SiLU 专家，使用预先生成的本地路由，不包含原生 K3 的 SITU、latent 投影、共享专家或通信。Attention TFLOPS = 2*B*Hq*P*(Dqk+Dv)/(latency_us*1e6)，其中非因果 attention 的 P=Sq*Sk；右下对齐的因果掩码使用 R*(2*Sk-R+1)/2，R=min(Sq,Sk)。该指标统计 QK 和 AV 矩阵乘法的有效计算量，包含对角线，不计 softmax、缓存投影和 RoPE。GQA 使用 query head 数；MLA 使用物化 Q/K/V 维度。已有 attention 运行在读取时即可获得 TFLOPS。每个分片采用最新尝试的结果，局部重跑时保留未重跑分片的数据。校验源码、运行、尝试次数和集群来源。GEMM 单卡 TFLOPS = 2*M*N*K/(latency_us*1e6)；不支持、失败、缺失或零维度测试的 TFLOPS 为 null。已结束但失败的运行仍可能包含实测数据。服务端按需保存原始产物，GitHub 不可用时返回已存储结果，缓存 60 秒。支持与运行列表相同的本机开发预览。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| runId | path | integer | 必填 | GitHub Actions 正整数运行 ID。 | 123456789 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/operatorx/runs/123456789'响应
OperatorXDataset200
运行覆盖情况和测量结果。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"version": {
"type": "integer",
"enum": [
3
]
},
"run": {
"type": "object",
"properties": {
"run_id": {
"type": "string"
},
"run_attempt": {
"type": "number"
},
"source_sha": {
"type": "string"
},
"source_branch": {
"type": [
"string",
"null"
]
},
"generated_at": {
"type": "string"
},
"conclusion": {
"type": [
"string",
"null"
]
},
"requested": {
"type": "number"
},
"measured": {
"type": "number"
},
"unsupported": {
"type": "number"
},
"failed": {
"type": "number"
},
"missing": {
"type": "number"
},
"clusters": {
"type": "array",
"items": {
"type": "string"
}
},
"testlists": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"run_id",
"run_attempt",
"source_sha",
"source_branch",
"generated_at",
"conclusion",
"requested",
"measured",
"unsupported",
"failed",
"missing",
"clusters",
"testlists"
],
"additionalProperties": false
},
"points": {
"type": "array",
"items": {
"type": "object",
"properties": {
"type": {
"type": "string",
"enum": [
"gemm",
"attention_mha",
"attention_mla",
"moe_gemm"
]
},
"args": {
"type": "object",
"additionalProperties": true
},
"attention": {
"type": [
"object",
"null"
],
"properties": {
"batch_size": {
"type": "number"
},
"seq_len_q": {
"type": "number"
},
"seq_len_kv": {
"type": "number"
},
"num_heads": {
"type": "number"
},
"num_heads_kv": {
"type": "number"
},
"head_dim_qk": {
"type": "number"
},
"head_dim_v": {
"type": "number"
},
"kv_lora_rank": {
"type": [
"number",
"null"
]
},
"dtype_q": {
"type": "string"
},
"dtype_k": {
"type": "string"
},
"dtype_v": {
"type": "string"
},
"dtype_o": {
"type": "string"
},
"causal": {
"type": "boolean"
}
},
"required": [
"batch_size",
"seq_len_q",
"seq_len_kv",
"num_heads",
"num_heads_kv",
"head_dim_qk",
"head_dim_v",
"kv_lora_rank",
"dtype_q",
"dtype_k",
"dtype_v",
"dtype_o",
"causal"
],
"additionalProperties": false
},
"moe": {
"type": [
"object",
"null"
],
"properties": {
"num_tokens": {
"type": "number"
},
"hidden": {
"type": "number"
},
"intermediate": {
"type": "number"
},
"local_intermediate": {
"type": "number"
},
"num_experts": {
"type": "number"
},
"local_experts": {
"type": "number"
},
"top_k": {
"type": "number"
},
"expert_parallel_size": {
"type": "number"
},
"routed_tensor_parallel_size": {
"type": "number"
},
"shared_tensor_parallel_size": {
"type": "number"
},
"n_shared_experts": {
"type": "number"
},
"dtype_act": {
"type": "string"
},
"dtype_weight": {
"type": "string"
},
"expert_distribution": {
"type": "string"
}
},
"required": [
"num_tokens",
"hidden",
"intermediate",
"local_intermediate",
"num_experts",
"local_experts",
"top_k",
"expert_parallel_size",
"routed_tensor_parallel_size",
"shared_tensor_parallel_size",
"n_shared_experts",
"dtype_act",
"dtype_weight",
"expert_distribution"
],
"additionalProperties": false
},
"id": {
"type": "string"
},
"shard": {
"type": "string"
},
"attempt": {
"type": [
"number",
"null"
]
},
"cluster": {
"type": "string"
},
"backend": {
"type": "string"
},
"testlist": {
"type": "string"
},
"name": {
"type": [
"string",
"null"
]
},
"m": {
"type": [
"number",
"null"
]
},
"n": {
"type": [
"number",
"null"
]
},
"k": {
"type": [
"number",
"null"
]
},
"dtype_a": {
"type": [
"string",
"null"
]
},
"dtype_b": {
"type": [
"string",
"null"
]
},
"dtype_out": {
"type": [
"string",
"null"
]
},
"status": {
"type": "string",
"enum": [
"ok",
"unsupported",
"error",
"missing"
]
},
"message": {
"type": [
"string",
"null"
]
},
"latency_us": {
"type": [
"number",
"null"
]
},
"tflops": {
"type": [
"number",
"null"
]
}
},
"required": [
"type",
"args",
"attention",
"moe",
"id",
"shard",
"attempt",
"cluster",
"backend",
"testlist",
"name",
"m",
"n",
"k",
"dtype_a",
"dtype_b",
"dtype_out",
"status",
"message",
"latency_us",
"tflops"
],
"additionalProperties": false
}
}
},
"required": [
"version",
"run",
"points"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"version": 3,
"run": {
"run_id": "123456789",
"run_attempt": 1,
"source_sha": "0123456789abcdef",
"source_branch": "example",
"generated_at": "2026-09-16T12:00:00Z",
"conclusion": "success",
"requested": 3,
"measured": 3,
"unsupported": 0,
"failed": 0,
"missing": 0,
"clusters": [
"h100_dgxc_8x"
],
"testlists": [
"gemm",
"attention",
"moe"
]
},
"points": [
{
"type": "gemm",
"args": {
"m": 1000,
"n": 1000,
"k": 1000,
"dtype_a": "bf16",
"dtype_b": "bf16",
"dtype_out": "bf16"
},
"attention": null,
"moe": null,
"id": "shard:0:torch",
"shard": "shard",
"attempt": 1,
"cluster": "h100_dgxc_8x",
"backend": "torch",
"testlist": "gemm",
"name": null,
"m": 1000,
"n": 1000,
"k": 1000,
"dtype_a": "bf16",
"dtype_b": "bf16",
"dtype_out": "bf16",
"status": "ok",
"message": null,
"latency_us": 1000,
"tflops": 2
},
{
"type": "attention_mha",
"args": {
"batch_size": 8,
"seq_len_q": 1,
"seq_len_kv": 4096,
"num_heads": 32,
"num_heads_kv": 8,
"head_dim": 128,
"dtype_q": "bf16",
"dtype_k": "bf16",
"dtype_v": "bf16",
"dtype_o": "bf16",
"causal": true
},
"attention": {
"batch_size": 8,
"seq_len_q": 1,
"seq_len_kv": 4096,
"num_heads": 32,
"num_heads_kv": 8,
"head_dim_qk": 128,
"head_dim_v": 128,
"kv_lora_rank": null,
"dtype_q": "bf16",
"dtype_k": "bf16",
"dtype_v": "bf16",
"dtype_o": "bf16",
"causal": true
},
"moe": null,
"id": "shard:1:torch",
"shard": "shard",
"attempt": 1,
"cluster": "h100_dgxc_8x",
"backend": "torch",
"testlist": "attention",
"name": null,
"m": null,
"n": null,
"k": null,
"dtype_a": null,
"dtype_b": null,
"dtype_out": null,
"status": "ok",
"message": null,
"latency_us": 12.5,
"tflops": 42.94967296
},
{
"type": "moe_gemm",
"args": {
"num_tokens": 128,
"hidden": 1024,
"intermediate": 2048,
"num_experts": 64,
"top_k": 4,
"expert_parallel_size": 8,
"routed_tensor_parallel_size": 2,
"shared_tensor_parallel_size": 1,
"n_shared_experts": 0,
"dtype_act": "bf16",
"dtype_weight": "bf16",
"expert_distribution": "uniform"
},
"moe": {
"num_tokens": 128,
"hidden": 1024,
"intermediate": 2048,
"local_intermediate": 1024,
"num_experts": 64,
"local_experts": 8,
"top_k": 4,
"expert_parallel_size": 8,
"routed_tensor_parallel_size": 2,
"shared_tensor_parallel_size": 1,
"n_shared_experts": 0,
"dtype_act": "bf16",
"dtype_weight": "bf16",
"expert_distribution": "uniform"
},
"attention": null,
"id": "moe-shard:0:vllm",
"shard": "moe-shard",
"attempt": 1,
"cluster": "h100_dgxc_8x",
"backend": "vllm",
"testlist": "moe",
"name": "Controlled routed expert profile",
"m": null,
"n": null,
"k": null,
"dtype_a": null,
"dtype_b": null,
"dtype_out": null,
"status": "ok",
"message": null,
"latency_us": 100,
"tflops": 32.21225472
}
]
}滚动查看完整示例。
400
运行 ID 无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX run unavailable"
}404
找不到运行或产物。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX run unavailable"
}409
运行尚未结束。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX run unavailable"
}502
GitHub 来源不可用。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX run unavailable"
}503
存储、配置或产物校验失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "OperatorX run unavailable"
}诊断读取
按结果提供跟踪、缓存、请求、同组结果和服务器指标诊断。
GET测试版/api/v1/agentic-aggregates读取智能体汇总百分位
按基准结果 ID 返回 ISL、OSL、KV 缓存利用率和前缀缓存命中率百分位。ID 会去重，最多接受 200 个。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| ids | query | comma-separated integers | 必填 | 1 到 200 个正整数基准结果 ID。 | 421,422 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/agentic-aggregates?ids=421,422'响应
AgenticAggregateMap200
结果 ID 映射到汇总百分位或 null 指标组。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": {
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"isl": {
"oneOf": [
{
"type": "object",
"properties": {
"mean": {
"type": "number"
},
"p50": {
"type": "number"
},
"p75": {
"type": "number"
},
"p90": {
"type": "number"
},
"p95": {
"type": "number"
},
"p99": {
"type": "number"
},
"n": {
"type": "integer"
}
},
"required": [
"mean",
"p50",
"p75",
"p90",
"p95",
"p99",
"n"
],
"additionalProperties": false
},
{
"type": "null"
}
]
},
"osl": {
"oneOf": [
{
"type": "object",
"properties": {
"mean": {
"type": "number"
},
"p50": {
"type": "number"
},
"p75": {
"type": "number"
},
"p90": {
"type": "number"
},
"p95": {
"type": "number"
},
"p99": {
"type": "number"
},
"n": {
"type": "integer"
}
},
"required": [
"mean",
"p50",
"p75",
"p90",
"p95",
"p99",
"n"
],
"additionalProperties": false
},
{
"type": "null"
}
]
},
"kvCacheUtil": {
"oneOf": [
{
"type": "object",
"properties": {
"mean": {
"type": "number"
},
"p50": {
"type": "number"
},
"p75": {
"type": "number"
},
"p90": {
"type": "number"
},
"p95": {
"type": "number"
},
"p99": {
"type": "number"
},
"n": {
"type": "integer"
}
},
"required": [
"mean",
"p50",
"p75",
"p90",
"p95",
"p99",
"n"
],
"additionalProperties": false
},
{
"type": "null"
}
]
},
"prefixCacheHitRate": {
"oneOf": [
{
"type": "object",
"properties": {
"mean": {
"type": "number"
},
"p50": {
"type": "number"
},
"p75": {
"type": "number"
},
"p90": {
"type": "number"
},
"p95": {
"type": "number"
},
"p99": {
"type": "number"
},
"n": {
"type": "integer"
}
},
"required": [
"mean",
"p50",
"p75",
"p90",
"p95",
"p99",
"n"
],
"additionalProperties": false
},
{
"type": "null"
}
]
}
},
"required": [
"id",
"isl",
"osl",
"kvCacheUtil",
"prefixCacheHitRate"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
{
"421": {
"id": 421,
"isl": {
"mean": 18320,
"p50": 16440,
"p75": 20110,
"p90": 24880,
"p95": 27940,
"p99": 31900,
"n": 512
},
"osl": null,
"kvCacheUtil": null,
"prefixCacheHitRate": null
}
}滚动查看完整示例。
400
ids 缺失、格式错误或超过 200 个唯一 ID。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "ids query param is required"
}500
汇总查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/benchmark-siblings读取同组基准点
返回基准 SKU，以及同一硬件、框架、模型、精度、方法、基准类型和工作流运行中的全部点。同组结果的工作负载可能不同。is_current 仅在结果 ID 与请求的 ID 相同时为 true；false 不表示结果已过时、无效或已被替代。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| id | query | integer | 必填 | 正整数基准结果 ID。 | 421 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/benchmark-siblings?id=421'响应
BenchmarkSiblings200
SKU 元数据和同组导航行。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"sku": {
"type": "object",
"additionalProperties": true
},
"siblings": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"sku",
"siblings"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"sku": {
"hardware": "h200_sxm",
"framework": "vllm",
"model": "dsr1",
"precision": "fp8",
"spec_method": "none",
"benchmark_type": "agentic_traces",
"github_run_id": 123456789,
"date": "2026-08-08",
"dataset_slug": "cc-traces-weka"
},
"siblings": [
{
"id": 421,
"conc": 32,
"offload_mode": "off",
"decode_tp": 8,
"decode_ep": 1,
"decode_pp": null,
"decode_dcp_size": 8,
"decode_pcp_size": 1,
"decode_dp_attention": false,
"decode_num_workers": 1,
"prefill_tp": 8,
"prefill_ep": 1,
"prefill_pp": null,
"prefill_dcp_size": 8,
"prefill_pcp_size": 1,
"prefill_dp_attention": false,
"prefill_num_workers": 1,
"num_prefill_gpu": 0,
"num_decode_gpu": 8,
"disagg": false,
"is_multinode": false,
"tput_per_gpu": 128.4,
"total_requests": 320,
"is_current": true,
"has_trace": true
}
]
}滚动查看完整示例。
400
id 缺失或无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "id is required (benchmark_result_id)"
}404
没有使用此 ID 的基准结果。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
同组查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/derived-agentic-metrics读取派生智能体指标
按基准结果 ID 返回归一化交互性百分位。ID 会去重，最多接受 200 个。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| ids | query | comma-separated integers | 必填 | 1 到 200 个正整数基准结果 ID。 | 421,422 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/derived-agentic-metrics?ids=421,422'响应
DerivedAgenticMetricMap200
结果 ID 映射到 p75 和 p90 归一化交互性。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": {
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"p75_e2e_norm_intvty": {
"type": [
"number",
"null"
]
},
"p90_e2e_norm_intvty": {
"type": [
"number",
"null"
]
}
},
"required": [
"id",
"p75_e2e_norm_intvty",
"p90_e2e_norm_intvty"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
{
"421": {
"id": 421,
"p75_e2e_norm_intvty": 31.2,
"p90_e2e_norm_intvty": 24.8
}
}400
ids 缺失、格式错误或超过 200 个唯一 ID。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "ids query param is required"
}500
派生指标查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/request-timeline读取请求时间线
返回带版本号的基准测试时间窗口，以及每个请求的重放标识、来源追溯信息、调度/确认/完成/取消时间、token 指标、阶段和 worker 信息。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| id | query | integer | 必填 | 正整数基准结果 ID。 | 421 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/request-timeline?id=421'响应
RequestTimeline200
时间线元数据和请求记录。纳秒事件字段是相对 startNs 的偏移。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"version": {
"type": "integer"
},
"startNs": {
"type": "integer"
},
"endNs": {
"type": "integer"
},
"durationS": {
"type": "number"
},
"requests": {
"type": "array",
"items": {
"type": "object",
"properties": {
"cid": {
"type": "string"
},
"ri": {
"type": "integer"
},
"ti": {
"type": "integer"
},
"srcTrace": {
"type": "string"
},
"srcOuter": {
"type": "integer"
},
"srcInner": {
"type": "integer"
},
"srcKind": {
"type": "string"
},
"wid": {
"type": "string"
},
"ad": {
"type": "integer"
},
"phase": {
"type": "string"
},
"credit": {
"type": "integer"
},
"start": {
"type": "integer"
},
"ack": {
"type": [
"number",
"null"
]
},
"end": {
"type": "integer"
},
"ttftMs": {
"type": [
"number",
"null"
]
},
"tpotMs": {
"type": [
"number",
"null"
]
},
"isl": {
"type": [
"number",
"null"
]
},
"osl": {
"type": [
"number",
"null"
]
},
"cancelled": {
"type": "boolean"
}
},
"required": [
"cid",
"ti",
"wid",
"ad",
"phase",
"credit",
"start",
"ack",
"end",
"ttftMs",
"tpotMs",
"isl",
"osl",
"cancelled"
],
"additionalProperties": false
}
}
},
"required": [
"version",
"startNs",
"endNs",
"durationS",
"requests"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"version": 6,
"startNs": 1000000000,
"endNs": 2400000000,
"durationS": 1.4,
"requests": [
{
"cid": "trace-018",
"ri": 0,
"ti": 0,
"wid": "7",
"ad": 0,
"phase": "profiling",
"credit": 0,
"start": 1200000,
"ack": 1800000,
"end": 420000000,
"ttftMs": 42.3,
"tpotMs": 18.1,
"isl": 18320,
"osl": 410,
"cancelled": false
}
]
}滚动查看完整示例。
400
id 缺失或无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "id is required (benchmark_result_id)"
}404
该结果没有时间线。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
时间线查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/server-log读取基准服务器日志
返回某个基准测试结果 ID 对应的一份已存储的 .log/.out 文件。file 应使用 server-log-files 返回的文件名。可添加 offset 或 limit，按指定范围分块读取；添加 download=1 可将完整的所选文件作为文本附件流式下载。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| id | query | integer | 必填 | 正整数基准结果 ID。 | 421 |
| file | query | string | 可选 | 产物内的相对文件名。省略时读取主文件或旧版日志文件。 | results/router.log |
| offset | query | integer | 可选 | 从零开始的字符偏移量。提供 offset 或 limit 后启用分块模式。 | 0 |
| limit | query | integer | 可选 | 分块字符数，范围为 1 到 262144，默认值为 65536。 | 65536 |
| download | query | integer | 可选 | 设为 1 时，将完整的所选文件作为文本附件流式下载；不能与 offset 或 limit 同时使用。 | 1 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/server-log?id=421&file=results%2Frouter.log&offset=0&limit=65536'响应
ServerLog | ServerLogChunk | text/plain attachment200
基准结果 ID 和服务器日志文本；分块模式还会返回范围元数据。
媒体类型: application/json响应结构
代码
{
"oneOf": [
{
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"serverLog": {
"type": "string"
}
},
"required": [
"id",
"serverLog"
],
"additionalProperties": false
},
{
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"fileName": {
"type": "string"
},
"serverLog": {
"type": "string"
},
"offset": {
"type": "integer"
},
"nextOffset": {
"type": [
"number",
"null"
]
}
},
"required": [
"id",
"fileName",
"serverLog",
"offset",
"nextOffset"
],
"additionalProperties": false
}
]
}滚动查看完整示例。
响应示例
代码
{
"id": 421,
"fileName": "results/router.log",
"serverLog": "INFO router initialized\n",
"offset": 0,
"nextOffset": 24
}400
id 缺失或无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "id is required (benchmark_result_id)"
}404
该结果没有服务器日志。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
服务器日志查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/server-log-search搜索完整基准测试日志
在某个基准测试结果对应的所有已存储 .log/.out 文件中，按字面值执行不区分大小写的搜索。响应仅返回数量受限的上下文片段，无需传输完整日志文件。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| id | query | integer | 必填 | 正整数基准结果 ID。 | 421 |
| q | query | string | 必填 | 按字面值匹配的搜索文本，长度为 1 到 256 个字符。 | router ready |
| limit | query | integer | 可选 | 最多返回的匹配数，范围为 1 到 100，默认值为 50。 | 50 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/server-log-search?id=421&q=router%20ready&limit=50'响应
ServerLogSearchResult200
数量有上限的匹配结果，包含文件名、字符偏移量和上下文文本。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"query": {
"type": "string"
},
"matches": {
"type": "array",
"items": {
"type": "object",
"properties": {
"fileName": {
"type": "string"
},
"offset": {
"type": "integer"
},
"before": {
"type": "string"
},
"match": {
"type": "string"
},
"after": {
"type": "string"
}
},
"required": [
"fileName",
"offset",
"before",
"match",
"after"
],
"additionalProperties": false
}
},
"truncated": {
"type": "boolean"
}
},
"required": [
"id",
"query",
"matches",
"truncated"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"id": 421,
"query": "router ready",
"matches": [
{
"fileName": "results/router.log",
"offset": 128,
"before": "INFO ",
"match": "router ready",
"after": " on port 8000\n"
}
],
"truncated": false
}滚动查看完整示例。
400
搜索参数无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Invalid query"
}500
完整日志搜索失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/server-log-files列出已存储的基准测试日志文件
列出匹配服务器日志产物中保留的所有 .log 和 .out 文件名。路径相对于产物根目录返回，主文件排在首位。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| id | query | integer | 必填 | 正整数基准结果 ID。 | 421 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/server-log-files?id=421'响应
ServerLogFileNames200
相对于产物根目录的 .log/.out 文件名。
媒体类型: application/json响应结构
代码
{
"type": "array",
"items": {
"type": "string"
}
}响应示例
代码
[
"results/server.log",
"results/benchmark.log",
"results/router.log"
]400
id 缺失或无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "id is required (benchmark_result_id)"
}404
该结果没有日志文件集合。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
日志文件名查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/log-availability检查服务器日志可用性
仅返回具有已存储服务器日志的基准结果 ID。ID 会去重，最多接受 500 个。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| ids | query | comma-separated integers | 必填 | 1 到 500 个正整数基准结果 ID。 | 421,422 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/log-availability?ids=421,422'响应
LogAvailabilityMap200
可用结果 ID 映射为 true。缺失的键表示没有服务器日志。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": {
"type": "boolean"
}
}响应示例
代码
{
"421": true
}400
ids 缺失、格式错误或超过 500 个唯一 ID。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Expected ids as comma-separated positive integers"
}500
服务器日志可用性查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/trace-availability检查跟踪可用性
仅返回具有已存储跟踪的基准结果 ID。ID 会去重，最多接受 500 个。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| ids | query | comma-separated integers | 必填 | 1 到 500 个正整数基准结果 ID。 | 421,422 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/trace-availability?ids=421,422'响应
TraceAvailabilityMap200
可用结果 ID 映射为 true。缺失的键表示没有跟踪。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": {
"type": "boolean"
}
}响应示例
代码
{
"421": true
}400
ids 缺失、格式错误或超过 500 个唯一 ID。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "ids query param is required"
}500
跟踪可用性查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/trace-histograms读取跟踪直方图
按基准结果 ID 返回输入和输出 token 计数数组。ID 会去重，最多接受 200 个。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| ids | query | comma-separated integers | 必填 | 1 到 200 个正整数基准结果 ID。 | 421,422 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/trace-histograms?ids=421,422'响应
TraceHistogramMap200
结果 ID 映射到原始 ISL 和 OSL 样本。
媒体类型: application/json响应结构
代码
{
"type": "object",
"additionalProperties": {
"type": "object",
"properties": {
"id": {
"type": "integer"
},
"isl": {
"type": "array",
"items": {
"type": "number"
}
},
"osl": {
"type": "array",
"items": {
"type": "number"
}
}
},
"required": [
"id",
"isl",
"osl"
],
"additionalProperties": false
}
}滚动查看完整示例。
响应示例
代码
{
"421": {
"id": 421,
"isl": [
18220,
19340,
15110
],
"osl": [
410,
380,
512
]
}
}滚动查看完整示例。
400
ids 缺失、格式错误或超过 200 个唯一 ID。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "ids query param is required"
}500
直方图查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}GET测试版/api/v1/trace-server-metrics读取跟踪服务器指标
返回数据点元数据，以及可直接用于图表的聚合时间序列，涵盖缓存使用率、队列深度、prefill/decode 吞吐量和 prompt token 来源。metricSources 包含各来源的描述信息；仅当用户在数据点详情界面选择某个来源时，才会加载该来源对应的数组。
参数
| 名称 | 位置 | 类型 | 要求 | 说明 | 示例 |
|---|---|---|---|---|---|
| id | query | integer | 必填 | 正整数基准结果 ID。 | 421 |
请求
代码
curl -sS 'https://inferencex.semianalysis.com/api/v1/trace-server-metrics?id=421'响应
TraceServerMetrics200
点元数据、窗口边界和服务器指标序列。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"meta": {
"type": "object",
"additionalProperties": true
},
"startNs": {
"type": "integer"
},
"endNs": {
"type": "integer"
},
"durationS": {
"type": "number"
},
"timeslicesCount": {
"type": "integer"
},
"kvCacheUsage": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"prefixCacheHitRate": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"queueDepth": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"promptTokensBySource": {
"type": "object",
"additionalProperties": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"prefillTps": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"decodeTps": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"prefixCacheHitsTps": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"hostKvCacheUsage": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"kvCacheUsageByEngine": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
},
"kvCachePoolTokens": {
"type": [
"number",
"null"
]
},
"metricSources": {
"type": "array",
"items": {
"type": "object",
"additionalProperties": true
}
}
},
"required": [
"meta",
"startNs",
"endNs",
"durationS",
"timeslicesCount",
"kvCacheUsage",
"prefixCacheHitRate",
"queueDepth",
"promptTokensBySource",
"prefillTps",
"decodeTps",
"prefixCacheHitsTps",
"hostKvCacheUsage",
"kvCacheUsageByEngine",
"kvCachePoolTokens",
"metricSources"
],
"additionalProperties": false
}滚动查看完整示例。
响应示例
代码
{
"meta": {
"id": 421,
"hardware": "h200_sxm",
"framework": "vllm",
"model": "dsr1",
"conc": 32,
"date": "2026-08-08"
},
"startNs": 1000000000,
"endNs": 2400000000,
"durationS": 1.4,
"timeslicesCount": 2,
"kvCacheUsage": [
{
"t": 0,
"v": 0.44
}
],
"prefixCacheHitRate": [],
"queueDepth": [],
"promptTokensBySource": {},
"prefillTps": [],
"decodeTps": [],
"prefixCacheHitsTps": [],
"hostKvCacheUsage": [],
"kvCacheUsageByEngine": [],
"kvCachePoolTokens": 983040,
"metricSources": []
}滚动查看完整示例。
400
id 缺失或无效。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "id is required (benchmark_result_id)"
}404
该结果没有服务器指标。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Not found"
}500
服务器指标查询失败。
媒体类型: application/json响应结构
代码
{
"type": "object",
"properties": {
"error": {
"type": "string"
}
},
"required": [
"error"
],
"additionalProperties": true
}响应示例
代码
{
"error": "Internal server error"
}