HDATF
简体中文
开始交流
菜单

HDATF RESEARCH / 基准评测报告

如何验证AI 能否完成实际工作

公开成绩能说明什么，哪些问题必须通过实际运行验证。 从模型选择到调研、文档编写与成果检验。

HDATF研究报告编写 成绩资料基准日

核心结论

公开评测为模型选择和测试设计提供依据。能否投入工作，还要连接实际资料和工具，检验系统是否完成所要求的成果。

本报告从可用成果、可核查证据和完整执行三个角度解读公开成绩。HDATF尚未公布这些评测的自身实测成绩，最后一章将说明验证这一差距的计划。

73 评测与指标684 归档成绩

01 / 如何读懂成绩

先确定要交付的工作，再阅读分数。

基准评测用规定的任务和评分规则比较能力。推理题、文档比较和工具操作分别考察不同能力，读分数时应先明确测试对象。

报告任务需要文件可打开、论点有据可查、内容符合要求。数据分析还需要能用提供的数据重现结果。通用模型排名无法单独验证这些条件。

公开成绩用于缩小候选范围并确定要测试的失败类型。选择用于LabChin的方法时，需要结合自己的资料、权限、工具与成果检查。本报告依次讨论成果、证据和执行。[1]

02 / 成果质量

按实际任务要求评价成果。

GDPval比较专业工作成果。最初的Gold研究涵盖44个职业的220项任务，由专家在不知道作者的情况下比较。下图展示归档的三项结果。

胜出与持平比例反映这些成果比较，不能换算为企业可交给AI的工作比例。任务范围、专家判断和模型配置限定了结论。[2]

图 01

GDPval Gold

相对专家成果的胜出与持平比例 (%)

%越高越好
  1. Claude Opus 4.147.6%
  2. GPT-5 (high)38.8%
  3. o3 (high)34.1%
GDPval Gold / %
模型与运行配置成绩
Claude Opus 4.1Anthropic47.6%
GPT-5 (high)OpenAI38.8%
o3 (high)OpenAI34.1%

44 个职业的 220 项 Gold 任务。原始研究由专家盲评比较成果，不代表当前排名。

来源: OpenAI2025-09原始记录

HDATF需要确认文件生成后还有多少人工工作。应保留遗漏要求、无依据数值和人工修改。易读的布局是质量的一部分，但不能弥补错误证据或不可用文件。

03 / 调研与证据

同时检查寻找答案和提供依据的能力。

BrowseComp测试寻找难查事实的能力。Parallel从1,266题中随机抽取100题，报告正确率与请求成本。以下成绩来自服务提供方对部分题目的实验。[3][4]

图 02

BrowseComp / Parallel study

正确率 (%)

%越高越好
  1. Parallel Ultra8x58%
  2. Parallel Ultra45%
  3. GPT-5 (high)38%
BrowseComp / Parallel study / %
模型与运行配置成绩
Parallel Ultra8xParallel58%
Parallel UltraParallel45%
GPT-5 (high)OpenAI38%

从 1,266 题随机抽取 100 题。Parallel 于 2025 年 8 月 11 至 29 日测量。每次费用：Ultra8x $2.40、Ultra $0.30、GPT-5 $0.488。配置与预算不同。

来源: Parallel2025-09-09原始记录

Ultra8x报告每次2.40美元、正确率58%，Ultra为0.30美元、45%。预算不同，这些数值呈现准确率与成本关系，但不能证明同等成本下的优势或基础模型的独立效果。

调研报告需要额外检查。DeepResearch Bench II和ResearchRubrics依据明确标准评估内容。LabChin计划保留支持主要论点的原文、矛盾资料及未回答的问题。

04 / 执行与记忆

同一模型，执行方式不同，结果也会改变。

执行框架向模型提供工具、上下文并控制任务。LangChain固定GPT-5.2-Codex，仅修改周边执行方式，89项Terminal-Bench 2.0任务的成绩从52.8%升至66.5%。[5][6]

图 03

Terminal-Bench 2.0

任务成功率 (%)

%越高越好
  1. Deep Agents / improved66.5%
  2. Deep Agents / baseline52.8%
Terminal-Bench 2.0 / %
模型与运行配置成绩
Deep Agents / improvedLangChain66.5%
Deep Agents / baselineLangChain52.8%

89 项任务。LangChain 固定 GPT-5.2-Codex，修改提示、工具及执行控制，使用 Harbor / Daytona。公布提升为 13.7 个百分点。

来源: LangChain2026-02-17原始记录

实验同时改变指令、工具和执行控制，包括结束前检查与环境说明。13.7个百分点属于组合修改的结果，无法据此确定各功能贡献或预测HDATF的提升。

可以固定自己的任务与模型，对比有无成果检查的流程。保留文件、检查结果、重试和耗时，同时解释成功及需要人工干预的失败，才能判断执行差异。

记忆需要独立测试。回忆旧信息还不够，也要处理修正和访问范围。归档的LoCoMo结果仅限单跳事实回忆，不能视为已验证更新冲突或用户隔离，因此列入附录供参考。

05 / HDATF评测计划

下一步验证HDATF实际完成的工作。

公开研究有助于整理问题，产品成绩仍需直接测量。计划记录代表任务的执行条件，分别评估证据检索、分析和成果交付，避免某一项高分掩盖其他失败。

调研和数据工作应保留问题、资料版本及最终成果检查记录。报告需暴露无依据论点，分析需保存输入数据、运行记录与可重现成果。以下是待验证的标准，并非已完成测试。[1][7][8][9]

这是评测计划，HDATF实测成绩尚未公布。

能否找到所需证据

BrowseComp评估查找网络中难以找到的事实的能力。LabChin还计划单独检查引用来源是否真正支持相应论点。

BrowseComp

能否依据证据回答问题

以DeepResearch Bench II和ResearchRubrics作为调研报告的评估参考。不只看行文流畅，还计划检查内容覆盖、事实依据和结论的分析过程。

DeepResearch Bench IIResearchRubrics

能否交付可用成果

GDPval和Agents’ Last Exam面向专业任务。计划检查请求是否完成、文件能否使用，以及还需要多少人工修正。

GDPvalAgents’ Last Exam

评测对象保留的证据支持的判断
任务任务要求、输入文件、完成标准所要求的工作是否完成
执行模型、工具、权限、执行配置版本能否以相同条件重新运行
结果成果文件、来源检查、人工修改成果是否正确且可用
效率总耗时、工具使用、重试、总成本整个流程的时间与成本是否可承担
APPENDIX

附录。完整评测资料

按评测比较公开成绩，点击模型名称查看原文。数据以标注日期为准，模型系列比较采用各系列成绩最好的配置。

73 / 73 评测与指标

工作与文档

AA-Briefcase15 项成绩

基础模型成绩Artificial Analysis

长期知识工作

Elo越高越好
  1. Claude Fable 5.11,661.91
  2. Claude Opus 51,647.02
  3. GPT-6 Astra1,561.95
  4. Muse Spark 1.31,558.85
  5. Grok 4.61,545.82
  6. Claude Fable 51,533.52
  7. GLM-5.31,515.45
  8. Kimi K31,496.83
  9. GPT-5.6 Sol1,474.49
  10. GLM 5.3 Flash1,459.13
  11. Qwen3.8 2.4T A95B1,442.81
  12. DeepSeek V4 Flash 07311,433.23
  13. Qwen3.8 27B1,401.81
  14. Qwen3.8 Max1,392.33
  15. Claude Sonnet 51,358.11
AA-Briefcase / Elo
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic1,661.91
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic1,647.02
GPT-6 Astra (max)OpenAI1,561.95
Muse Spark 1.3 (max)Meta1,558.85
Grok 4.6 (xhigh)SpaceXAI1,545.82
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic1,533.52
GLM-5.3 (max)Z AI1,515.45
Kimi K3 (max)Kimi1,496.83
GPT-5.6 Sol (max)OpenAI1,474.49
GLM 5.3 Flash (GLM-5.3-Flash)Z AI1,459.13
Qwen3.8 2.4T A95BAlibaba1,442.81
DeepSeek V4 Flash 0731 (DeepSeek V4 Flash Vision (Reasoning, Max Effort))DeepSeek1,433.23
Qwen3.8 27B (xhigh)Alibaba1,401.81
Qwen3.8 MaxAlibaba1,392.33
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)Anthropic1,358.11
AA-Briefcase / Rubric15 项成绩

基础模型成绩Artificial Analysis

工作要求满足率

%越高越好
  1. Claude Fable 5.161.52%
  2. Claude Opus 557.98%
  3. Claude Fable 555.96%
  4. Muse Spark 1.354.87%
  5. Grok 4.653.84%
  6. GPT-6 Astra52.32%
  7. GLM-5.351.35%
  8. Kimi K350.97%
  9. Qwen3.8 2.4T A95B50%
  10. Qwen3.8 Max49.6%
  11. Qwen3.8 27B47.8%
  12. GLM 5.3 Flash46.36%
  13. DeepSeek V4 Flash 073146.15%
  14. Muse Spark 1.245.15%
  15. DeepSeek V4 Pro 081343.52%
AA-Briefcase / Rubric / %
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic61.52%
Claude Opus 5 (Adaptive Reasoning, Xhigh Effort)Anthropic57.98%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic55.96%
Muse Spark 1.3 (max)Meta54.87%
Grok 4.6 (xhigh)SpaceXAI53.84%
GPT-6 Astra (xhigh)OpenAI52.32%
GLM-5.3 (max)Z AI51.35%
Kimi K3 (max)Kimi50.97%
Qwen3.8 2.4T A95BAlibaba50%
Qwen3.8 MaxAlibaba49.6%
Qwen3.8 27B (xhigh)Alibaba47.8%
GLM 5.3 Flash (GLM-5.3-Flash)Z AI46.36%
DeepSeek V4 Flash 0731 (DeepSeek V4 Flash Vision (Reasoning, Max Effort))DeepSeek46.15%
Muse Spark 1.2 (xhigh)Meta45.15%
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)DeepSeek43.52%
AA-Briefcase / Analytical quality15 项成绩

基础模型成绩Artificial Analysis

分析质量

Elo越高越好
  1. Claude Fable 5.11,959.49
  2. Claude Opus 51,909.74
  3. GLM-5.31,788.62
  4. GPT-6 Astra1,753.64
  5. Muse Spark 1.31,711.52
  6. Grok 4.61,682.58
  7. Claude Fable 51,676.55
  8. Kimi K31,668.89
  9. GLM 5.3 Flash1,650.95
  10. Qwen3.8 2.4T A95B1,617.45
  11. DeepSeek V4 Flash 07311,617.37
  12. Qwen3.8 27B1,590.24
  13. GPT-5.6 Sol1,537.92
  14. Qwen3.8 Max1,533.14
  15. Claude Sonnet 51,418.22
AA-Briefcase / Analytical quality / Elo
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic1,959.49
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic1,909.74
GLM-5.3 (max)Z AI1,788.62
GPT-6 Astra (max)OpenAI1,753.64
Muse Spark 1.3 (max)Meta1,711.52
Grok 4.6 (xhigh)SpaceXAI1,682.58
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic1,676.55
Kimi K3 (max)Kimi1,668.89
GLM 5.3 Flash (GLM-5.3-Flash)Z AI1,650.95
Qwen3.8 2.4T A95BAlibaba1,617.45
DeepSeek V4 Flash 0731 (DeepSeek V4 Flash Vision (Reasoning, Max Effort))DeepSeek1,617.37
Qwen3.8 27B (xhigh)Alibaba1,590.24
GPT-5.6 Sol (max)OpenAI1,537.92
Qwen3.8 MaxAlibaba1,533.14
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)Anthropic1,418.22
AA-Briefcase / Presentation15 项成绩

基础模型成绩Artificial Analysis

成果呈现质量

Elo越高越好
  1. GPT-5.6 Sol1,633.93
  2. Claude Opus 51,544.01
  3. GPT-6 Astra1,535.29
  4. GPT-5.6 Terra1,519.13
  5. Grok 4.61,514.68
  6. Muse Spark 1.31,506.83
  7. Claude Fable 5.11,472.7
  8. GPT-5.6 Luna1,471.03
  9. Claude Fable 51,456.83
  10. Kimi K31,435.29
  11. Claude Sonnet 51,409.5
  12. GLM 5.3 Flash1,409.12
  13. DeepSeek V4 Flash 07311,355.99
  14. GLM-5.31,354.5
  15. Muse Spark 1.21,334.35
AA-Briefcase / Presentation / Elo
模型与运行配置成绩
GPT-5.6 Sol (max)OpenAI1,633.93
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic1,544.01
GPT-6 Astra (max)OpenAI1,535.29
GPT-5.6 Terra (max)OpenAI1,519.13
Grok 4.6 (xhigh)SpaceXAI1,514.68
Muse Spark 1.3 (max)Meta1,506.83
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic1,472.7
GPT-5.6 Luna (max)OpenAI1,471.03
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic1,456.83
Kimi K3 (max)Kimi1,435.29
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)Anthropic1,409.5
GLM 5.3 Flash (GLM-5.3-Flash)Z AI1,409.12
DeepSeek V4 Flash 0731 (DeepSeek V4 Flash Vision (Reasoning, Max Effort))DeepSeek1,355.99
GLM-5.3 (max)Z AI1,354.5
Muse Spark 1.2 (xhigh)Meta1,334.35
GDPval-AA v215 项成绩

基础模型成绩Artificial Analysis

实际职业任务

Elo越高越好
  1. Claude Fable 5.11,765.9
  2. Claude Opus 51,738.08
  3. Muse Spark 1.31,719.65
  4. GLM-5.31,678.47
  5. GLM 5.3 Flash1,672.94
  6. Grok 4.61,664.82
  7. Qwen3.8-Flash-Next1,649.93
  8. Claude Fable 51,635.39
  9. Qwen3.8 Max1,633.53
  10. Qwen3.8 2.4T A95B1,630.39
  11. GPT-5.6 Sol1,625.68
  12. Kimi K31,585.72
  13. GPT-6 Astra1,582.24
  14. DeepSeek V4 Flash 07311,579.3
  15. Muse Spark 1.21,525.03
GDPval-AA v2 / Elo
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic1,765.9
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic1,738.08
Muse Spark 1.3 (max)Meta1,719.65
GLM-5.3 (max)Z AI1,678.47
GLM 5.3 Flash (GLM-5.3-Flash)Z AI1,672.94
Grok 4.6 (xhigh)SpaceXAI1,664.82
Qwen3.8-Flash-NextAlibaba1,649.93
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic1,635.39
Qwen3.8 MaxAlibaba1,633.53
Qwen3.8 2.4T A95BAlibaba1,630.39
GPT-5.6 Sol (max)OpenAI1,625.68
Kimi K3 (max)Kimi1,585.72
GPT-6 Astra (max)OpenAI1,582.24
DeepSeek V4 Flash 0731 (DeepSeek V4 Flash Vision (Reasoning, Max Effort))DeepSeek1,579.3
Muse Spark 1.2 (xhigh)Meta1,525.03
AA-AnalystAgent / pass^515 项成绩

基础模型成绩Artificial Analysis

表格与文档分析的重复成功

%越高越好
  1. Gemini 3.7 Flash60%
  2. Claude Fable 5.157.5%
  3. Claude Opus 553.75%
  4. GPT-6 Astra51.25%
  5. Claude Fable 548.75%
  6. GPT-5.6 Sol47.5%
  7. Claude Sonnet 546.25%
  8. Gemini 3.1 Pro Preview41.25%
  9. Grok 4.641.25%
  10. Kimi K338.75%
  11. Grok 4.535%
  12. Inkling Small27.5%
  13. Inkling23.75%
  14. MiMo-V2.5-Pro20%
  15. DeepSeek V4 Pro 042418.75%
AA-AnalystAgent / pass^5 / %
模型与运行配置成绩
Gemini 3.7 Flash (high)Google60%
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic57.5%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic53.75%
GPT-6 Astra (max)OpenAI51.25%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic48.75%
GPT-5.6 Sol (max)OpenAI47.5%
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)Anthropic46.25%
Gemini 3.1 Pro PreviewGoogle41.25%
Grok 4.6 (high)SpaceXAI41.25%
Kimi K3 (max)Kimi38.75%
Grok 4.5 (high)SpaceXAI35%
Inkling SmallThinking Machines27.5%
Inkling (xhigh)Thinking Machines23.75%
MiMo-V2.5-ProXiaomi20%
DeepSeek V4 Pro 0424 (DeepSeek V4 Pro (Reasoning, Max Effort))DeepSeek18.75%
GDP.pdf / All-pass15 项成绩

基础模型成绩Artificial Analysis

专业文档推理

%越高越好
  1. GPT-6 Astra33.2%
  2. GPT-5.6 Sol28.2%
  3. Claude Fable 5.128%
  4. Muse Spark 1.325.6%
  5. GPT-5.6 Terra25.6%
  6. Claude Fable 524%
  7. GPT-5.6 Luna23.8%
  8. Gemini 3.7 Flash23.6%
  9. Gemini 3.8 Flash22.8%
  10. Qwen3.8 Max21.8%
  11. Claude Opus 521.6%
  12. GPT-5.5 Instant (June 2026)20.2%
  13. Kimi K319.6%
  14. Grok 4.518.8%
  15. Grok 4.618.8%
GDP.pdf / All-pass / %
模型与运行配置成绩
GPT-6 Astra (max)OpenAI33.2%
GPT-5.6 Sol (max)OpenAI28.2%
Claude Fable 5.1 (Adaptive Reasoning, Low Effort, Default Fallback)Anthropic28%
Muse Spark 1.3 (max)Meta25.6%
GPT-5.6 Terra (max)OpenAI25.6%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic24%
GPT-5.6 Luna (xhigh)OpenAI23.8%
Gemini 3.7 Flash (high)Google23.6%
Gemini 3.8 Flash (medium)Google22.8%
Qwen3.8 MaxAlibaba21.8%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic21.6%
GPT-5.5 Instant (June 2026)OpenAI20.2%
Kimi K3 (max)Kimi19.6%
Grok 4.5 (high)SpaceXAI18.8%
Grok 4.6 (high)SpaceXAI18.8%
AutomationBench-AA15 项成绩

基础模型成绩Artificial Analysis

业务应用目标完成

%越高越好
  1. Gemini 3.7 Flash62.75%
  2. Kimi K352.71%
  3. Grok 4.551.44%
  4. GPT-5.6 Sol51.19%
  5. Gemini 3.6 Flash51.08%
  6. Gemini 3.8 Flash50.72%
  7. Claude Fable 548.58%
  8. GPT-5.6 Terra45.61%
  9. GPT-5.6 Luna42.24%
  10. Claude Sonnet 539.19%
  11. Gemini 3.1 Pro Preview37.54%
  12. Gemini 3.5 Flash-Lite32.66%
  13. GLM-5.227.84%
  14. Kimi K2.7 Code22.53%
  15. Qwen3.7 Plus20.43%
AutomationBench-AA / %
模型与运行配置成绩
Gemini 3.7 Flash (high)Google62.75%
Kimi K3 (max)Kimi52.71%
Grok 4.5 (high)SpaceXAI51.44%
GPT-5.6 Sol (max)OpenAI51.19%
Gemini 3.6 Flash (high)Google51.08%
Gemini 3.8 Flash (high)Google50.72%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic48.58%
GPT-5.6 Terra (max)OpenAI45.61%
GPT-5.6 Luna (max)OpenAI42.24%
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)Anthropic39.19%
Gemini 3.1 Pro PreviewGoogle37.54%
Gemini 3.5 Flash-LiteGoogle32.66%
GLM-5.2 (max)Z AI27.84%
Kimi K2.7 CodeKimi22.53%
Qwen3.7 PlusAlibaba20.43%
EnterpriseOps-Gym-AA15 项成绩

基础模型成绩Artificial Analysis

企业运营任务

%越高越好
  1. Claude Fable 551.12%
  2. Gemini 3.7 Flash50.4%
  3. DeepSeek V4 Pro 081349.6%
  4. Grok 4.648.34%
  5. Claude Opus 547.48%
  6. Qwen3.8 2.4T A95B47.36%
  7. Muse Spark 1.247.27%
  8. DeepSeek V4 Flash 073147.09%
  9. Kimi K345.33%
  10. Claude Sonnet 544.67%
  11. Qwen3.8 27B44.23%
  12. GPT-5.6 Sol42.91%
  13. GLM-5.242.73%
  14. Inkling Small42.7%
  15. Gemini 3.5 Flash-Lite42.35%
EnterpriseOps-Gym-AA / %
模型与运行配置成绩
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic51.12%
Gemini 3.7 Flash (medium)Google50.4%
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)DeepSeek49.6%
Grok 4.6 (high)SpaceXAI48.34%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic47.48%
Qwen3.8 2.4T A95BAlibaba47.36%
Muse Spark 1.2 (xhigh)Meta47.27%
DeepSeek V4 Flash 0731 (DeepSeek V4 Flash Vision (Reasoning, Max Effort))DeepSeek47.09%
Kimi K3 (max)Kimi45.33%
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)Anthropic44.67%
Qwen3.8 27B (xhigh)Alibaba44.23%
GPT-5.6 Sol (max)OpenAI42.91%
GLM-5.2 (max)Z AI42.73%
Inkling SmallThinking Machines42.7%
Gemini 3.5 Flash-LiteGoogle42.35%
APEX-Agents-AA14 项成绩

基础模型成绩Artificial Analysis

跨应用长期任务

%越高越好
  1. Kimi K341.3%
  2. GPT-5.6 Terra38.94%
  3. GPT-5.6 Luna35.84%
  4. GLM-5.233.7%
  5. Gemini 3.1 Pro Preview32.01%
  6. Apodex 1.131.19%
  7. DeepSeek V4 Pro 042424.26%
  8. Qwen3.7 Plus22.42%
  9. Qwen3.5 397B A17B15.34%
  10. Step 3.7 Flash14.82%
  11. gpt-oss-120b3.1%
  12. MiMo-V2.5-Pro2.43%
  13. Nemotron 3 Super 120B A12B1.84%
  14. gpt-oss-20b0.74%
APEX-Agents-AA / %
模型与运行配置成绩
Kimi K3 (max)Kimi41.3%
GPT-5.6 Terra (max)OpenAI38.94%
GPT-5.6 Luna (max)OpenAI35.84%
GLM-5.2 (max)Z AI33.7%
Gemini 3.1 Pro PreviewGoogle32.01%
Apodex 1.1Apodex31.19%
DeepSeek V4 Pro 0424 (DeepSeek V4 Pro (Reasoning, Max Effort))DeepSeek24.26%
Qwen3.7 PlusAlibaba22.42%
Qwen3.5 397B A17B (Reasoning)Alibaba15.34%
Step 3.7 FlashStepFun14.82%
gpt-oss-120b (high)OpenAI3.1%
MiMo-V2.5-ProXiaomi2.43%
Nemotron 3 Super 120B A12B (Reasoning)NVIDIA1.84%
gpt-oss-20b (high)OpenAI0.74%

系统研究

GDPval Gold3 项成绩

专家比较研究OpenAI

AI 能否交付专业人员认可的成果？ 相对专家成果的胜出与持平比例 (%)

%越高越好
  1. Claude Opus 4.147.6%
  2. GPT-5 (high)38.8%
  3. o3 (high)34.1%
GDPval Gold / %
模型与运行配置成绩
Claude Opus 4.1Anthropic47.6%
GPT-5 (high)OpenAI38.8%
o3 (high)OpenAI34.1%
BrowseComp / Parallel study3 项成绩

检索智能体研究Parallel

智能体能否找到难以检索的信息并连接证据？ 正确率 (%)

%越高越好
  1. Parallel Ultra8x58%
  2. Parallel Ultra45%
  3. GPT-5 (high)38%
BrowseComp / Parallel study / %
模型与运行配置成绩
Parallel Ultra8xParallel58%
Parallel UltraParallel45%
GPT-5 (high)OpenAI38%
Terminal-Bench 2.02 项成绩

执行体系研究LangChain

改变执行机制能让结果发生多大变化？ 任务成功率 (%)

%越高越好
  1. Deep Agents / improved66.5%
  2. Deep Agents / baseline52.8%
Terminal-Bench 2.0 / %
模型与运行配置成绩
Deep Agents / improvedLangChain66.5%
Deep Agents / baselineLangChain52.8%
LoCoMo / single-hop3 项成绩

记忆系统研究Mem0 research team

跨越不同对话后，是否保留有用信息？ 单跳事实回忆，AI 评分（0~100）

score越高越好
  1. Mem067.13
  2. LangMem62.23
  3. Zep61.7
LoCoMo / single-hop / score
模型与运行配置成绩
Mem0Mem067.13
LangMemLangChain62.23
ZepZep61.7

智能体与工具

τ³-Banking15 项成绩

基础模型成绩Artificial Analysis

银行政策检索与工具执行

%越高越好
  1. Muse Spark 1.352.37%
  2. Qwen3.8 Max51.34%
  3. Grok 4.650.72%
  4. GLM-5.350.31%
  5. Qwen3.8 2.4T A95B49.07%
  6. Qwen3.8 27B48.04%
  7. GLM 5.3 Flash47.22%
  8. Claude Fable 5.147.22%
  9. Kimi K345.98%
  10. Gemini 3.8 Flash45.77%
  11. Qwen3.8-Flash-Next45.36%
  12. Claude Opus 544.74%
  13. GPT-5.6 Sol44.33%
  14. GPT-6 Astra43.09%
  15. Grok 4.542.06%
τ³-Banking / %
模型与运行配置成绩
Muse Spark 1.3 (max)Meta52.37%
Qwen3.8 MaxAlibaba51.34%
Grok 4.6 (high)SpaceXAI50.72%
GLM-5.3 (max)Z AI50.31%
Qwen3.8 2.4T A95BAlibaba49.07%
Qwen3.8 27B (xhigh)Alibaba48.04%
GLM 5.3 Flash (GLM-5.3-Flash)Z AI47.22%
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic47.22%
Kimi K3 (max)Kimi45.98%
Gemini 3.8 Flash (medium)Google45.77%
Qwen3.8-Flash-NextAlibaba45.36%
Claude Opus 5 (Adaptive Reasoning, High Effort)Anthropic44.74%
GPT-5.6 Sol (max)OpenAI44.33%
GPT-6 Astra (xhigh)OpenAI43.09%
Grok 4.5 (high)SpaceXAI42.06%
τ²-Bench15 项成绩

基础模型成绩Artificial Analysis

对话工具使用

%越高越好
  1. JT-35B-Flash99.12%
  2. GLM-5.299.12%
  3. Step 3.7 Flash98.54%
  4. Claude Fable 598.54%
  5. DeepSeek V4 Pro 042496.2%
  6. Qwen3.5 397B A17B95.61%
  7. Gemini 3.5 Flash95.61%
  8. Gemini 3.1 Pro Preview95.61%
  9. Qwen3.6 35B A3B95.32%
  10. DeepSeek V4 Flash 042094.44%
  11. MiMo-V2.5-Pro94.15%
  12. Qwen3.6 27B94.15%
  13. Mistral Medium 3.594.15%
  14. Qwen3.5 122B A10B93.57%
  15. MiMo-V2-Flash (Feb 2026)93.27%
τ²-Bench / %
模型与运行配置成绩
JT-35B-FlashChina Mobile99.12%
GLM-5.2 (max)Z AI99.12%
Step 3.7 FlashStepFun98.54%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic98.54%
DeepSeek V4 Pro 0424 (DeepSeek V4 Pro (Reasoning, Max Effort))DeepSeek96.2%
Qwen3.5 397B A17B (Reasoning)Alibaba95.61%
Gemini 3.5 Flash (medium)Google95.61%
Gemini 3.1 Pro PreviewGoogle95.61%
Qwen3.6 35B A3B (Reasoning)Alibaba95.32%
DeepSeek V4 Flash 0420 (DeepSeek V4 Flash (Non-reasoning))DeepSeek94.44%
MiMo-V2.5-ProXiaomi94.15%
Qwen3.6 27B (Reasoning)Alibaba94.15%
Mistral Medium 3.5Mistral94.15%
Qwen3.5 122B A10B (Reasoning)Alibaba93.57%
MiMo-V2-Flash (Feb 2026)Xiaomi93.27%
ITBench-AA15 项成绩

基础模型成绩Artificial Analysis

运维故障根因分析

%越高越好
  1. GPT-5.6 Sol56.21%
  2. GPT-5.6 Terra51.04%
  3. Kimi K347.69%
  4. GLM-5.242.66%
  5. GPT-5.6 Luna40.32%
  6. DeepSeek V4 Pro 042438.32%
  7. MiMo-V2.5-Pro38.23%
  8. Gemma 4 31B37.29%
  9. Qwen3.5 397B A17B34.09%
  10. Gemini 3.1 Pro Preview30.33%
  11. Step 3.7 Flash30.27%
  12. Claude 4.5 Haiku27.31%
  13. Gemma 4 26B A4B23.63%
  14. gpt-oss-120b5.65%
  15. Nemotron 3 Super 120B A12B1.13%
ITBench-AA / %
模型与运行配置成绩
GPT-5.6 Sol (max)OpenAI56.21%
GPT-5.6 Terra (max)OpenAI51.04%
Kimi K3 (max)Kimi47.69%
GLM-5.2 (max)Z AI42.66%
GPT-5.6 Luna (max)OpenAI40.32%
DeepSeek V4 Pro 0424 (DeepSeek V4 Pro (Reasoning, Max Effort))DeepSeek38.32%
MiMo-V2.5-ProXiaomi38.23%
Gemma 4 31B (Reasoning)Google37.29%
Qwen3.5 397B A17B (Reasoning)Alibaba34.09%
Gemini 3.1 Pro PreviewGoogle30.33%
Step 3.7 FlashStepFun30.27%
Claude 4.5 Haiku (Reasoning)Anthropic27.31%
Gemma 4 26B A4B (Reasoning)Google23.63%
gpt-oss-120b (high)OpenAI5.65%
Nemotron 3 Super 120B A12B (Reasoning)NVIDIA1.13%
MCP-Atlas public set / Z.ai report7 项成绩

供应商发布的模型成绩Z.ai (model-card report)

使用连接工具完成任务。

%越高越好
  1. GPT-5.268%
  2. GLM-567.8%
  3. Gemini 3 Pro66.6%
  4. Claude Opus 4.565.2%
  5. Kimi K2.563.8%
  6. DeepSeek V3.262.2%
  7. GLM-4.752%
MCP-Atlas public set / Z.ai report / %
模型与运行配置成绩
GPT-5.2 (xhigh)OpenAI68%
GLM-5 发布报告Z.ai67.8%
Gemini 3 Pro (GLM-5 发布资料对比)Google66.6%
Claude Opus 4.5 (GLM-5 发布资料对比)Anthropic65.2%
Kimi K2.5 (GLM-5 发布资料对比)Moonshot AI63.8%
DeepSeek V3.2 (GLM-5 发布资料对比)DeepSeek62.2%
GLM-4.7 (GLM-5 发布资料对比)Z.ai52%

代码与执行

Terminal-Bench v2.115 项成绩

基础模型成绩Artificial Analysis

终端任务完成

%越高越好
  1. Claude Fable 5.191.39%
  2. GPT-6 Astra89.89%
  3. GPT-5.6 Sol89.51%
  4. Claude Opus 589.14%
  5. Grok 4.688.39%
  6. GPT-5.6 Terra88.01%
  7. Gemini 3.8 Flash87.64%
  8. Qwen3.8-Flash-Next86.14%
  9. Muse Spark 1.385.77%
  10. Gemini 3.7 Flash85.77%
  11. Kimi K385.02%
  12. Claude Fable 584.64%
  13. GLM 5.3 Flash84.27%
  14. GLM-5.383.9%
  15. Qwen3.8 2.4T A95B82.02%
Terminal-Bench v2.1 / %
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic91.39%
GPT-6 Astra (high)OpenAI89.89%
GPT-5.6 Sol (xhigh)OpenAI89.51%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic89.14%
Grok 4.6 (high)SpaceXAI88.39%
GPT-5.6 Terra (max)OpenAI88.01%
Gemini 3.8 Flash (high)Google87.64%
Qwen3.8-Flash-NextAlibaba86.14%
Muse Spark 1.3 (max)Meta85.77%
Gemini 3.7 Flash (high)Google85.77%
Kimi K3 (max)Kimi85.02%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic84.64%
GLM 5.3 Flash (GLM-5.3-Flash)Z AI84.27%
GLM-5.3 (max)Z AI83.9%
Qwen3.8 2.4T A95BAlibaba82.02%
SciCode15 项成绩

基础模型成绩Artificial Analysis

科学编程

%越高越好
  1. Claude Fable 5.163.08%
  2. Claude Fable 561%
  3. Gemini 3.7 Flash59.84%
  4. Muse Spark 1.359.72%
  5. Kimi K359.49%
  6. GLM-5.359.03%
  7. Gemini 3.1 Pro Preview58.68%
  8. GPT-5.6 Sol57.75%
  9. Muse Spark 1.257.41%
  10. Gemini 3.8 Flash56.6%
  11. GPT-6 Astra56.48%
  12. Grok 4.656.48%
  13. Claude Opus 556.37%
  14. Grok 4.554.98%
  15. GPT-5.6 Terra54.98%
SciCode / %
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic63.08%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic61%
Gemini 3.7 Flash (medium)Google59.84%
Muse Spark 1.3 (xhigh)Meta59.72%
Kimi K3 (max)Kimi59.49%
GLM-5.3 (max)Z AI59.03%
Gemini 3.1 Pro PreviewGoogle58.68%
GPT-5.6 Sol (high)OpenAI57.75%
Muse Spark 1.2 (xhigh)Meta57.41%
Gemini 3.8 Flash (high)Google56.6%
GPT-6 Astra (max)OpenAI56.48%
Grok 4.6 (high)SpaceXAI56.48%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic56.37%
Grok 4.5 (high)SpaceXAI54.98%
GPT-5.6 Terra (max)OpenAI54.98%
LiveCodeBench15 项成绩

基础模型成绩Artificial Analysis

编程问题求解

%越高越好
  1. gpt-oss-120b87.83%
  2. ERNIE 5.0 Thinking Preview81.16%
  3. o380.85%
  4. Apriel-v1.6-15B-Thinker80.74%
  5. Qwen3 Next 80B A3B (Reasoning)78.41%
  6. INTELLECT-377.67%
  7. gpt-oss-20b77.67%
  8. K-EXAONE76.83%
  9. Doubao Seed Code76.61%
  10. Magistral Medium 1.275.03%
  11. EXAONE 4.0 32B74.71%
  12. NVIDIA Nemotron 3 Nano 30B A3B74.07%
  13. Llama Nemotron Super 49B v1.573.65%
  14. Nova 2.0 Pro Preview73.02%
  15. Falcon-H1R-7B72.38%
LiveCodeBench / %
模型与运行配置成绩
gpt-oss-120b (high)OpenAI87.83%
ERNIE 5.0 Thinking PreviewBaidu81.16%
o3OpenAI80.85%
Apriel-v1.6-15B-ThinkerServiceNow80.74%
Qwen3 Next 80B A3B (Reasoning)Alibaba78.41%
INTELLECT-3Prime Intellect77.67%
gpt-oss-20b (high)OpenAI77.67%
K-EXAONE (Reasoning)LG AI Research76.83%
Doubao Seed CodeByteDance Seed76.61%
Magistral Medium 1.2Mistral75.03%
EXAONE 4.0 32B (Reasoning)LG AI Research74.71%
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)NVIDIA74.07%
Llama Nemotron Super 49B v1.5 (Reasoning)NVIDIA73.65%
Nova 2.0 Pro Preview (medium)Amazon73.02%
Falcon-H1R-7BTII UAE72.38%
SciCode / MiniMax report7 项成绩

供应商发布的模型成绩MiniMax (internal evaluation)

科学编程任务。

score越高越好
  1. Gemini 3 Pro56
  2. Claude Opus 4.652
  3. GPT-5.252
  4. Claude Opus 4.550
  5. Claude Sonnet 4.545
  6. MiniMax-M2.544.4
  7. MiniMax-M2.141
SciCode / MiniMax report / score
模型与运行配置成绩
Gemini 3 Pro (MiniMax 内部评测)Google56
Claude Opus 4.6 (MiniMax 内部评测)Anthropic52
GPT-5.2 (Thinking; MiniMax 内部评测)OpenAI52
Claude Opus 4.5 (MiniMax 内部评测)Anthropic50
Claude Sonnet 4.5 (MiniMax 内部评测)Anthropic45
MiniMax-M2.5 (MiniMax 内部评测)MiniMax44.4
MiniMax-M2.1 (MiniMax 内部评测)MiniMax41
Terminal Bench 2.1 / DeepSeek GA report8 项成绩

供应商发布的模型成绩DeepSeek (GA model-card report)

终端中的编程与工具使用任务。

score越高越好
  1. Kimi K388.3
  2. Fable-5 (w/ fallback)88
  3. DeepSeek-V4-Pro-081387.9
  4. Opus-4.885
  5. DeepSeek-V4-Flash-073182.7
  6. GLM-5.281
  7. DeepSeek-V4-Pro (Preview)72.1
  8. DeepSeek-V4-Flash (Preview)61.8
Terminal Bench 2.1 / DeepSeek GA report / score
模型与运行配置成绩
Kimi K3 (代码智能体评测; 未公开该模型的运行环境和推理强度)Moonshot AI88.3
Fable-5 (w/ fallback) (代码智能体评测; 未公开该模型的运行环境和推理强度; 使用备用模型，未说明细节)Anthropic88
DeepSeek-V4-Pro-0813 (DeepSeek Harness minimal; max reasoning effort; temperature=1.0; top_p=0.95)DeepSeek87.9
Opus-4.8 (代码智能体评测; 未公开该模型的运行环境和推理强度)Anthropic85
DeepSeek-V4-Flash-0731 (代码智能体评测; 未公开该模型的运行环境和推理强度)DeepSeek82.7
GLM-5.2 (代码智能体评测; 未公开该模型的运行环境和推理强度)Z.ai81
DeepSeek-V4-Pro (Preview) (代码智能体评测; 未公开该模型的运行环境和推理强度)DeepSeek72.1
DeepSeek-V4-Flash (Preview) (代码智能体评测; 未公开该模型的运行环境和推理强度)DeepSeek61.8
SWE-bench Pro refined set / Qwen3.8-Max report5 项成绩

供应商发布的模型成绩Qwen (model-card report)

Qwen修订的SWE-bench Pro评测集上的代码修复任务。

score越高越好
  1. Fable 580
  2. Opus 4.869.2
  3. Qwen3.8-Max67.7
  4. GPT 5.6 Sol (max)64.6
  5. Qwen3.7-Max60.6
SWE-bench Pro refined set / Qwen3.8-Max report / score
模型与运行配置成绩
Fable 5 (Qwen 精选题集; Claude Code; temperature=1.0; top_p=0.95; 256K 上下文; 可能使用了备用模型; 未公开推理强度)Anthropic80
Opus 4.8 (Qwen 精选题集; Claude Code; temperature=1.0; top_p=0.95; 256K 上下文; 未公开推理强度)Anthropic69.2
Qwen3.8-Max 服务模型; Qwen 精选题集; Claude Code; temperature=1.0; top_p=0.95; 256K 上下文; 未公开推理强度Qwen67.7
GPT 5.6 Sol (max) (Qwen 精选题集; Claude Code; max (表头); temperature=1.0; top_p=0.95; 256K 上下文)OpenAI64.6
Qwen3.7-Max (Qwen 精选题集; Claude Code; temperature=1.0; top_p=0.95; 256K 上下文; 未公开推理强度)Qwen60.6
SWE-bench Verified / Google G31 (2026-02-19)5 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

模型及其编程代理环境解决代码仓库问题的比例。

%越高越好
  1. Claude Opus 4.680.8%
  2. Gemini 3.1 Pro80.6%
  3. GPT-5.280%
  4. Claude Sonnet 4.679.6%
  5. Gemini 3 Pro76.2%
SWE-bench Verified / Google G31 (2026-02-19) / %
模型与运行配置成绩
Claude Opus 4.6 (Thinking (Max); 单次尝试; 各提供方专用运行框架)Anthropic80.8%
Gemini 3.1 Pro (Thinking (High); 单次尝试; 各提供方专用运行框架)Google80.6%
GPT-5.2 (Thinking (xhigh); 单次尝试; 各提供方专用运行框架)OpenAI80%
Claude Sonnet 4.6 (Thinking (Max); 单次尝试; 各提供方专用运行框架)Anthropic79.6%
Gemini 3 Pro (Thinking (High); 单次尝试; 各提供方专用运行框架)Google76.2%
SWE-bench Pro (Public) / Google G31 (2026-02-19)4 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

SWE-bench Pro 公开版软件工程任务。

%越高越好
  1. GPT-5.3-Codex56.8%
  2. GPT-5.255.6%
  3. Gemini 3.1 Pro54.2%
  4. Gemini 3 Pro43.3%
SWE-bench Pro (Public) / Google G31 (2026-02-19) / %
模型与运行配置成绩
GPT-5.3-Codex (Thinking (xhigh); 公开题集; 单次尝试; 各提供方专用运行框架)OpenAI56.8%
GPT-5.2 (Thinking (xhigh); 公开题集; 单次尝试; 各提供方专用运行框架)OpenAI55.6%
Gemini 3.1 Pro (Thinking (High); 公开题集; 单次尝试; 各提供方专用运行框架)Google54.2%
Gemini 3 Pro (Thinking (High); 公开题集; 单次尝试; 各提供方专用运行框架)Google43.3%

模型推理

Intelligence Index v4.215 项成绩

基础模型成绩Artificial Analysis

10项评测综合指数

score越高越好
  1. Claude Fable 5.156.76
  2. GPT-6 Astra54.66
  3. Claude Opus 554.05
  4. Claude Fable 553.19
  5. Muse Spark 1.352.95
  6. GPT-5.6 Sol51.26
  7. Grok 4.650.58
  8. Kimi K350.23
  9. GLM-5.348.58
  10. Gemini 3.8 Flash47.07
  11. Qwen3.8 Max46.91
  12. Muse Spark 1.246.84
  13. GPT-5.6 Terra46.77
  14. Qwen3.8 2.4T A95B46.74
  15. GLM 5.3 Flash46.22
Intelligence Index v4.2 / score
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic56.76
GPT-6 Astra (max)OpenAI54.66
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic54.05
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic53.19
Muse Spark 1.3 (max)Meta52.95
GPT-5.6 Sol (max)OpenAI51.26
Grok 4.6 (high)SpaceXAI50.58
Kimi K3 (max)Kimi50.23
GLM-5.3 (max)Z AI48.58
Gemini 3.8 Flash (high)Google47.07
Qwen3.8 MaxAlibaba46.91
Muse Spark 1.2 (xhigh)Meta46.84
GPT-5.6 Terra (max)OpenAI46.77
Qwen3.8 2.4T A95BAlibaba46.74
GLM 5.3 Flash (GLM-5.3-Flash)Z AI46.22
Humanity's Last Exam15 项成绩

基础模型成绩Artificial Analysis

专家知识与复杂推理

%越高越好
  1. Claude Fable 5.159.13%
  2. Claude Fable 555.47%
  3. Claude Opus 554.87%
  4. GPT-6 Astra54.68%
  5. GPT-5.6 Sol49.49%
  6. Muse Spark 1.349.07%
  7. Gemini 3.7 Flash47.87%
  8. Gemini 3.8 Flash47.82%
  9. Gemini 3.1 Pro Preview47.03%
  10. Kimi K346.9%
  11. Muse Spark 1.245.46%
  12. Grok 4.644.07%
  13. Qwen3.8 Max43.05%
  14. GPT-5.6 Terra42.91%
  15. Grok 4.542.68%
Humanity's Last Exam / %
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic59.13%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic55.47%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic54.87%
GPT-6 Astra (max)OpenAI54.68%
GPT-5.6 Sol (max)OpenAI49.49%
Muse Spark 1.3 (max)Meta49.07%
Gemini 3.7 Flash (high)Google47.87%
Gemini 3.8 Flash (high)Google47.82%
Gemini 3.1 Pro PreviewGoogle47.03%
Kimi K3 (max)Kimi46.9%
Muse Spark 1.2 (xhigh)Meta45.46%
Grok 4.6 (xhigh)SpaceXAI44.07%
Qwen3.8 MaxAlibaba43.05%
GPT-5.6 Terra (max)OpenAI42.91%
Grok 4.5 (high)SpaceXAI42.68%
GPQA Diamond15 项成绩

基础模型成绩Artificial Analysis

研究生级科学推理

%越高越好
  1. GPT-6 Astra96.26%
  2. Gemini 3.8 Flash95.25%
  3. Grok 4.694.95%
  4. Gemini 3.7 Flash94.55%
  5. Gemini 3.1 Pro Preview94.14%
  6. Muse Spark 1.394.14%
  7. GPT-5.6 Sol94.14%
  8. Claude Opus 593.74%
  9. Claude Fable 5.193.74%
  10. Qwen3.8 2.4T A95B93.54%
  11. Kimi K393.54%
  12. Grok 4.593.13%
  13. MiniMax-M392.93%
  14. Gemini 3.6 Flash92.83%
  15. DeepSeek V4 Pro 081392.83%
GPQA Diamond / %
模型与运行配置成绩
GPT-6 Astra (xhigh)OpenAI96.26%
Gemini 3.8 Flash (high)Google95.25%
Grok 4.6 (high)SpaceXAI94.95%
Gemini 3.7 Flash (high)Google94.55%
Gemini 3.1 Pro PreviewGoogle94.14%
Muse Spark 1.3 (xhigh)Meta94.14%
GPT-5.6 Sol (max)OpenAI94.14%
Claude Opus 5 (Adaptive Reasoning, Xhigh Effort)Anthropic93.74%
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic93.74%
Qwen3.8 2.4T A95BAlibaba93.54%
Kimi K3 (max)Kimi93.54%
Grok 4.5 (high)SpaceXAI93.13%
MiniMax-M3MiniMax92.93%
Gemini 3.6 Flash (high)Google92.83%
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)DeepSeek92.83%
CritPt15 项成绩

基础模型成绩Artificial Analysis

研究级物理问题

%越高越好
  1. GPT-5.6 Sol32.29%
  2. GPT-6 Astra31.71%
  3. Claude Fable 5.131.14%
  4. GPT-5.5 Pro30.57%
  5. GPT-5.6 Terra30%
  6. Claude Opus 529.14%
  7. Claude Fable 528.57%
  8. Muse Spark 1.326%
  9. Gemini 3 Deep Think25.71%
  10. Kimi K323.43%
  11. GLM-5.220.86%
  12. GPT-5.6 Luna20.57%
  13. Qwen3.8 Max20%
  14. Qwen3.8 2.4T A95B20%
  15. Grok 4.619.71%
CritPt / %
模型与运行配置成绩
GPT-5.6 Sol (max)OpenAI32.29%
GPT-6 Astra (max)OpenAI31.71%
Claude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback)Anthropic31.14%
GPT-5.5 Pro (xhigh)OpenAI30.57%
GPT-5.6 Terra (max)OpenAI30%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic29.14%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic28.57%
Muse Spark 1.3 (xhigh)Meta26%
Gemini 3 Deep ThinkGoogle25.71%
Kimi K3 (max)Kimi23.43%
GLM-5.2 (max)Z AI20.86%
GPT-5.6 Luna (max)OpenAI20.57%
Qwen3.8 MaxAlibaba20%
Qwen3.8 2.4T A95BAlibaba20%
Grok 4.6 (xhigh)SpaceXAI19.71%
AIME 202515 项成绩

基础模型成绩Artificial Analysis

竞赛数学

%越高越好
  1. Nova 2.0 Lite94.33%
  2. gpt-oss-120b93.44%
  3. NVIDIA Nemotron 3 Nano 30B A3B91%
  4. K-EXAONE90.33%
  5. Nova 2.0 Omni89.67%
  6. gpt-oss-20b89.33%
  7. Nova 2.0 Pro Preview89%
  8. o388.33%
  9. INTELLECT-388%
  10. Apriel-v1.6-15B-Thinker88%
  11. ERNIE 5.0 Thinking Preview85%
  12. Qwen3 Next 80B A3B (Reasoning)84.33%
  13. Ring-flash-2.083.67%
  14. Claude 4.5 Haiku83.67%
  15. Magistral Medium 1.282%
AIME 2025 / %
模型与运行配置成绩
Nova 2.0 Lite (high)Amazon94.33%
gpt-oss-120b (high)OpenAI93.44%
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)NVIDIA91%
K-EXAONE (Reasoning)LG AI Research90.33%
Nova 2.0 Omni (medium)Amazon89.67%
gpt-oss-20b (high)OpenAI89.33%
Nova 2.0 Pro Preview (medium)Amazon89%
o3OpenAI88.33%
INTELLECT-3Prime Intellect88%
Apriel-v1.6-15B-ThinkerServiceNow88%
ERNIE 5.0 Thinking PreviewBaidu85%
Qwen3 Next 80B A3B (Reasoning)Alibaba84.33%
Ring-flash-2.0InclusionAI83.67%
Claude 4.5 Haiku (Reasoning)Anthropic83.67%
Magistral Medium 1.2Mistral82%
IFBench15 项成绩

基础模型成绩Artificial Analysis

复杂指令遵循

%越高越好
  1. Grok 4.383.33%
  2. MiniMax-M382.86%
  3. Nemotron 3 Ultra 550B A55B81.36%
  4. Nemotron Cascade 2 30B A3B80.41%
  5. MiMo-V2.5-Pro79.86%
  6. Nova 2.0 Pro Preview79.59%
  7. Qwen3.5 397B A17B78.78%
  8. Qwen3.7 Plus77.96%
  9. Gemini 3.1 Pro Preview77.14%
  10. DeepSeek V4 Pro 042476.46%
  11. Qwen3.5 122B A10B75.71%
  12. Gemma 4 31B75.58%
  13. GPT-5.3 Codex75.37%
  14. Gemini 3.5 Flash74.56%
  15. Command A+73.95%
IFBench / %
模型与运行配置成绩
Grok 4.3 (medium)SpaceXAI83.33%
MiniMax-M3MiniMax82.86%
Nemotron 3 Ultra 550B A55B (Reasoning)NVIDIA81.36%
Nemotron Cascade 2 30B A3BNVIDIA80.41%
MiMo-V2.5-ProXiaomi79.86%
Nova 2.0 Pro Preview (low)Amazon79.59%
Qwen3.5 397B A17B (Reasoning)Alibaba78.78%
Qwen3.7 PlusAlibaba77.96%
Gemini 3.1 Pro PreviewGoogle77.14%
DeepSeek V4 Pro 0424 (DeepSeek V4 Pro (Reasoning, Max Effort))DeepSeek76.46%
Qwen3.5 122B A10B (Reasoning)Alibaba75.71%
Gemma 4 31B (Reasoning)Google75.58%
GPT-5.3 Codex (xhigh)OpenAI75.37%
Gemini 3.5 Flash (medium)Google74.56%
Command A+Cohere73.95%
LongBench v2 / Moonshot report5 项成绩

供应商发布的模型成绩Moonshot AI (model-card report)

长输入阅读与推理。

score越高越好
  1. Gemini 3 Pro68.2
  2. Claude Opus 4.564.4
  3. Kimi K2.561
  4. DeepSeek V3.259.8
  5. GPT-5.254.5
LongBench v2 / Moonshot report / score
模型与运行配置成绩
Gemini 3 Pro (High Thinking Level; 发布方重新运行 (*))Google68.2
Claude Opus 4.5 (Extended Thinking; 发布方重新运行 (*))Anthropic64.4
Kimi K2.5 (Thinking)Moonshot AI61
DeepSeek V3.2 (Thinking; 发布方重新运行 (*))DeepSeek59.8
GPT-5.2 (xhigh; 发布方重新运行 (*))OpenAI54.5
AIME 2026 I / Z.ai report6 项成绩

供应商发布的模型成绩Z.ai (model-card report)

2026 年 AIME 第一场，不是全年合并题集。

score越高越好
  1. Claude Opus 4.593.3
  2. GLM-4.792.9
  3. GLM-592.7
  4. DeepSeek V3.292.7
  5. Kimi K2.592.5
  6. Gemini 3 Pro90.6
AIME 2026 I / Z.ai report / score
模型与运行配置成绩
Claude Opus 4.5 (GLM-5 发布资料对比)Anthropic93.3
GLM-4.7 (GLM-5 发布资料对比)Z.ai92.9
GLM-5 发布报告Z.ai92.7
DeepSeek V3.2 (GLM-5 发布资料对比)DeepSeek92.7
Kimi K2.5 (GLM-5 发布资料对比)Moonshot AI92.5
Gemini 3 Pro (GLM-5 发布资料对比)Google90.6
HMMT November 2025 / Z.ai report7 项成绩

供应商发布的模型成绩Z.ai (model-card report)

2025 年 11 月数学竞赛题。

score越高越好
  1. GPT-5.297.1
  2. GLM-596.9
  3. GLM-4.793.5
  4. Gemini 3 Pro93
  5. Claude Opus 4.591.7
  6. Kimi K2.591.1
  7. DeepSeek V3.290.2
HMMT November 2025 / Z.ai report / score
模型与运行配置成绩
GPT-5.2 (xhigh)OpenAI97.1
GLM-5 发布报告Z.ai96.9
GLM-4.7 (GLM-5 发布资料对比)Z.ai93.5
Gemini 3 Pro (GLM-5 发布资料对比)Google93
Claude Opus 4.5 (GLM-5 发布资料对比)Anthropic91.7
Kimi K2.5 (GLM-5 发布资料对比)Moonshot AI91.1
DeepSeek V3.2 (GLM-5 发布资料对比)DeepSeek90.2
AA-LCR / MiniMax report7 项成绩

供应商发布的模型成绩MiniMax (internal evaluation)

基于长输入的推理。

score越高越好
  1. Claude Opus 4.574
  2. GPT-5.273
  3. Claude Opus 4.671
  4. Gemini 3 Pro71
  5. MiniMax-M2.569.5
  6. Claude Sonnet 4.566
  7. MiniMax-M2.162
AA-LCR / MiniMax report / score
模型与运行配置成绩
Claude Opus 4.5 (MiniMax 内部评测)Anthropic74
GPT-5.2 (Thinking; MiniMax 内部评测)OpenAI73
Claude Opus 4.6 (MiniMax 内部评测)Anthropic71
Gemini 3 Pro (MiniMax 内部评测)Google71
MiniMax-M2.5 (MiniMax 内部评测)MiniMax69.5
Claude Sonnet 4.5 (MiniMax 内部评测)Anthropic66
MiniMax-M2.1 (MiniMax 内部评测)MiniMax62
HLE no tools / DeepSeek GA report8 项成绩

供应商发布的模型成绩DeepSeek (GA model-card report)

不使用工具的跨学科推理评测。

score越高越好
  1. Fable-5 (w/ fallback)53.3
  2. Opus-4.849.8
  3. Kimi K343.5
  4. DeepSeek-V4-Pro-081342.7
  5. GLM-5.240.5
  6. DeepSeek-V4-Flash-073137.8
  7. DeepSeek-V4-Pro (Preview)37.7
  8. DeepSeek-V4-Flash (Preview)34.8
HLE no tools / DeepSeek GA report / score
模型与运行配置成绩
Fable-5 (w/ fallback) (不使用工具; 未公开 HLE 推理强度和 token 预算; 使用备用模型，未说明细节)Anthropic53.3
Opus-4.8 (不使用工具; 未公开 HLE 推理强度和 token 预算)Anthropic49.8
Kimi K3 (不使用工具; 未公开 HLE 推理强度和 token 预算)Moonshot AI43.5
DeepSeek-V4-Pro-0813 (不使用工具; 未公开 HLE 推理强度和 token 预算)DeepSeek42.7
GLM-5.2 (不使用工具; 未公开 HLE 推理强度和 token 预算)Z.ai40.5
DeepSeek-V4-Flash-0731 (不使用工具; 未公开 HLE 推理强度和 token 预算)DeepSeek37.8
DeepSeek-V4-Pro (Preview) (不使用工具; 未公开 HLE 推理强度和 token 预算)DeepSeek37.7
DeepSeek-V4-Flash (Preview) (不使用工具; 未公开 HLE 推理强度和 token 预算)DeepSeek34.8
HLE with tools / DeepSeek GA report8 项成绩

供应商发布的模型成绩DeepSeek (GA model-card report)

使用工具的跨学科推理评测。

score越高越好
  1. Fable-5 (w/ fallback)63
  2. DeepSeek-V4-Pro-081360
  3. Opus-4.857.9
  4. Kimi K356
  5. GLM-5.254.7
  6. DeepSeek-V4-Flash-073151.5
  7. DeepSeek-V4-Pro (Preview)48.2
  8. DeepSeek-V4-Flash (Preview)45.1
HLE with tools / DeepSeek GA report / score
模型与运行配置成绩
Fable-5 (w/ fallback) (使用工具; 未公开具体工具、HLE 推理强度和 token 预算; 使用备用模型，未说明细节)Anthropic63
DeepSeek-V4-Pro-0813 (使用工具; 未公开具体工具、HLE 推理强度和 token 预算)DeepSeek60
Opus-4.8 (使用工具; 未公开具体工具、HLE 推理强度和 token 预算)Anthropic57.9
Kimi K3 (使用工具; 未公开具体工具、HLE 推理强度和 token 预算)Moonshot AI56
GLM-5.2 (使用工具; 未公开具体工具、HLE 推理强度和 token 预算)Z.ai54.7
DeepSeek-V4-Flash-0731 (使用工具; 未公开具体工具、HLE 推理强度和 token 预算)DeepSeek51.5
DeepSeek-V4-Pro (Preview) (使用工具; 未公开具体工具、HLE 推理强度和 token 预算)DeepSeek48.2
DeepSeek-V4-Flash (Preview) (使用工具; 未公开具体工具、HLE 推理强度和 token 预算)DeepSeek45.1
HMMT February 2026 / DeepSeek Preview report6 项成绩

供应商发布的模型成绩DeepSeek (Preview technical report)

以单个答案成功率Pass@1衡量的数学竞赛题。

%越高越好
  1. GPT-5.4 xHigh97.7%
  2. Opus-4.6 Max96.2%
  3. DS-V4-Pro Max95.2%
  4. Gemini-3.1-Pro High94.7%
  5. K2.6 Thinking92.7%
  6. GLM-5.1 Thinking89.4%
HMMT February 2026 / DeepSeek Preview report / %
模型与运行配置成绩
GPT-5.4 xHigh (xHigh; DeepSeek Preview 报告对比)OpenAI97.7%
Opus-4.6 Max (Max; DeepSeek Preview 报告对比)Anthropic96.2%
DS-V4-Pro Max (Preview; Max; temperature=1.0; 384K token 上下文; 独立的严格证明数学提示)DeepSeek95.2%
Gemini-3.1-Pro High (High; DeepSeek Preview 报告对比)Google94.7%
K2.6 Thinking (Thinking; DeepSeek Preview 报告对比)Moonshot AI92.7%
GLM-5.1 Thinking (Thinking; DeepSeek Preview 报告对比)Z.ai89.4%
LongBench v2 / Qwen3.8-Max report4 项成绩

供应商发布的模型成绩Qwen (model-card report)

长文档与长输入的阅读和推理。

score越高越好
  1. Opus 4.869.1
  2. GPT 5.6 Sol (max)67.1
  3. Qwen3.8-Max66.3
  4. Qwen3.7-Max65.3
LongBench v2 / Qwen3.8-Max report / score
模型与运行配置成绩
Opus 4.8 (LongBench v2; 未公开工具、推理强度和 token 预算)Anthropic69.1
GPT 5.6 Sol (max) (max (表头); 未公开 LongBench v2 工具和 token 预算)OpenAI67.1
Qwen3.8-Max 服务模型; 未公开 LongBench v2 工具、推理强度和 token 预算Qwen66.3
Qwen3.7-Max (LongBench v2; 未公开工具、推理强度和 token 预算)Qwen65.3
GPQA Diamond / Google G31 (2026-02-19)5 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

不使用工具的科学知识与推理评测。

%越高越好
  1. Gemini 3.1 Pro94.3%
  2. GPT-5.292.4%
  3. Gemini 3 Pro91.9%
  4. Claude Opus 4.691.3%
  5. Claude Sonnet 4.689.9%
GPQA Diamond / Google G31 (2026-02-19) / %
模型与运行配置成绩
Gemini 3.1 Pro (Thinking (High); 不使用工具)Google94.3%
GPT-5.2 (Thinking (xhigh); 不使用工具)OpenAI92.4%
Gemini 3 Pro (Thinking (High); 不使用工具)Google91.9%
Claude Opus 4.6 (Thinking (Max); 不使用工具)Anthropic91.3%
Claude Sonnet 4.6 (Thinking (Max); 不使用工具)Anthropic89.9%
HLE, no tools / Google G31 (2026-02-19)5 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

不使用工具完成 HLE 全部文本与多模态题目。

%越高越好
  1. Gemini 3.1 Pro44.4%
  2. Claude Opus 4.640%
  3. Gemini 3 Pro37.5%
  4. GPT-5.234.5%
  5. Claude Sonnet 4.633.2%
HLE, no tools / Google G31 (2026-02-19) / %
模型与运行配置成绩
Gemini 3.1 Pro (Thinking (High); 不使用工具)Google44.4%
Claude Opus 4.6 (Thinking (Max); 不使用工具)Anthropic40%
Gemini 3 Pro (Thinking (High); 不使用工具)Google37.5%
GPT-5.2 (Thinking (xhigh); 不使用工具)OpenAI34.5%
Claude Sonnet 4.6 (Thinking (Max); 不使用工具)Anthropic33.2%
HLE, search and code / Google G31 (2026-02-19)5 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

使用搜索与代码执行的 HLE 推理评测。

%越高越好
  1. Claude Opus 4.653.1%
  2. Gemini 3.1 Pro51.4%
  3. Claude Sonnet 4.649%
  4. Gemini 3 Pro45.8%
  5. GPT-5.245.5%
HLE, search and code / Google G31 (2026-02-19) / %
模型与运行配置成绩
Claude Opus 4.6 (Thinking (Max); 搜索和代码; 各提供方专用工具)Anthropic53.1%
Gemini 3.1 Pro (Thinking (High); 搜索和代码; 各提供方专用工具)Google51.4%
Claude Sonnet 4.6 (Thinking (Max); 搜索和代码; 各提供方专用工具)Anthropic49%
Gemini 3 Pro (Thinking (High); 搜索和代码; 各提供方专用工具)Google45.8%
GPT-5.2 (Thinking (xhigh); 搜索和代码; 各提供方专用工具)OpenAI45.5%
ARC-AGI-2 / Google G31 (2026-02-19)5 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

从网格示例中推断陌生规律。

%越高越好
  1. Gemini 3.1 Pro77.1%
  2. Claude Opus 4.668.8%
  3. Claude Sonnet 4.658.3%
  4. GPT-5.252.9%
  5. Gemini 3 Pro31.1%
ARC-AGI-2 / Google G31 (2026-02-19) / %
模型与运行配置成绩
Gemini 3.1 Pro (Thinking (High); ARC Prize Verified; 半私有题集)Google77.1%
Claude Opus 4.6 (Thinking (Max); ARC Prize Verified; 半私有题集)Anthropic68.8%
Claude Sonnet 4.6 (Thinking (Max); ARC Prize Verified; 半私有题集)Anthropic58.3%
GPT-5.2 (Thinking (xhigh); ARC Prize Verified; 半私有题集)OpenAI52.9%
Gemini 3 Pro (Thinking (High); ARC Prize Verified; 半私有题集)Google31.1%
AIME 2025, no tools / Google G3F (2025-12-17)7 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3 Flash release comparison)

解答 2025 年 AIME 数学竞赛题。

%越高越好
  1. GPT-5.2100%
  2. Gemini 3 Flash95.2%
  3. Gemini 3 Pro95%
  4. Grok 4.1 Fast91.9%
  5. Gemini 2.5 Pro88%
  6. Claude Sonnet 4.587%
  7. Gemini 2.5 Flash72%
AIME 2025, no tools / Google G3F (2025-12-17) / %
模型与运行配置成绩
GPT-5.2 (Extra high; 不使用工具)OpenAI100%
Gemini 3 Flash (Thinking; 未说明具体级别; 不使用工具)Google95.2%
Gemini 3 Pro (Thinking; 未说明具体级别; 不使用工具)Google95%
Grok 4.1 Fast (Reasoning; 不使用工具)xAI91.9%
Gemini 2.5 Pro (Thinking; 未说明具体级别; 不使用工具)Google88%
Claude Sonnet 4.5 (Thinking; 优先 high，否则采用已公开的最佳设置; 不使用工具)Anthropic87%
Gemini 2.5 Flash (Thinking; 未说明具体级别; 不使用工具)Google72%
AIME 2025, code execution / Google G3F (2025-12-17)4 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3 Flash release comparison)

解答 2025 年 AIME 数学竞赛题。

%越高越好
  1. Gemini 3 Pro100%
  2. Claude Sonnet 4.5100%
  3. Gemini 3 Flash99.7%
  4. Gemini 2.5 Flash75.7%
AIME 2025, code execution / Google G3F (2025-12-17) / %
模型与运行配置成绩
Gemini 3 Pro (Thinking; 未说明具体级别; 代码执行)Google100%
Claude Sonnet 4.5 (Thinking; 优先 high，否则采用已公开的最佳设置; 代码执行)Anthropic100%
Gemini 3 Flash (Thinking; 未说明具体级别; 代码执行)Google99.7%
Gemini 2.5 Flash (Thinking; 未说明具体级别; 代码执行)Google75.7%
HLE, no tools / Anthropic A51 (2026-09-01)3 项成绩

供应商发布的模型成绩Anthropic (Fable 5.1 release comparison)

不使用工具完成原版 HLE 的 2,500 道多模态题目。

%越高越好
  1. Claude Fable 5.160.9%
  2. Claude Fable 557.8%
  3. Claude Opus 556.6%
HLE, no tools / Anthropic A51 (2026-09-01) / %
模型与运行配置成绩
Claude Fable 5.1 (Adaptive thinking (auto); max effort; 默认采样; 五次平均; 总 token 上限 1M; 不压缩对话; 启用生产安全措施; 不使用工具)Anthropic60.9%
Claude Fable 5 (未核实详细推理设置和预算; 启用生产安全措施; 不使用工具)Anthropic57.8%
Claude Opus 5 (未核实详细推理设置和预算; 不使用工具)Anthropic56.6%
HLE, tools / Anthropic A51 (2026-09-01)3 项成绩

供应商发布的模型成绩Anthropic (Fable 5.1 release comparison)

使用搜索、网页检索及代码工具的原版 HLE 推理评测。

%越高越好
  1. Claude Fable 5.165%
  2. Claude Fable 563.8%
  3. Claude Opus 563.6%
HLE, tools / Anthropic A51 (2026-09-01) / %
模型与运行配置成绩
Claude Fable 5.1 (Adaptive thinking (auto); max effort; 默认采样; 五次平均; 总 token 上限 1M; 不压缩对话; 启用生产安全措施; 搜索; 受限网页读取; 程序化工具调用; 代码执行)Anthropic65%
Claude Fable 5 (未核实详细推理设置和预算; 启用生产安全措施; 搜索; 受限网页读取; 程序化工具调用; 代码执行)Anthropic63.8%
Claude Opus 5 (未核实详细推理设置和预算; 搜索; 受限网页读取; 程序化工具调用; 代码执行)Anthropic63.6%
ARC-AGI-2 / Anthropic A51 (2026-09-01)4 项成绩

供应商发布的模型成绩Anthropic (Fable 5.1 release comparison)

九月发布比较中的陌生网格规律推理评测。

%越高越好
  1. GPT-5.6 Sol92.5%
  2. Claude Opus 590.42%
  3. Claude Fable 5.1 / Claude Mythos 5.190%
  4. Claude Fable 5 / Claude Mythos 589.2%
ARC-AGI-2 / Anthropic A51 (2026-09-01) / %
模型与运行配置成绩
GPT-5.6 Sol (未核实具体推理设置和 token 预算)OpenAI92.5%
Claude Opus 5 (未核实具体推理设置和 token 预算)Anthropic90.42%
Claude Fable 5.1 / Claude Mythos 5.1 (Fable 5.1: max effort; 半私有题集; ARC Prize Verified)Anthropic90%
Claude Fable 5 / Claude Mythos 5 (未核实具体推理设置和 token 预算)Anthropic89.2%
HLE-Verified / Google G38 (2026-09-02)6 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.8 Flash release comparison)

采用经验证及修订的 1,811 道题进行专家推理评测。

%越高越好
  1. Gemini 3.8 Flash54.9%
  2. GPT-5.6 Sol54.5%
  3. Claude Opus 554.4%
  4. Gemini 3.7 Flash53.6%
  5. GPT-5.6 Terra51.1%
  6. Claude Sonnet 531%
HLE-Verified / Google G38 (2026-09-02) / %
模型与运行配置成绩
Gemini 3.8 Flash (默认采样; 未说明具体思考级别; HLE-Verified; 1,811 题; 未说明是否使用工具)Google54.9%
GPT-5.6 Sol (未说明具体推理级别; HLE-Verified; 1,811 题; 未说明是否使用工具)OpenAI54.5%
Claude Opus 5 (未说明具体思考级别; HLE-Verified; 1,811 题; 未说明是否使用工具)Anthropic54.4%
Gemini 3.7 Flash (未说明具体思考级别; HLE-Verified; 1,811 题; 未说明是否使用工具)Google53.6%
GPT-5.6 Terra (优先最高推理级别; 否则采用已公开的最佳设置; HLE-Verified; 1,811 题; 未说明是否使用工具)OpenAI51.1%
Claude Sonnet 5 (优先最高思考级别; 否则采用已公开的最佳设置; HLE-Verified; 1,811 题; 未说明是否使用工具)Anthropic31%

文档与上下文理解

AA-LCR v1.115 项成绩

基础模型成绩Artificial Analysis

长上下文推理

%越高越好
  1. Kimi K388.67%
  2. Claude Fable 5.185.33%
  3. Muse Spark 1.384.33%
  4. Gemini 3.8 Flash84%
  5. GPT-5.6 Sol84%
  6. GPT-5.6 Luna83.67%
  7. Muse Glimmer83.33%
  8. GPT-5.3 Codex83.33%
  9. MiniMax-M383%
  10. GPT-5.6 Terra83%
  11. Gemini 3.7 Flash83%
  12. Agnes 2.5 Pro Beta83%
  13. Claude Fable 582.33%
  14. Claude Sonnet 582%
  15. Qwen3.8 27B82%
AA-LCR v1.1 / %
模型与运行配置成绩
Kimi K3 (max)Kimi88.67%
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic85.33%
Muse Spark 1.3 (max)Meta84.33%
Gemini 3.8 Flash (medium)Google84%
GPT-5.6 Sol (max)OpenAI84%
GPT-5.6 Luna (max)OpenAI83.67%
Muse Glimmer (high)Meta83.33%
GPT-5.3 Codex (xhigh)OpenAI83.33%
MiniMax-M3MiniMax83%
GPT-5.6 Terra (max)OpenAI83%
Gemini 3.7 Flash (medium)Google83%
Agnes 2.5 Pro BetaSapiens AI83%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic82.33%
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)Anthropic82%
Qwen3.8 27B (xhigh)Alibaba82%
MMMU-Pro15 项成绩

基础模型成绩Artificial Analysis

视觉推理

%越高越好
  1. GPT-6 Astra86.88%
  2. Gemini 3.8 Flash85.61%
  3. Gemini 3.7 Flash85.49%
  4. Claude Opus 584.74%
  5. Gemini 3.5 Flash83.87%
  6. GPT-5.6 Sol83.41%
  7. Gemini 3.6 Flash83.24%
  8. Gemini 3.1 Pro Preview82.43%
  9. Qwen3.8 Max82.31%
  10. Muse Spark 1.382.02%
  11. GPT-5.6 Terra80.69%
  12. Kimi K380.52%
  13. Qwen3.7 Plus80.46%
  14. Grok 4.580.4%
  15. Qwen3.8-Flash-Next79.77%
MMMU-Pro / %
模型与运行配置成绩
GPT-6 Astra (max)OpenAI86.88%
Gemini 3.8 Flash (high)Google85.61%
Gemini 3.7 Flash (high)Google85.49%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic84.74%
Gemini 3.5 Flash (medium)Google83.87%
GPT-5.6 Sol (max)OpenAI83.41%
Gemini 3.6 Flash (high)Google83.24%
Gemini 3.1 Pro PreviewGoogle82.43%
Qwen3.8 MaxAlibaba82.31%
Muse Spark 1.3 (xhigh)Meta82.02%
GPT-5.6 Terra (max)OpenAI80.69%
Kimi K3 (max)Kimi80.52%
Qwen3.7 PlusAlibaba80.46%
Grok 4.5 (high)SpaceXAI80.4%
Qwen3.8-Flash-NextAlibaba79.77%
AA-Omniscience / Index15 项成绩

基础模型成绩Artificial Analysis

知识可靠性

score越高越好
  1. GPT-6 Astra43.73
  2. Claude Fable 5.143.45
  3. Claude Fable 543.3
  4. Claude Opus 537.07
  5. Gemini 3.1 Pro Preview31.88
  6. Grok 4.630.48
  7. Gemini 3.8 Flash29.55
  8. Muse Spark 1.227.2
  9. Gemini 3.7 Flash26.48
  10. Grok 4.525.32
  11. Muse Spark 1.324.93
  12. Gemini 3.6 Flash22.13
  13. GPT-5.6 Sol21.97
  14. Gemini 3.5 Flash20.82
  15. Kimi K319.7
AA-Omniscience / Index / score
模型与运行配置成绩
GPT-6 Astra (high)OpenAI43.73
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic43.45
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic43.3
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic37.07
Gemini 3.1 Pro PreviewGoogle31.88
Grok 4.6 (high)SpaceXAI30.48
Gemini 3.8 Flash (high)Google29.55
Muse Spark 1.2 (xhigh)Meta27.2
Gemini 3.7 Flash (high)Google26.48
Grok 4.5 (high)SpaceXAI25.32
Muse Spark 1.3 (max)Meta24.93
Gemini 3.6 Flash (high)Google22.13
GPT-5.6 Sol (max)OpenAI21.97
Gemini 3.5 Flash (medium)Google20.82
Kimi K3 (max)Kimi19.7
AA-Omniscience / Accuracy15 项成绩

基础模型成绩Artificial Analysis

知识问题正确率

%越高越好
  1. Claude Fable 5.167.23%
  2. Claude Fable 565.35%
  3. GPT-6 Astra62.6%
  4. Claude Opus 560.87%
  5. GPT-5.6 Sol59.4%
  6. Gemini 3.7 Flash55.32%
  7. Gemini 3.1 Pro Preview54.85%
  8. Gemini 3.8 Flash54.6%
  9. GPT-5.3 Codex52.88%
  10. Grok 4.551.55%
  11. Gemini 3.5 Flash51.05%
  12. Gemini 3.6 Flash49.97%
  13. DeepSeek V4 Pro 081349.1%
  14. Grok 4.648.23%
  15. Kimi K347.58%
AA-Omniscience / Accuracy / %
模型与运行配置成绩
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic67.23%
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic65.35%
GPT-6 Astra (max)OpenAI62.6%
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic60.87%
GPT-5.6 Sol (max)OpenAI59.4%
Gemini 3.7 Flash (high)Google55.32%
Gemini 3.1 Pro PreviewGoogle54.85%
Gemini 3.8 Flash (high)Google54.6%
GPT-5.3 Codex (xhigh)OpenAI52.88%
Grok 4.5 (high)SpaceXAI51.55%
Gemini 3.5 Flash (medium)Google51.05%
Gemini 3.6 Flash (high)Google49.97%
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)DeepSeek49.1%
Grok 4.6 (high)SpaceXAI48.23%
Kimi K3 (max)Kimi47.58%
AA-Omniscience / Hallucination15 项成绩

基础模型成绩Artificial Analysis

幻觉率，越低越好

%越低越好
  1. MiniCPM5-1B0.9%
  2. G9v3-3B11.66%
  3. G9v3-39A5B13.04%
  4. Command A+14.16%
  5. LFM2.5-2.6B16%
  6. Grok 4.316.94%
  7. Qwen3.8 27B18.09%
  8. MiniMax-M318.43%
  9. Quasar 438B21.44%
  10. K-EXAONE 2.0 080322.6%
  11. Grok 4.624%
  12. Solar Pro 424.4%
  13. MiMo-V2.5-Pro24.7%
  14. Solar Open2 250B25.38%
  15. Granite 4.2 30B25.58%
AA-Omniscience / Hallucination / %
模型与运行配置成绩
MiniCPM5-1B (Non-reasoning)OpenBMB0.9%
G9v3-3BAI9Stars11.66%
G9v3-39A5BAI9Stars13.04%
Command A+Cohere14.16%
LFM2.5-2.6BLiquid AI16%
Grok 4.3 (medium)SpaceXAI16.94%
Qwen3.8 27B (Non-reasoning)Alibaba18.09%
MiniMax-M3MiniMax18.43%
Quasar 438B (max, based on GLM-5.2)Multiverse Computing21.44%
K-EXAONE 2.0 0803 (K-EXAONE 2.0)LG AI Research22.6%
Grok 4.6 (medium)SpaceXAI24%
Solar Pro 4Upstage24.4%
MiMo-V2.5-ProXiaomi24.7%
Solar Open2 250BUpstage25.38%
Granite 4.2 30BIBM25.58%
MathVision / Moonshot report5 项成绩

供应商发布的模型成绩Moonshot AI (model-card report)

包含图像的数学题。

score越高越好
  1. Gemini 3 Pro86.1
  2. Kimi K2.584.2
  3. GPT-5.283
  4. Claude Opus 4.577.1
  5. Qwen3-VL-235B-A22B74.6
MathVision / Moonshot report / score
模型与运行配置成绩
Gemini 3 Pro (High Thinking Level; 发布方重新运行 (*))Google86.1
Kimi K2.5 (Thinking)Moonshot AI84.2
GPT-5.2 (xhigh)OpenAI83
Claude Opus 4.5 (Extended Thinking; 发布方重新运行 (*))Anthropic77.1
Qwen3-VL-235B-A22B (Thinking)Qwen74.6
OCRBench / Moonshot report5 项成绩

供应商发布的模型成绩Moonshot AI (model-card report)

图像中的文字识别。

score越高越好
  1. Kimi K2.592.3
  2. Gemini 3 Pro90.3
  3. Qwen3-VL-235B-A22B87.5
  4. Claude Opus 4.586.5
  5. GPT-5.280.7
OCRBench / Moonshot report / score
模型与运行配置成绩
Kimi K2.5 (Thinking)Moonshot AI92.3
Gemini 3 Pro (High Thinking Level; 发布方重新运行 (*))Google90.3
Qwen3-VL-235B-A22B (Thinking)Qwen87.5
Claude Opus 4.5 (Extended Thinking; 发布方重新运行 (*))Anthropic86.5
GPT-5.2 (xhigh; 发布方重新运行 (*))OpenAI80.7
OmniDocBench 1.5 / Moonshot report5 项成绩

供应商发布的模型成绩Moonshot AI (model-card report)

文档阅读。公布分数为归一化编辑距离的补数乘以 100。

score越高越好
  1. Kimi K2.588.8
  2. Gemini 3 Pro88.5
  3. Claude Opus 4.587.7
  4. GPT-5.285.7
  5. Qwen3-VL-235B-A22B82
OmniDocBench 1.5 / Moonshot report / score
模型与运行配置成绩
Kimi K2.5 (Thinking)Moonshot AI88.8
Gemini 3 Pro (High Thinking Level)Google88.5
Claude Opus 4.5 (Extended Thinking; 发布方重新运行 (*))Anthropic87.7
GPT-5.2 (xhigh)OpenAI85.7
Qwen3-VL-235B-A22B (Thinking; 发布方重新运行 (*))Qwen82
VideoMMMU / Moonshot report5 项成绩

供应商发布的模型成绩Moonshot AI (model-card report)

跨学科视频理解。

score越高越好
  1. Gemini 3 Pro87.6
  2. Kimi K2.586.6
  3. GPT-5.285.9
  4. Claude Opus 4.584.4
  5. Qwen3-VL-235B-A22B80
VideoMMMU / Moonshot report / score
模型与运行配置成绩
Gemini 3 Pro (High Thinking Level)Google87.6
Kimi K2.5 (Thinking)Moonshot AI86.6
GPT-5.2 (xhigh)OpenAI85.9
Claude Opus 4.5 (Extended Thinking; 发布方重新运行 (*))Anthropic84.4
Qwen3-VL-235B-A22B (Thinking)Qwen80
MotionBench / Moonshot report4 项成绩

供应商发布的模型成绩Moonshot AI (model-card report)

理解视频中的运动。

score越高越好
  1. Kimi K2.570.4
  2. Gemini 3 Pro70.3
  3. GPT-5.264.8
  4. Claude Opus 4.560.3
MotionBench / Moonshot report / score
模型与运行配置成绩
Kimi K2.5 (Thinking)Moonshot AI70.4
Gemini 3 Pro (High Thinking Level)Google70.3
GPT-5.2 (xhigh)OpenAI64.8
Claude Opus 4.5 (Extended Thinking)Anthropic60.3
IFBench / MiniMax report7 项成绩

供应商发布的模型成绩MiniMax (internal evaluation)

遵循详细指令。

score越高越好
  1. GPT-5.275
  2. MiniMax-M2.570
  3. MiniMax-M2.170
  4. Gemini 3 Pro70
  5. Claude Opus 4.558
  6. Claude Sonnet 4.557
  7. Claude Opus 4.653
IFBench / MiniMax report / score
模型与运行配置成绩
GPT-5.2 (Thinking; MiniMax 内部评测)OpenAI75
MiniMax-M2.5 (MiniMax 内部评测)MiniMax70
MiniMax-M2.1 (MiniMax 内部评测)MiniMax70
Gemini 3 Pro (MiniMax 内部评测)Google70
Claude Opus 4.5 (MiniMax 内部评测)Anthropic58
Claude Sonnet 4.5 (MiniMax 内部评测)Anthropic57
Claude Opus 4.6 (MiniMax 内部评测)Anthropic53
MMMLU / DeepSeek Base report3 项成绩

供应商发布的模型成绩DeepSeek (Base technical report)

提供5个示例，以答案完全匹配率衡量的多语言知识。

%越高越好
  1. DeepSeek-V4-Pro-Base90.3%
  2. DeepSeek-V4-Flash-Base88.8%
  3. DeepSeek-V3.2-Base87.9%
MMMLU / DeepSeek Base report / %
模型与运行配置成绩
DeepSeek-V4-Pro-Base (Base; MMMLU EM; 5-shot; 统一的内部评测环境; 未公开采样和工具)DeepSeek90.3%
DeepSeek-V4-Flash-Base (Base; MMMLU EM; 5-shot; 统一的内部评测环境; 未公开采样和工具)DeepSeek88.8%
DeepSeek-V3.2-Base (Base; MMMLU EM; 5-shot; 统一的内部评测环境; 未公开采样和工具)DeepSeek87.9%
OmniDocBench 1.5 / Qwen3.8-27B report5 项成绩

供应商发布的模型成绩Qwen (model-card report)

使用提供方公布分数比较文档图像读取能力。

score越高越好
  1. Qwen3.7-Plus91.4
  2. Qwen3.8-27B91.1
  3. Qwen3.6-27B89.4
  4. Opus4.6 Max86.6
  5. Muse Glimmer-30B75.8
OmniDocBench 1.5 / Qwen3.8-27B report / score
模型与运行配置成绩
Qwen3.7-Plus (OmniDocBench 1.5; 未公开工具、推理强度和图像设置)Qwen91.4
Qwen3.8-27B (OmniDocBench 1.5; 未公开工具、推理强度和图像设置)Qwen91.1
Qwen3.6-27B (OmniDocBench 1.5; 未公开工具、推理强度和图像设置)Qwen89.4
Opus4.6 Max (Max (表头); 未公开 OmniDocBench 1.5 工具和图像设置)Anthropic86.6
Muse Glimmer-30B (OmniDocBench 1.5; 未公开工具、推理强度和图像设置)Meta75.8
MMMU-Pro / Google G31 (2026-02-19)5 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

不使用工具理解多模态信息并进行推理。

%越高越好
  1. Gemini 3 Pro81%
  2. Gemini 3.1 Pro80.5%
  3. GPT-5.279.5%
  4. Claude Sonnet 4.674.5%
  5. Claude Opus 4.673.9%
MMMU-Pro / Google G31 (2026-02-19) / %
模型与运行配置成绩
Gemini 3 Pro (Thinking (High); 不使用工具; 标准(10 个选项)与图像题平均)Google81%
Gemini 3.1 Pro (Thinking (High); 不使用工具; 标准(10 个选项)与图像题平均)Google80.5%
GPT-5.2 (Thinking (xhigh); 不使用工具; 标准(10 个选项)与图像题平均)OpenAI79.5%
Claude Sonnet 4.6 (Thinking (Max); 不使用工具; 标准(10 个选项)与图像题平均)Anthropic74.5%
Claude Opus 4.6 (Thinking (Max); 不使用工具; 标准(10 个选项)与图像题平均)Anthropic73.9%
MRCR v2, 128k / Google G31 (2026-02-19)5 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

长上下文中检索 8 项指定信息，采用截至 128k 令牌的累计平均。

%越高越好
  1. Gemini 3.1 Pro84.9%
  2. Claude Sonnet 4.684.9%
  3. Claude Opus 4.684%
  4. GPT-5.283.8%
  5. Gemini 3 Pro77%
MRCR v2, 128k / Google G31 (2026-02-19) / %
模型与运行配置成绩
Gemini 3.1 Pro (Thinking (High); MRCR v2; 8 个目标; 128k 累计平均)Google84.9%
Claude Sonnet 4.6 (Thinking (Max); MRCR v2; 8 个目标; 128k 累计平均)Anthropic84.9%
Claude Opus 4.6 (Thinking (Max); MRCR v2; 8 个目标; 128k 累计平均)Anthropic84%
GPT-5.2 (Thinking (xhigh); MRCR v2; 8 个目标; 128k 累计平均)OpenAI83.8%
Gemini 3 Pro (Thinking (High); MRCR v2; 8 个目标; 128k 累计平均)Google77%
MRCR v2, 1M / Google G31 (2026-02-19)2 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.1 Pro release comparison)

在 1M 令牌长度处检索 8 项指定信息的评测。

%越高越好
  1. Gemini 3.1 Pro26.3%
  2. Gemini 3 Pro26.3%
MRCR v2, 1M / Google G31 (2026-02-19) / %
模型与运行配置成绩
Gemini 3.1 Pro (Thinking (High); MRCR v2; 8 个目标; 1M 逐点)Google26.3%
Gemini 3 Pro (Thinking (High); MRCR v2; 8 个目标; 1M 逐点)Google26.3%
CharXiv Reasoning / Google G38 (2026-09-02)6 项成绩

供应商发布的模型成绩Google DeepMind (Gemini 3.8 Flash release comparison)

不使用工具综合复杂图表中的信息。

%越高越好
  1. Gemini 3.8 Flash86.2%
  2. GPT-5.6 Terra85.9%
  3. GPT-5.6 Sol85.8%
  4. Gemini 3.7 Flash84.5%
  5. Claude Opus 583.7%
  6. Claude Sonnet 570.1%
CharXiv Reasoning / Google G38 (2026-09-02) / %
模型与运行配置成绩
Gemini 3.8 Flash (默认采样; 未说明具体思考级别; 不使用工具)Google86.2%
GPT-5.6 Terra (优先最高推理级别; 否则采用已公开的最佳设置; 不使用工具)OpenAI85.9%
GPT-5.6 Sol (未说明具体推理级别; 不使用工具)OpenAI85.8%
Gemini 3.7 Flash (未说明具体思考级别; 不使用工具)Google84.5%
Claude Opus 5 (未说明具体思考级别; 不使用工具)Anthropic83.7%
Claude Sonnet 5 (优先最高思考级别; 否则采用已公开的最佳设置; 不使用工具)Anthropic70.1%

检索模型

MTEB / OpenAI embeddings report3 项成绩

检索模型成绩OpenAI (developer documentation)

文本嵌入模型评测，与生成式模型推理分开。

%越高越好
  1. text-embedding-3-large64.6%
  2. text-embedding-3-small62.3%
  3. text-embedding-ada-00261%
MTEB / OpenAI embeddings report / %
模型与运行配置成绩
text-embedding-3-large (已公开的 MTEB 结果; 未说明评测维度)OpenAI64.6%
text-embedding-3-small (已公开的 MTEB 结果; 未说明评测维度)OpenAI62.3%
text-embedding-ada-002 (已公开的 MTEB 结果; 未说明评测维度)OpenAI61%

时间与成本

Intelligence Index / Cost per task15 项成绩

基础模型成绩Artificial Analysis

评测任务加权平均成本

USD越低越好
  1. GLM 5.3 Flash0.18
  2. Muse Spark 1.20.55
  3. Gemini 3.8 Flash0.74
  4. GPT-5.6 Terra0.81
  5. Muse Spark 1.30.96
  6. Qwen3.8 2.4T A95B1.1
  7. Qwen3.8 Max1.19
  8. GPT-5.6 Sol1.25
  9. Grok 4.61.25
  10. GLM-5.31.26
  11. Kimi K31.58
  12. GPT-6 Astra2.57
  13. Claude Opus 54.21
  14. Claude Fable 55.62
  15. Claude Fable 5.16.12
Intelligence Index / Cost per task / USD
模型与运行配置成绩
GLM 5.3 Flash (GLM-5.3-Flash)Z AI0.18
Muse Spark 1.2 (xhigh)Meta0.55
Gemini 3.8 Flash (high)Google0.74
GPT-5.6 Terra (max)OpenAI0.81
Muse Spark 1.3 (max)Meta0.96
Qwen3.8 2.4T A95BAlibaba1.1
Qwen3.8 MaxAlibaba1.19
GPT-5.6 Sol (max)OpenAI1.25
Grok 4.6 (high)SpaceXAI1.25
GLM-5.3 (max)Z AI1.26
Kimi K3 (max)Kimi1.58
GPT-6 Astra (max)OpenAI2.57
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic4.21
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic5.62
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic6.12
Output speed15 项成绩

基础模型成绩Artificial Analysis

输出生成速度

tokens/s越高越好
  1. Gemini 3.8 Flash280.76
  2. Muse Spark 1.2269.24
  3. Muse Spark 1.3233.15
  4. GPT-5.6 Terra113.93
  5. GLM-5.383.31
  6. GPT-5.6 Sol75.78
  7. Claude Fable 5.168.22
  8. GPT-6 Astra64.26
  9. Claude Fable 562.97
  10. Grok 4.659.89
  11. Claude Opus 555.95
  12. GLM 5.3 Flash50.63
  13. Kimi K341.61
  14. Qwen3.8 2.4T A95B40.23
  15. Qwen3.8 Max40.15
Output speed / tokens/s
模型与运行配置成绩
Gemini 3.8 Flash (high)Google280.76
Muse Spark 1.2 (xhigh)Meta269.24
Muse Spark 1.3 (max)Meta233.15
GPT-5.6 Terra (max)OpenAI113.93
GLM-5.3 (max)Z AI83.31
GPT-5.6 Sol (max)OpenAI75.78
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic68.22
GPT-6 Astra (max)OpenAI64.26
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic62.97
Grok 4.6 (high)SpaceXAI59.89
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic55.95
GLM 5.3 Flash (GLM-5.3-Flash)Z AI50.63
Kimi K3 (max)Kimi41.61
Qwen3.8 2.4T A95BAlibaba40.23
Qwen3.8 MaxAlibaba40.15
API input price15 项成绩

基础模型成绩Artificial Analysis

每百万输入令牌价格

USD / 1M越低越好
  1. GLM 5.3 Flash0.15
  2. Gemini 3.8 Flash0.75
  3. Muse Spark 1.31.25
  4. Muse Spark 1.21.25
  5. GLM-5.31.4
  6. Grok 4.62
  7. Qwen3.8 Max2
  8. GPT-5.6 Terra2
  9. Qwen3.8 2.4T A95B2
  10. Kimi K33
  11. GPT-5.6 Sol4
  12. Claude Opus 55
  13. Claude Fable 5.110
  14. GPT-6 Astra10
  15. Claude Fable 510
API input price / USD / 1M
模型与运行配置成绩
GLM 5.3 Flash (GLM-5.3-Flash)Z AI0.15
Gemini 3.8 Flash (high)Google0.75
Muse Spark 1.3 (max)Meta1.25
Muse Spark 1.2 (xhigh)Meta1.25
GLM-5.3 (max)Z AI1.4
Grok 4.6 (high)SpaceXAI2
Qwen3.8 MaxAlibaba2
GPT-5.6 Terra (max)OpenAI2
Qwen3.8 2.4T A95BAlibaba2
Kimi K3 (max)Kimi3
GPT-5.6 Sol (max)OpenAI4
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic5
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic10
GPT-6 Astra (max)OpenAI10
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic10
API output price15 项成绩

基础模型成绩Artificial Analysis

每百万输出令牌价格

USD / 1M越低越好
  1. GLM 5.3 Flash0.5
  2. Gemini 3.8 Flash3.75
  3. Muse Spark 1.34.25
  4. Muse Spark 1.24.25
  5. GLM-5.34.4
  6. Grok 4.66
  7. Qwen3.8 Max6
  8. Qwen3.8 2.4T A95B6
  9. GPT-5.6 Terra12
  10. Kimi K315
  11. GPT-5.6 Sol20
  12. Claude Opus 525
  13. Claude Fable 5.150
  14. GPT-6 Astra50
  15. Claude Fable 550
API output price / USD / 1M
模型与运行配置成绩
GLM 5.3 Flash (GLM-5.3-Flash)Z AI0.5
Gemini 3.8 Flash (high)Google3.75
Muse Spark 1.3 (max)Meta4.25
Muse Spark 1.2 (xhigh)Meta4.25
GLM-5.3 (max)Z AI4.4
Grok 4.6 (high)SpaceXAI6
Qwen3.8 MaxAlibaba6
Qwen3.8 2.4T A95BAlibaba6
GPT-5.6 Terra (max)OpenAI12
Kimi K3 (max)Kimi15
GPT-5.6 Sol (max)OpenAI20
Claude Opus 5 (Adaptive Reasoning, Max Effort)Anthropic25
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic50
GPT-6 Astra (max)OpenAI50
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)Anthropic50

正文来源与延伸阅读

  1. Anthropic. Demystifying evals for AI agents
  2. OpenAI. GDPval
  3. OpenAI. BrowseComp
  4. Parallel. Deep Research price-performance
  5. LangChain. Improving Deep Agents with harness engineering
  6. LangChain. Deep Agents source code
  7. DeepResearch Bench II. Evaluation code
  8. ResearchRubrics. Evaluation code
  9. Agents’ Last Exam. Tasks and evaluation