SWE 任务和轨迹进度看板

最后更新时间:2026-07-08 05:40:44 BJT | 下次刷新:2026-07-08 06:40:45 BJT | 刷新间隔:3600 秒

收集 PR 总数
557,087
1h 0 / 24h +2
有效 SWE 总数
52,678
1h +4 / 24h +26
整体处理成功率
9.7%
Valid SWE / 已处理 545,867
difficulty_score 均值
5.90
median 5.9,count 52,628

语言进度

语言收集 PR过去 1h过去 24h有效 SWE过去 1h过去 24h已处理处理成功率
Cc29,4700010,2710+128,870
35.6%
C++cpp45,625004,0620045,552
8.9%
Gogo126,4480+18,393+1+7118,839
7.1%
Javajava84,869004,3450+684,386
5.1%
JavaScriptjs36,409007,2570035,809
20.3%
Pythonpy98,883005,969+1+298,321
6.1%
Rustrust68,650005,5950068,018
8.2%
TypeScriptts66,7330+16,786+2+1066,072
10.3%

运行参数

语言评估模型 (OPENAI)填充模型 (ANTHROPIC)并发数min_source_filesmax_source_files
CQwen3.6-35B-A3Bclaude-opus-4-812215
C++Qwen3.6-35B-A3Bclaude-opus-4-88215
GoQwen3.6-35B-A3Bclaude-opus-4-812210
JavaQwen3.6-35B-A3Bclaude-opus-4-88210
JavaScriptQwen3.6-35B-A3Bclaude-opus-4-812210
PythonQwen3.6-35B-A3Bclaude-opus-4-812315
RustQwen3.6-35B-A3Bclaude-opus-4-88210
TypeScriptQwen3.6-35B-A3Bclaude-opus-4-812210

失败原因统计

语言已处理有效 SWE失败trivial_prvalidationinfra_errortimeoutworkflow_error其他
C28,87010,27118,59916,3158582,1761252
C++45,5524,06241,4908,2376,14528,408159543266
Go118,8398,393110,44636,22022,34549,3791,44795799
Java84,3864,34580,04125,65410,98637,6591,1553,4621,599
JavaScript35,8097,25728,55218,1831811,9341600
Python98,3215,96992,35243,46712,65936,740857330120
Rust68,0185,59562,42329,1198,62022,3471,0716991,233
TypeScript66,0726,78659,28619,74012,22125,3481,7765758

trivial_pr:PR 被 LLM 评估为过于简单(如仅修改配置、文档、依赖版本等),不适合作为 SWE 任务。

validation:任务生成后验证失败(NOP agent 未返回 reward=0 或 ORACLE agent 未返回 reward=1)。

infra_error:基础设施错误(Docker 构建失败、网络超时、磁盘空间不足等)。

timeout:处理超时(单个 PR 总超时或 Claude Code session 超时)。

workflow_error:工作流程错误(PR 元数据获取失败、worktree 创建失败、patch 生成失败等)。

fix.patch 复杂度

语言Valid SWE CountAvg fix.patch linesAvg fix.patch hunksAvg fix.patch files
C10,271333.2617.965.82
C++4,062286.0413.745.09
Go8,393211.8612.554.34
Java4,345167.0510.824.32
JavaScript7,25777.116.312.80
Python5,969156.5611.233.95
Rust5,595226.3513.194.11
TypeScript6,786155.269.534.12

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patchtests/instruction.md,由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分,避免中等规模 patch 过早变成 hard。权重为:patch_scope 38%logic_complexity 32%context_breadth 15%test_complexity 10%instruction_complexity 5%

label 阈值:easy <= 4.0medium <= 7.0hard > 7.0

Tags 生成与展示

tags 不是看板现场计算的,而是在 swegen 构建任务时由 LLM 根据 PR 信息生成,并写入 task.toml[metadata].tags

prompt 要求 tags 按三段式生成:编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch,并按语言扩展名过滤代码文件,口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数;Avg fix.patch hunks 统计 @@ hunk 数;Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言easy / medium / hardeasymediumhard
C
897 / 6768 / 2598
8976,7682,598
C++
433 / 2524 / 1100
4332,5241,100
Go
691 / 6046 / 1650
6916,0461,650
Java
472 / 2806 / 1063
4722,8061,063
JavaScript
1096 / 5376 / 784
1,0965,376784
Python
281 / 3762 / 1902
2813,7621,902
Rust
391 / 3312 / 1890
3913,3121,890
TypeScript
625 / 5005 / 1156
6255,0051,156

difficulty_score 概览

语言countminp25medianmeanp75max
C10,2632.44.96.05.997.19.2
C++4,0572.54.96.05.997.29.1
Go8,3872.64.95.85.856.89.1
Java4,3412.84.85.95.917.09.2
JavaScript7,2562.64.45.25.366.29.2
Python5,9452.65.36.36.297.49.1
Rust5,5932.75.26.36.267.49.0
TypeScript6,7862.74.75.65.726.69.2

全局 Top Tags

library24,569 (46.7%)
backend16,313 (31.0%)
cli7,038 (13.4%)
missing-feature3,731 (7.1%)
frontend3,202 (6.1%)
testing2,229 (4.2%)
http1,608 (3.1%)
react1,449 (2.8%)
incomplete-validation1,379 (2.6%)
framework1,256 (2.4%)
missing-implementation1,198 (2.3%)
missing-metadata-propagation955 (1.8%)
missing-fallback866 (1.6%)
kubernetes746 (1.4%)
async694 (1.3%)
wrong-default667 (1.3%)
embedded643 (1.2%)
networking629 (1.2%)
cpp607 (1.2%)
missing-validation578 (1.1%)
missing-functionality454 (0.9%)
missing-configuration426 (0.8%)
typescript402 (0.8%)
type-handling-inconsistency389 (0.7%)
parsing365 (0.7%)
eslint350 (0.7%)
graphql344 (0.7%)
race-condition337 (0.6%)
missing-configuration-option317 (0.6%)
postgresql301 (0.6%)

每语言 Tags 分布

C c

library5,450 (53.1%)
backend2,634 (25.6%)
cli1,174 (11.4%)
missing-feature710 (6.9%)
embedded617 (6.0%)
cpp601 (5.9%)
testing417 (4.1%)
networking409 (4.0%)
framework294 (2.9%)
incomplete-validation288 (2.8%)
missing-implementation284 (2.8%)
http224 (2.2%)
ruby221 (2.2%)
postgresql213 (2.1%)
firmware184 (1.8%)
kernel182 (1.8%)
quic180 (1.8%)
missing-metadata-propagation153 (1.5%)
rust141 (1.4%)
tls137 (1.3%)

C++ cpp

library2,794 (68.8%)
backend741 (18.2%)
testing496 (12.2%)
cli359 (8.8%)
missing-feature268 (6.6%)
framework186 (4.6%)
missing-implementation144 (3.5%)
http129 (3.2%)
incomplete-validation119 (2.9%)
boost114 (2.8%)
async92 (2.3%)
parsing76 (1.9%)
qt65 (1.6%)
serialization55 (1.4%)
compiler54 (1.3%)
geometry51 (1.3%)
missing-fallback50 (1.2%)
networking49 (1.2%)
missing-metadata-propagation48 (1.2%)
formatting45 (1.1%)

Go go

backend4,427 (52.8%)
library2,089 (24.9%)
cli2,028 (24.2%)
missing-feature739 (8.8%)
kubernetes666 (7.9%)
http536 (6.4%)
incomplete-validation251 (3.0%)
testing236 (2.8%)
missing-metadata-propagation207 (2.5%)
missing-fallback179 (2.1%)
missing-implementation179 (2.1%)
docker134 (1.6%)
wrong-default134 (1.6%)
terraform125 (1.5%)
grpc122 (1.5%)
aws121 (1.4%)
missing-validation120 (1.4%)
prometheus116 (1.4%)
networking97 (1.2%)
database90 (1.1%)

Java java

backend2,111 (48.6%)
library1,967 (45.3%)
missing-feature242 (5.6%)
testing222 (5.1%)
spring165 (3.8%)
framework157 (3.6%)
aem147 (3.4%)
http147 (3.4%)
android129 (3.0%)
incomplete-validation101 (2.3%)
missing-metadata-propagation96 (2.2%)
missing-implementation83 (1.9%)
missing-configuration72 (1.7%)
cli71 (1.6%)
json68 (1.6%)
missing-null-check64 (1.5%)
wrong-default63 (1.5%)
maven61 (1.4%)
kafka57 (1.3%)
sling57 (1.3%)

JavaScript js

library3,913 (53.9%)
backend1,239 (17.1%)
frontend1,043 (14.4%)
cli859 (11.8%)
missing-feature496 (6.8%)
react354 (4.9%)
typescript334 (4.6%)
testing297 (4.1%)
eslint263 (3.6%)
incomplete-validation221 (3.0%)
framework200 (2.8%)
http183 (2.5%)
fastify149 (2.1%)
webpack148 (2.0%)
missing-fallback124 (1.7%)
missing-metadata-propagation113 (1.6%)
svelte106 (1.5%)
mongoose104 (1.4%)
nodejs104 (1.4%)
missing-implementation100 (1.4%)

Python py

library2,588 (43.5%)
backend2,425 (40.8%)
cli800 (13.4%)
missing-feature518 (8.7%)
fastapi235 (4.0%)
django174 (2.9%)
missing-implementation147 (2.5%)
pytorch144 (2.4%)
incomplete-validation124 (2.1%)
testing119 (2.0%)
missing-fallback117 (2.0%)
missing-metadata-propagation117 (2.0%)
async112 (1.9%)
framework104 (1.7%)
http102 (1.7%)
ansible100 (1.7%)
aws80 (1.3%)
pydantic73 (1.2%)
aiohttp66 (1.1%)
flask66 (1.1%)

Rust rust

library3,132 (56.0%)
backend1,224 (21.9%)
cli1,138 (20.3%)
missing-feature411 (7.3%)
testing315 (5.6%)
async225 (4.0%)
http211 (3.8%)
missing-implementation162 (2.9%)
incomplete-validation133 (2.4%)
compiler120 (2.1%)
git119 (2.1%)
missing-metadata-propagation97 (1.7%)
macros93 (1.7%)
parsing92 (1.6%)
graphql81 (1.4%)
blockchain80 (1.4%)
substrate77 (1.4%)
serde73 (1.3%)
missing-fallback71 (1.3%)
sql65 (1.2%)

TypeScript ts

library2,636 (38.8%)
frontend1,860 (27.4%)
backend1,512 (22.3%)
react1,084 (16.0%)
cli609 (9.0%)
missing-feature347 (5.1%)
angular204 (3.0%)
graphql164 (2.4%)
framework163 (2.4%)
missing-fallback149 (2.2%)
javascript145 (2.1%)
electron144 (2.1%)
incomplete-validation142 (2.1%)
fullstack134 (2.0%)
testing127 (1.9%)
missing-metadata-propagation124 (1.8%)
wrong-default121 (1.8%)
vue106 (1.6%)
missing-implementation99 (1.5%)
eslint87 (1.3%)
无轨迹数据