SWE 任务和轨迹进度看板

收集 PR 总数

557,067

1h 0 / 24h 0

有效 SWE 总数

49,585

1h +53 / 24h +327

整体处理成功率

10.5%

Valid SWE / 已处理 470,524

difficulty_score 均值

5.89

median 5.8，count 49,528

语言进度

语言	收集 PR	有效 SWE	过去 1h	过去 24h	已处理	处理成功率
Cc	29,469	9,684	+1	+21	29,469	32.9%
C++cpp	45,620	4,032	0	0	19,510	20.7%
Gogo	126,439	7,993	+15	+109	87,043	9.2%
Javajava	84,868	4,011	0	+7	77,323	5.2%
JavaScriptjs	36,409	7,083	0	+20	36,409	19.5%
Pythonpy	98,883	4,974	+18	+84	95,824	5.2%
Rustrust	68,650	5,468	+12	+54	68,611	8.0%
TypeScriptts	66,729	6,340	+7	+32	56,335	11.3%

运行参数

语言	评估模型 (OPENAI)	填充模型 (ANTHROPIC)	并发数	min_source_files	max_source_files
C	`gpt-5.4`	`claude-sonnet-4-6`	12	2	15
C++	`glm-5`	`claude-sonnet-4-6`	8	2	15
Go	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	12	2	10
Java	`claude-haiku-4-5-20251001`	`claude-sonnet-4-6`	8	2	10
JavaScript	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	12	2	10
Python	`glm-5`	`claude-sonnet-4-6`	12	3	15
Rust	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	8	2	10
TypeScript	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	12	2	10

失败原因统计

语言	已处理	有效 SWE	失败	trivial_pr	validation	infra_error	timeout	workflow_error	其他
C	29,469	9,684	19,785	14,632	363	5,083	21	29	1
C++	19,510	4,032	15,478	2,058	73	14,897	156	285	266
Go	87,043	7,993	79,050	21,486	7,121	47,668	1,520	733	505
Java	77,323	4,011	73,312	17,593	6,585	44,732	1,293	1,914	1,602
JavaScript	36,409	7,083	29,326	15,019	823	14,416	546	144	0
Python	95,824	4,974	90,850	26,158	5,787	59,197	944	358	120
Rust	68,611	5,468	63,143	19,091	4,527	36,890	1,243	811	1,234
TypeScript	56,335	6,340	49,995	13,497	3,083	31,293	1,721	757	11

trivial_pr：PR 被 LLM 评估为过于简单（如仅修改配置、文档、依赖版本等），不适合作为 SWE 任务。

validation：任务生成后验证失败（NOP agent 未返回 reward=0 或 ORACLE agent 未返回 reward=1）。

infra_error：基础设施错误（Docker 构建失败、网络超时、磁盘空间不足等）。

timeout：处理超时（单个 PR 总超时或 Claude Code session 超时）。

workflow_error：工作流程错误（PR 元数据获取失败、worktree 创建失败、patch 生成失败等）。

fix.patch 复杂度

语言	Valid SWE Count	Avg fix.patch lines	Avg fix.patch hunks	Avg fix.patch files
C	9,684	334.26	17.92	5.84
C++	4,032	287.03	13.73	5.10
Go	7,993	214.66	12.73	4.37
Java	4,011	163.43	10.50	4.23
JavaScript	7,083	77.29	6.29	2.79
Python	4,974	151.92	10.98	3.83
Rust	5,468	226.41	13.17	4.10
TypeScript	6,340	158.73	9.60	4.14

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patch、tests/ 和 instruction.md，由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分，避免中等规模 patch 过早变成 hard。权重为：patch_scope 38%、logic_complexity 32%、context_breadth 15%、test_complexity 10%、instruction_complexity 5%。

label 阈值：easy <= 4.0，medium <= 7.0，hard > 7.0。

Tags 生成与展示

tags 不是看板现场计算的，而是在 swegen 构建任务时由 LLM 根据 PR 信息生成，并写入 task.toml 的 [metadata].tags。

prompt 要求 tags 按三段式生成：编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch，并按语言扩展名过滤代码文件，口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数；Avg fix.patch hunks 统计 @@ hunk 数；Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言	easy / medium / hard	easy	medium	hard
C	866 / 6400 / 2408	866	6,400	2,408
C++	431 / 2501 / 1092	431	2,501	1,092
Go	621 / 5777 / 1589	621	5,777	1,589
Java	443 / 2599 / 964	443	2,599	964
JavaScript	1066 / 5250 / 765	1,066	5,250	765
Python	268 / 3197 / 1486	268	3,197	1,486
Rust	380 / 3240 / 1846	380	3,240	1,846
TypeScript	563 / 4694 / 1082	563	4,694	1,082

difficulty_score 概览

语言	count	min	p25	median	mean	p75	max
C	9,674	2.4	4.9	6.0	5.97	7.0	9.2
C++	4,024	2.5	4.9	6.0	5.99	7.2	9.1
Go	7,987	2.6	4.9	5.8	5.87	6.8	9.1
Java	4,006	2.8	4.8	5.9	5.89	7.0	9.2
JavaScript	7,081	2.6	4.4	5.2	5.36	6.2	9.2
Python	4,951	2.6	5.2	6.2	6.21	7.3	9.1
Rust	5,466	2.7	5.2	6.3	6.26	7.4	9.0
TypeScript	6,339	2.7	4.7	5.7	5.72	6.6	9.1

全局 Top Tags

library23,104 (46.6%)

backend15,240 (30.8%)

cli6,708 (13.5%)

frontend3,020 (6.1%)

testing2,160 (4.4%)

http1,529 (3.1%)

react1,380 (2.8%)

framework1,208 (2.4%)

kubernetes699 (1.4%)

async669 (1.4%)

embedded640 (1.3%)

networking613 (1.2%)

cpp590 (1.2%)

typescript375 (0.8%)

parsing357 (0.7%)

eslint339 (0.7%)

graphql333 (0.7%)

postgresql298 (0.6%)

security285 (0.6%)

compiler284 (0.6%)

git282 (0.6%)

database279 (0.6%)

aws260 (0.5%)

json247 (0.5%)

redis236 (0.5%)

api224 (0.5%)

fastapi223 (0.5%)

ruby220 (0.4%)

angular207 (0.4%)

cryptography205 (0.4%)

每语言 Tags 分布

C c

library5,074 (52.4%)

backend2,504 (25.9%)

cli1,117 (11.5%)

embedded614 (6.3%)

cpp587 (6.1%)

testing408 (4.2%)

networking400 (4.1%)

framework287 (3.0%)

postgresql212 (2.2%)

ruby209 (2.2%)

http201 (2.1%)

firmware185 (1.9%)

kernel178 (1.8%)

quic169 (1.7%)

rust140 (1.4%)

bluetooth129 (1.3%)

tls128 (1.3%)

python114 (1.2%)

scheduler111 (1.1%)

cryptography107 (1.1%)

C++ cpp

library2,779 (69.0%)

backend728 (18.1%)

testing488 (12.1%)

cli356 (8.8%)

framework185 (4.6%)

http129 (3.2%)

boost114 (2.8%)

async91 (2.3%)

parsing76 (1.9%)

qt63 (1.6%)

compiler54 (1.3%)

serialization54 (1.3%)

geometry51 (1.3%)

networking49 (1.2%)

formatting45 (1.1%)

ros244 (1.1%)

frontend40 (1.0%)

json40 (1.0%)

logging37 (0.9%)

templates36 (0.9%)

Go go

backend4,192 (52.5%)

library2,002 (25.1%)

cli1,935 (24.2%)

kubernetes640 (8.0%)

http517 (6.5%)

testing222 (2.8%)

docker133 (1.7%)

aws118 (1.5%)

grpc117 (1.5%)

terraform117 (1.5%)

prometheus100 (1.3%)

networking96 (1.2%)

database88 (1.1%)

framework86 (1.1%)

api81 (1.0%)

git77 (1.0%)

security69 (0.9%)

aws-sdk65 (0.8%)

blockchain56 (0.7%)

configuration56 (0.7%)

Java java

backend1,945 (48.5%)

library1,812 (45.2%)

testing210 (5.2%)

spring158 (3.9%)

framework151 (3.8%)

aem147 (3.7%)

http136 (3.4%)

android118 (2.9%)

json67 (1.7%)

cli64 (1.6%)

maven59 (1.5%)

sling57 (1.4%)

kafka53 (1.3%)

flink48 (1.2%)

concurrency47 (1.2%)

grpc47 (1.2%)

frontend46 (1.1%)

mybatis37 (0.9%)

nacos34 (0.8%)

security34 (0.8%)

JavaScript js

library3,814 (53.9%)

backend1,226 (17.3%)

frontend999 (14.1%)

cli848 (12.0%)

react344 (4.9%)

typescript312 (4.4%)

testing292 (4.1%)

eslint260 (3.7%)

framework196 (2.8%)

http179 (2.5%)

fastify146 (2.1%)

webpack144 (2.0%)

mongoose103 (1.5%)

nodejs102 (1.4%)

svelte99 (1.4%)

express91 (1.3%)

stylelint65 (0.9%)

vue64 (0.9%)

lighthouse63 (0.9%)

async61 (0.9%)

Python py

library2,098 (42.4%)

backend2,066 (41.7%)

cli682 (13.8%)

fastapi201 (4.1%)

django139 (2.8%)

testing112 (2.3%)

pytorch102 (2.1%)

ansible100 (2.0%)

async99 (2.0%)

framework98 (2.0%)

http92 (1.9%)

aws72 (1.5%)

aiohttp65 (1.3%)

pydantic57 (1.2%)

openai55 (1.1%)

click51 (1.0%)

flask50 (1.0%)

litellm49 (1.0%)

beets48 (1.0%)

frontend44 (0.9%)

Rust rust

library3,068 (56.1%)

backend1,179 (21.6%)

cli1,119 (20.5%)

testing307 (5.6%)

async220 (4.0%)

http205 (3.8%)

compiler119 (2.2%)

git117 (2.1%)

macros92 (1.7%)

parsing91 (1.7%)

graphql79 (1.4%)

blockchain75 (1.4%)

substrate75 (1.4%)

serde71 (1.3%)

framework62 (1.1%)

sql62 (1.1%)

datafusion57 (1.0%)

cryptography56 (1.0%)

lsp56 (1.0%)

database55 (1.0%)

TypeScript ts

library2,457 (38.8%)

frontend1,750 (27.6%)

backend1,400 (22.1%)

react1,028 (16.2%)

cli587 (9.3%)

angular201 (3.2%)

graphql162 (2.6%)

framework143 (2.3%)

javascript138 (2.2%)

electron130 (2.1%)

fullstack124 (2.0%)

testing121 (1.9%)

vue96 (1.5%)

nextjs82 (1.3%)

github-actions81 (1.3%)

eslint79 (1.2%)

express79 (1.2%)

vscode73 (1.2%)

http70 (1.1%)

mcp69 (1.1%)

无轨迹数据