SWE 任务和轨迹进度看板

收集 PR 总数

557,067

1h 0 / 24h 0

有效 SWE 总数

49,494

1h +65 / 24h +236

整体处理成功率

10.5%

Valid SWE / 已处理 469,153

difficulty_score 均值

5.89

median 5.8，count 49,437

语言进度

语言	收集 PR	有效 SWE	过去 1h	过去 24h	已处理	处理成功率
Cc	29,469	9,677	+4	+14	29,469	32.8%
C++cpp	45,620	4,032	0	0	19,373	20.8%
Gogo	126,439	7,963	+24	+79	86,949	9.2%
Javajava	84,868	4,011	+2	+7	76,409	5.2%
JavaScriptjs	36,409	7,079	+6	+16	36,409	19.4%
Pythonpy	98,883	4,950	+13	+60	95,634	5.2%
Rustrust	68,650	5,453	+10	+39	68,611	7.9%
TypeScriptts	66,729	6,329	+6	+21	56,299	11.2%

运行参数

语言	评估模型 (OPENAI)	填充模型 (ANTHROPIC)	并发数	min_source_files	max_source_files
C	`gpt-5.4`	`claude-sonnet-4-6`	12	2	15
C++	`glm-5`	`claude-sonnet-4-6`	8	2	15
Go	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	12	2	10
Java	`claude-haiku-4-5-20251001`	`claude-sonnet-4-6`	8	2	10
JavaScript	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	12	2	10
Python	`glm-5`	`claude-sonnet-4-6`	12	3	15
Rust	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	8	2	10
TypeScript	`Qwen3.6-35B-A3B`	`Qwen3.6-35B-A3B`	12	2	10

失败原因统计

语言	已处理	有效 SWE	失败	trivial_pr	validation	infra_error	timeout	workflow_error	其他
C	29,469	9,677	19,792	14,632	360	5,093	21	29	1
C++	19,373	4,032	15,341	2,051	73	14,767	156	285	266
Go	86,949	7,963	78,986	21,435	7,119	47,667	1,512	730	506
Java	76,409	4,011	72,398	17,212	6,585	44,701	1,293	1,412	1,602
JavaScript	36,409	7,079	29,330	15,019	824	14,419	546	144	0
Python	95,634	4,950	90,684	26,063	5,786	59,134	936	357	120
Rust	68,611	5,453	63,158	19,079	4,524	36,924	1,238	811	1,234
TypeScript	56,299	6,329	49,970	13,466	3,081	31,310	1,713	756	11

trivial_pr：PR 被 LLM 评估为过于简单（如仅修改配置、文档、依赖版本等），不适合作为 SWE 任务。

validation：任务生成后验证失败（NOP agent 未返回 reward=0 或 ORACLE agent 未返回 reward=1）。

infra_error：基础设施错误（Docker 构建失败、网络超时、磁盘空间不足等）。

timeout：处理超时（单个 PR 总超时或 Claude Code session 超时）。

workflow_error：工作流程错误（PR 元数据获取失败、worktree 创建失败、patch 生成失败等）。

fix.patch 复杂度

语言	Valid SWE Count	Avg fix.patch lines	Avg fix.patch hunks	Avg fix.patch files
C	9,677	334.47	17.92	5.84
C++	4,032	287.03	13.73	5.10
Go	7,963	214.97	12.75	4.37
Java	4,011	163.43	10.50	4.23
JavaScript	7,079	77.26	6.29	2.79
Python	4,950	151.71	10.93	3.81
Rust	5,453	226.26	13.16	4.10
TypeScript	6,329	158.77	9.60	4.14

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patch、tests/ 和 instruction.md，由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分，避免中等规模 patch 过早变成 hard。权重为：patch_scope 38%、logic_complexity 32%、context_breadth 15%、test_complexity 10%、instruction_complexity 5%。

label 阈值：easy <= 4.0，medium <= 7.0，hard > 7.0。

Tags 生成与展示

tags 不是看板现场计算的，而是在 swegen 构建任务时由 LLM 根据 PR 信息生成，并写入 task.toml 的 [metadata].tags。

prompt 要求 tags 按三段式生成：编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch，并按语言扩展名过滤代码文件，口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数；Avg fix.patch hunks 统计 @@ hunk 数；Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言	easy / medium / hard	easy	medium	hard
C	865 / 6394 / 2408	865	6,394	2,408
C++	431 / 2501 / 1092	431	2,501	1,092
Go	620 / 5754 / 1583	620	5,754	1,583
Java	443 / 2599 / 964	443	2,599	964
JavaScript	1064 / 5248 / 765	1,064	5,248	765
Python	267 / 3183 / 1477	267	3,183	1,477
Rust	380 / 3231 / 1840	380	3,231	1,840
TypeScript	562 / 4685 / 1081	562	4,685	1,081

difficulty_score 概览

语言	count	min	p25	median	mean	p75	max
C	9,667	2.4	4.9	6.0	5.97	7.0	9.2
C++	4,024	2.5	4.9	6.0	5.99	7.2	9.1
Go	7,957	2.6	4.9	5.8	5.87	6.8	9.1
Java	4,006	2.8	4.8	5.9	5.89	7.0	9.2
JavaScript	7,077	2.6	4.4	5.2	5.36	6.2	9.2
Python	4,927	2.6	5.2	6.2	6.21	7.3	9.1
Rust	5,451	2.7	5.2	6.3	6.26	7.4	9.0
TypeScript	6,328	2.7	4.7	5.6	5.72	6.6	9.1

全局 Top Tags

library23,060 (46.6%)

backend15,204 (30.7%)

cli6,700 (13.5%)

frontend3,018 (6.1%)

testing2,154 (4.4%)

http1,526 (3.1%)

react1,380 (2.8%)

framework1,206 (2.4%)

kubernetes695 (1.4%)

async667 (1.3%)

embedded640 (1.3%)

networking611 (1.2%)

cpp590 (1.2%)

typescript374 (0.8%)

parsing356 (0.7%)

eslint339 (0.7%)

graphql331 (0.7%)

postgresql298 (0.6%)

security285 (0.6%)

compiler283 (0.6%)

git281 (0.6%)

database278 (0.6%)

aws259 (0.5%)

json247 (0.5%)

redis235 (0.5%)

api223 (0.5%)

fastapi221 (0.4%)

ruby220 (0.4%)

angular207 (0.4%)

cryptography205 (0.4%)

每语言 Tags 分布

C c

library5,073 (52.4%)

backend2,501 (25.8%)

cli1,115 (11.5%)

embedded614 (6.3%)

cpp587 (6.1%)

testing406 (4.2%)

networking400 (4.1%)

framework286 (3.0%)

postgresql212 (2.2%)

ruby209 (2.2%)

http201 (2.1%)

firmware185 (1.9%)

kernel178 (1.8%)

quic169 (1.7%)

rust140 (1.4%)

bluetooth129 (1.3%)

tls128 (1.3%)

python114 (1.2%)

scheduler111 (1.1%)

cryptography107 (1.1%)

C++ cpp

library2,779 (69.0%)

backend728 (18.1%)

testing488 (12.1%)

cli356 (8.8%)

framework185 (4.6%)

http129 (3.2%)

boost114 (2.8%)

async91 (2.3%)

parsing76 (1.9%)

qt63 (1.6%)

compiler54 (1.3%)

serialization54 (1.3%)

geometry51 (1.3%)

networking49 (1.2%)

formatting45 (1.1%)

ros244 (1.1%)

frontend40 (1.0%)

json40 (1.0%)

logging37 (0.9%)

templates36 (0.9%)

Go go

backend4,178 (52.5%)

library1,987 (25.0%)

cli1,934 (24.3%)

kubernetes636 (8.0%)

http515 (6.5%)

testing220 (2.8%)

docker132 (1.7%)

aws117 (1.5%)

grpc117 (1.5%)

terraform116 (1.5%)

prometheus100 (1.3%)

networking96 (1.2%)

database88 (1.1%)

framework86 (1.1%)

api81 (1.0%)

git76 (1.0%)

security69 (0.9%)

aws-sdk65 (0.8%)

blockchain56 (0.7%)

configuration55 (0.7%)

Java java

backend1,945 (48.5%)

library1,812 (45.2%)

testing210 (5.2%)

spring158 (3.9%)

framework151 (3.8%)

aem147 (3.7%)

http136 (3.4%)

android118 (2.9%)

json67 (1.7%)

cli64 (1.6%)

maven59 (1.5%)

sling57 (1.4%)

kafka53 (1.3%)

flink48 (1.2%)

concurrency47 (1.2%)

grpc47 (1.2%)

frontend46 (1.1%)

mybatis37 (0.9%)

nacos34 (0.8%)

security34 (0.8%)

JavaScript js

library3,812 (53.9%)

backend1,224 (17.3%)

frontend999 (14.1%)

cli848 (12.0%)

react344 (4.9%)

typescript311 (4.4%)

testing292 (4.1%)

eslint260 (3.7%)

framework196 (2.8%)

http179 (2.5%)

fastify146 (2.1%)

webpack144 (2.0%)

mongoose103 (1.5%)

nodejs101 (1.4%)

svelte99 (1.4%)

express91 (1.3%)

stylelint65 (0.9%)

vue64 (0.9%)

lighthouse63 (0.9%)

async61 (0.9%)

Python py

library2,088 (42.4%)

backend2,055 (41.7%)

cli678 (13.8%)

fastapi199 (4.0%)

django139 (2.8%)

testing110 (2.2%)

pytorch102 (2.1%)

ansible100 (2.0%)

async99 (2.0%)

framework98 (2.0%)

http92 (1.9%)

aws72 (1.5%)

aiohttp65 (1.3%)

pydantic57 (1.2%)

openai55 (1.1%)

click51 (1.0%)

flask49 (1.0%)

litellm49 (1.0%)

beets48 (1.0%)

frontend44 (0.9%)

Rust rust

library3,059 (56.1%)

backend1,174 (21.5%)

cli1,118 (20.5%)

testing307 (5.6%)

async219 (4.0%)

http204 (3.7%)

compiler119 (2.2%)

git117 (2.1%)

macros92 (1.7%)

parsing91 (1.7%)

graphql79 (1.4%)

blockchain75 (1.4%)

substrate75 (1.4%)

serde71 (1.3%)

framework62 (1.1%)

sql62 (1.1%)

datafusion57 (1.0%)

cryptography56 (1.0%)

lsp56 (1.0%)

database54 (1.0%)

TypeScript ts

library2,450 (38.7%)

frontend1,748 (27.6%)

backend1,399 (22.1%)

react1,028 (16.2%)

cli587 (9.3%)

angular201 (3.2%)

graphql161 (2.5%)

framework142 (2.2%)

javascript138 (2.2%)

electron130 (2.1%)

fullstack124 (2.0%)

testing121 (1.9%)

vue96 (1.5%)

nextjs82 (1.3%)

github-actions81 (1.3%)

eslint79 (1.2%)

express79 (1.2%)

vscode72 (1.1%)

http70 (1.1%)

mcp69 (1.1%)

无轨迹数据