SWE 任务和轨迹进度看板

最后更新时间:2026-07-04 13:51:00 BJT | 下次刷新:2026-07-04 14:51:01 BJT | 刷新间隔:3600 秒

收集 PR 总数
557,070
1h +1 / 24h -41,703
有效 SWE 总数
52,143
1h +26 / 24h +1,229
整体处理成功率
8.9%
Valid SWE / 已处理 588,932
difficulty_score 均值
5.89
median 5.9,count 52,093

语言进度

语言收集 PR过去 1h过去 24h有效 SWE过去 1h过去 24h已处理处理成功率
Cc29,4690-3,51210,2690+55332,981
31.1%
C++cpp45,6200-3,5434,0620049,127
8.3%
Gogo126,441+1-6,5828,3860+2123,518
6.8%
Javajava84,8680-5,9684,272+2+11490,730
4.7%
JavaScriptjs36,4090-3,6567,2570040,065
18.1%
Pythonpy98,8830-9,4625,605+21+486108,256
5.2%
Rustrust68,6500-3,9275,5950072,539
7.7%
TypeScriptts66,7300-5,0536,697+3+7471,716
9.3%

运行参数

语言评估模型 (OPENAI)填充模型 (ANTHROPIC)并发数min_source_filesmax_source_files
Cglm-5claude-opus-4-712215
C++glm-5claude-opus-4-78215
Goglm-5claude-opus-4-712210
Javaglm-5claude-opus-4-78210
JavaScriptglm-5claude-opus-4-712210
Pythonglm-5claude-opus-4-712315
Rustglm-5claude-opus-4-78210
TypeScriptglm-5claude-opus-4-712210

失败原因统计

语言已处理有效 SWE失败trivial_prvalidationinfra_errortimeoutworkflow_error其他
C32,98110,26922,71219,4521,1272,34311372
C++49,1274,06245,0658,7886,81030,628159660266
Go123,5188,386115,13238,74124,04849,7421,4611,033108
Java90,7304,27286,45827,02811,02041,1301,1085,0091,599
JavaScript40,0657,25732,80820,7639313,3101150
Python108,2565,605102,65145,06015,52342,512850339120
Rust72,5395,59566,94430,14910,20524,1001,0778461,233
TypeScript71,7166,69765,01922,09313,94126,8011,7727048

trivial_pr:PR 被 LLM 评估为过于简单(如仅修改配置、文档、依赖版本等),不适合作为 SWE 任务。

validation:任务生成后验证失败(NOP agent 未返回 reward=0 或 ORACLE agent 未返回 reward=1)。

infra_error:基础设施错误(Docker 构建失败、网络超时、磁盘空间不足等)。

timeout:处理超时(单个 PR 总超时或 Claude Code session 超时)。

workflow_error:工作流程错误(PR 元数据获取失败、worktree 创建失败、patch 生成失败等)。

fix.patch 复杂度

语言Valid SWE CountAvg fix.patch linesAvg fix.patch hunksAvg fix.patch files
C10,269333.2817.965.82
C++4,062286.0413.745.09
Go8,386212.0112.564.34
Java4,272166.6410.704.26
JavaScript7,25777.116.312.80
Python5,605154.5811.173.93
Rust5,595226.3513.194.11
TypeScript6,697155.179.524.10

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patchtests/instruction.md,由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分,避免中等规模 patch 过早变成 hard。权重为:patch_scope 38%logic_complexity 32%context_breadth 15%test_complexity 10%instruction_complexity 5%

label 阈值:easy <= 4.0medium <= 7.0hard > 7.0

Tags 生成与展示

tags 不是看板现场计算的,而是在 swegen 构建任务时由 LLM 根据 PR 信息生成,并写入 task.toml[metadata].tags

prompt 要求 tags 按三段式生成:编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch,并按语言扩展名过滤代码文件,口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数;Avg fix.patch hunks 统计 @@ hunk 数;Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言easy / medium / hardeasymediumhard
C
897 / 6767 / 2597
8976,7672,597
C++
433 / 2524 / 1100
4332,5241,100
Go
689 / 6041 / 1650
6896,0411,650
Java
469 / 2761 / 1038
4692,7611,038
JavaScript
1096 / 5376 / 784
1,0965,376784
Python
278 / 3570 / 1733
2783,5701,733
Rust
391 / 3312 / 1890
3913,3121,890
TypeScript
617 / 4941 / 1139
6174,9411,139

difficulty_score 概览

语言countminp25medianmeanp75max
C10,2612.44.96.05.997.19.2
C++4,0572.54.96.05.997.29.1
Go8,3802.64.95.85.856.89.1
Java4,2682.84.85.95.907.09.2
JavaScript7,2562.64.45.25.366.29.2
Python5,5812.65.36.36.267.39.1
Rust5,5932.75.26.36.267.49.0
TypeScript6,6972.74.75.65.726.69.2

全局 Top Tags

library24,304 (46.6%)
backend16,130 (31.0%)
cli6,987 (13.4%)
missing-feature3,685 (7.1%)
frontend3,178 (6.1%)
testing2,228 (4.3%)
http1,601 (3.1%)
react1,435 (2.8%)
incomplete-validation1,371 (2.6%)
framework1,251 (2.4%)
missing-implementation1,195 (2.3%)
missing-metadata-propagation950 (1.8%)
missing-fallback863 (1.7%)
kubernetes742 (1.4%)
async685 (1.3%)
wrong-default666 (1.3%)
embedded643 (1.2%)
networking629 (1.2%)
cpp605 (1.2%)
missing-validation571 (1.1%)
missing-functionality454 (0.9%)
missing-configuration425 (0.8%)
typescript401 (0.8%)
type-handling-inconsistency387 (0.7%)
parsing364 (0.7%)
eslint346 (0.7%)
graphql341 (0.7%)
race-condition336 (0.6%)
missing-configuration-option309 (0.6%)
postgresql301 (0.6%)

每语言 Tags 分布

C c

library5,450 (53.1%)
backend2,632 (25.6%)
cli1,174 (11.4%)
missing-feature710 (6.9%)
embedded617 (6.0%)
cpp601 (5.9%)
testing417 (4.1%)
networking409 (4.0%)
framework294 (2.9%)
incomplete-validation288 (2.8%)
missing-implementation284 (2.8%)
http224 (2.2%)
ruby221 (2.2%)
postgresql213 (2.1%)
firmware184 (1.8%)
kernel182 (1.8%)
quic180 (1.8%)
missing-metadata-propagation153 (1.5%)
rust141 (1.4%)
tls137 (1.3%)

C++ cpp

library2,794 (68.8%)
backend741 (18.2%)
testing496 (12.2%)
cli359 (8.8%)
missing-feature268 (6.6%)
framework186 (4.6%)
missing-implementation144 (3.5%)
http129 (3.2%)
incomplete-validation119 (2.9%)
boost114 (2.8%)
async92 (2.3%)
parsing76 (1.9%)
qt65 (1.6%)
serialization55 (1.4%)
compiler54 (1.3%)
geometry51 (1.3%)
missing-fallback50 (1.2%)
networking49 (1.2%)
missing-metadata-propagation48 (1.2%)
formatting45 (1.1%)

Go go

backend4,423 (52.8%)
library2,087 (24.9%)
cli2,027 (24.2%)
missing-feature739 (8.8%)
kubernetes665 (7.9%)
http536 (6.4%)
incomplete-validation251 (3.0%)
testing236 (2.8%)
missing-metadata-propagation207 (2.5%)
missing-fallback179 (2.1%)
missing-implementation179 (2.1%)
docker134 (1.6%)
wrong-default134 (1.6%)
terraform125 (1.5%)
grpc122 (1.5%)
aws121 (1.4%)
missing-validation120 (1.4%)
prometheus115 (1.4%)
networking97 (1.2%)
database90 (1.1%)

Java java

backend2,077 (48.7%)
library1,930 (45.2%)
missing-feature238 (5.6%)
testing222 (5.2%)
spring163 (3.8%)
framework156 (3.7%)
aem147 (3.4%)
http147 (3.4%)
android128 (3.0%)
incomplete-validation101 (2.4%)
missing-metadata-propagation96 (2.2%)
missing-implementation83 (1.9%)
missing-configuration72 (1.7%)
cli70 (1.6%)
json68 (1.6%)
missing-null-check64 (1.5%)
wrong-default63 (1.5%)
maven61 (1.4%)
sling57 (1.3%)
kafka56 (1.3%)

JavaScript js

library3,913 (53.9%)
backend1,239 (17.1%)
frontend1,043 (14.4%)
cli859 (11.8%)
missing-feature496 (6.8%)
react354 (4.9%)
typescript334 (4.6%)
testing297 (4.1%)
eslint263 (3.6%)
incomplete-validation221 (3.0%)
framework200 (2.8%)
http183 (2.5%)
fastify149 (2.1%)
webpack148 (2.0%)
missing-fallback124 (1.7%)
missing-metadata-propagation113 (1.6%)
svelte106 (1.5%)
mongoose104 (1.4%)
nodejs104 (1.4%)
missing-implementation100 (1.4%)

Python py

library2,401 (43.0%)
backend2,302 (41.2%)
cli755 (13.5%)
missing-feature477 (8.5%)
fastapi223 (4.0%)
django164 (2.9%)
missing-implementation146 (2.6%)
pytorch128 (2.3%)
incomplete-validation118 (2.1%)
testing118 (2.1%)
missing-fallback115 (2.1%)
missing-metadata-propagation114 (2.0%)
async104 (1.9%)
framework103 (1.8%)
ansible100 (1.8%)
http97 (1.7%)
aws77 (1.4%)
pydantic69 (1.2%)
aiohttp66 (1.2%)
missing-parameter63 (1.1%)

Rust rust

library3,132 (56.0%)
backend1,224 (21.9%)
cli1,138 (20.3%)
missing-feature411 (7.3%)
testing315 (5.6%)
async225 (4.0%)
http211 (3.8%)
missing-implementation162 (2.9%)
incomplete-validation133 (2.4%)
compiler120 (2.1%)
git119 (2.1%)
missing-metadata-propagation97 (1.7%)
macros93 (1.7%)
parsing92 (1.6%)
graphql81 (1.4%)
blockchain80 (1.4%)
substrate77 (1.4%)
serde73 (1.3%)
missing-fallback71 (1.3%)
sql65 (1.2%)

TypeScript ts

library2,597 (38.8%)
frontend1,840 (27.5%)
backend1,492 (22.3%)
react1,072 (16.0%)
cli605 (9.0%)
missing-feature346 (5.2%)
angular204 (3.0%)
graphql164 (2.4%)
framework160 (2.4%)
missing-fallback148 (2.2%)
javascript144 (2.2%)
electron141 (2.1%)
incomplete-validation140 (2.1%)
fullstack131 (2.0%)
testing127 (1.9%)
missing-metadata-propagation122 (1.8%)
wrong-default120 (1.8%)
vue105 (1.6%)
missing-implementation97 (1.4%)
nextjs86 (1.3%)
无轨迹数据