SWE 任务和轨迹进度看板

最后更新时间:2026-07-05 00:56:56 BJT | 下次刷新:2026-07-05 01:56:56 BJT | 刷新间隔:3600 秒

收集 PR 总数
557,074
1h +1 / 24h -41,702
有效 SWE 总数
52,439
1h +32 / 24h +1,106
整体处理成功率
8.9%
Valid SWE / 已处理 588,932
difficulty_score 均值
5.90
median 5.9,count 52,389

语言进度

语言收集 PR过去 1h过去 24h有效 SWE过去 1h过去 24h已处理处理成功率
Cc29,470+1-3,51110,2690+41132,981
31.1%
C++cpp45,6220-3,5414,0620049,127
8.3%
Gogo126,4420-6,5828,38600123,518
6.8%
Javajava84,8680-5,9684,304+11+5590,730
4.7%
JavaScriptjs36,4090-3,6577,2570040,065
18.1%
Pythonpy98,8830-9,4625,828+17+549108,256
5.4%
Rustrust68,6500-3,9275,5950072,539
7.7%
TypeScriptts66,7300-5,0546,738+4+9171,716
9.4%

运行参数

语言评估模型 (OPENAI)填充模型 (ANTHROPIC)并发数min_source_filesmax_source_files
Cglm-5claude-opus-4-712215
C++glm-5claude-opus-4-78215
Goglm-5claude-opus-4-712210
Javaglm-5claude-opus-4-78210
JavaScriptglm-5claude-opus-4-712210
Pythonglm-5claude-opus-4-712315
Rustglm-5claude-opus-4-78210
TypeScriptglm-5claude-opus-4-712210

失败原因统计

语言已处理有效 SWE失败trivial_prvalidationinfra_errortimeoutworkflow_error其他
C32,98110,26922,71219,4521,1272,34311372
C++49,1274,06245,0658,8056,81030,622159649266
Go123,5188,386115,13238,74124,04849,7421,4611,033108
Java90,7304,30486,42627,08511,03340,9921,1485,0091,599
JavaScript40,0657,25732,80820,8459313,2281150
Python108,2565,828102,42845,40015,54541,907877339120
Rust72,5395,59566,94430,14910,20524,1001,0778461,233
TypeScript71,7166,73864,97822,10013,94326,7601,7756928

trivial_pr:PR 被 LLM 评估为过于简单(如仅修改配置、文档、依赖版本等),不适合作为 SWE 任务。

validation:任务生成后验证失败(NOP agent 未返回 reward=0 或 ORACLE agent 未返回 reward=1)。

infra_error:基础设施错误(Docker 构建失败、网络超时、磁盘空间不足等)。

timeout:处理超时(单个 PR 总超时或 Claude Code session 超时)。

workflow_error:工作流程错误(PR 元数据获取失败、worktree 创建失败、patch 生成失败等)。

fix.patch 复杂度

语言Valid SWE CountAvg fix.patch linesAvg fix.patch hunksAvg fix.patch files
C10,269333.2817.965.82
C++4,062286.0413.745.09
Go8,386212.0112.564.34
Java4,304166.4610.704.26
JavaScript7,25777.116.312.80
Python5,828156.3811.193.94
Rust5,595226.3513.194.11
TypeScript6,738155.559.534.12

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patchtests/instruction.md,由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分,避免中等规模 patch 过早变成 hard。权重为:patch_scope 38%logic_complexity 32%context_breadth 15%test_complexity 10%instruction_complexity 5%

label 阈值:easy <= 4.0medium <= 7.0hard > 7.0

Tags 生成与展示

tags 不是看板现场计算的,而是在 swegen 构建任务时由 LLM 根据 PR 信息生成,并写入 task.toml[metadata].tags

prompt 要求 tags 按三段式生成:编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch,并按语言扩展名过滤代码文件,口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数;Avg fix.patch hunks 统计 @@ hunk 数;Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言easy / medium / hardeasymediumhard
C
897 / 6767 / 2597
8976,7672,597
C++
433 / 2524 / 1100
4332,5241,100
Go
689 / 6041 / 1650
6896,0411,650
Java
470 / 2784 / 1046
4702,7841,046
JavaScript
1096 / 5376 / 784
1,0965,376784
Python
281 / 3687 / 1836
2813,6871,836
Rust
391 / 3312 / 1890
3913,3121,890
TypeScript
618 / 4975 / 1145
6184,9751,145

difficulty_score 概览

语言countminp25medianmeanp75max
C10,2612.44.96.05.997.19.2
C++4,0572.54.96.05.997.29.1
Go8,3802.64.95.85.856.89.1
Java4,3002.84.85.95.917.09.2
JavaScript7,2562.64.45.25.366.29.2
Python5,8042.65.36.36.287.39.1
Rust5,5932.75.26.36.267.49.0
TypeScript6,7382.74.75.65.726.69.2

全局 Top Tags

library24,455 (46.7%)
backend16,227 (31.0%)
cli7,016 (13.4%)
missing-feature3,717 (7.1%)
frontend3,189 (6.1%)
testing2,229 (4.3%)
http1,603 (3.1%)
react1,440 (2.7%)
incomplete-validation1,375 (2.6%)
framework1,255 (2.4%)
missing-implementation1,196 (2.3%)
missing-metadata-propagation954 (1.8%)
missing-fallback865 (1.7%)
kubernetes743 (1.4%)
async689 (1.3%)
wrong-default666 (1.3%)
embedded643 (1.2%)
networking629 (1.2%)
cpp606 (1.2%)
missing-validation573 (1.1%)
missing-functionality454 (0.9%)
missing-configuration425 (0.8%)
typescript402 (0.8%)
type-handling-inconsistency389 (0.7%)
parsing364 (0.7%)
eslint348 (0.7%)
graphql342 (0.7%)
race-condition336 (0.6%)
missing-configuration-option316 (0.6%)
postgresql301 (0.6%)

每语言 Tags 分布

C c

library5,450 (53.1%)
backend2,632 (25.6%)
cli1,174 (11.4%)
missing-feature710 (6.9%)
embedded617 (6.0%)
cpp601 (5.9%)
testing417 (4.1%)
networking409 (4.0%)
framework294 (2.9%)
incomplete-validation288 (2.8%)
missing-implementation284 (2.8%)
http224 (2.2%)
ruby221 (2.2%)
postgresql213 (2.1%)
firmware184 (1.8%)
kernel182 (1.8%)
quic180 (1.8%)
missing-metadata-propagation153 (1.5%)
rust141 (1.4%)
tls137 (1.3%)

C++ cpp

library2,794 (68.8%)
backend741 (18.2%)
testing496 (12.2%)
cli359 (8.8%)
missing-feature268 (6.6%)
framework186 (4.6%)
missing-implementation144 (3.5%)
http129 (3.2%)
incomplete-validation119 (2.9%)
boost114 (2.8%)
async92 (2.3%)
parsing76 (1.9%)
qt65 (1.6%)
serialization55 (1.4%)
compiler54 (1.3%)
geometry51 (1.3%)
missing-fallback50 (1.2%)
networking49 (1.2%)
missing-metadata-propagation48 (1.2%)
formatting45 (1.1%)

Go go

backend4,423 (52.8%)
library2,087 (24.9%)
cli2,027 (24.2%)
missing-feature739 (8.8%)
kubernetes665 (7.9%)
http536 (6.4%)
incomplete-validation251 (3.0%)
testing236 (2.8%)
missing-metadata-propagation207 (2.5%)
missing-fallback179 (2.1%)
missing-implementation179 (2.1%)
docker134 (1.6%)
wrong-default134 (1.6%)
terraform125 (1.5%)
grpc122 (1.5%)
aws121 (1.4%)
missing-validation120 (1.4%)
prometheus115 (1.4%)
networking97 (1.2%)
database90 (1.1%)

Java java

backend2,092 (48.6%)
library1,945 (45.2%)
missing-feature239 (5.6%)
testing222 (5.2%)
spring164 (3.8%)
framework157 (3.7%)
aem147 (3.4%)
http147 (3.4%)
android129 (3.0%)
incomplete-validation101 (2.3%)
missing-metadata-propagation96 (2.2%)
missing-implementation83 (1.9%)
missing-configuration72 (1.7%)
cli71 (1.7%)
json68 (1.6%)
missing-null-check64 (1.5%)
wrong-default63 (1.5%)
maven61 (1.4%)
sling57 (1.3%)
kafka56 (1.3%)

JavaScript js

library3,913 (53.9%)
backend1,239 (17.1%)
frontend1,043 (14.4%)
cli859 (11.8%)
missing-feature496 (6.8%)
react354 (4.9%)
typescript334 (4.6%)
testing297 (4.1%)
eslint263 (3.6%)
incomplete-validation221 (3.0%)
framework200 (2.8%)
http183 (2.5%)
fastify149 (2.1%)
webpack148 (2.0%)
missing-fallback124 (1.7%)
missing-metadata-propagation113 (1.6%)
svelte106 (1.5%)
mongoose104 (1.4%)
nodejs104 (1.4%)
missing-implementation100 (1.4%)

Python py

library2,517 (43.3%)
backend2,377 (40.9%)
cli781 (13.4%)
missing-feature507 (8.7%)
fastapi232 (4.0%)
django170 (2.9%)
missing-implementation147 (2.5%)
pytorch138 (2.4%)
incomplete-validation122 (2.1%)
testing119 (2.0%)
missing-fallback117 (2.0%)
missing-metadata-propagation117 (2.0%)
async108 (1.9%)
framework104 (1.8%)
ansible100 (1.7%)
http99 (1.7%)
aws80 (1.4%)
pydantic71 (1.2%)
aiohttp66 (1.1%)
flask63 (1.1%)

Rust rust

library3,132 (56.0%)
backend1,224 (21.9%)
cli1,138 (20.3%)
missing-feature411 (7.3%)
testing315 (5.6%)
async225 (4.0%)
http211 (3.8%)
missing-implementation162 (2.9%)
incomplete-validation133 (2.4%)
compiler120 (2.1%)
git119 (2.1%)
missing-metadata-propagation97 (1.7%)
macros93 (1.7%)
parsing92 (1.6%)
graphql81 (1.4%)
blockchain80 (1.4%)
substrate77 (1.4%)
serde73 (1.3%)
missing-fallback71 (1.3%)
sql65 (1.2%)

TypeScript ts

library2,617 (38.8%)
frontend1,848 (27.4%)
backend1,499 (22.2%)
react1,076 (16.0%)
cli607 (9.0%)
missing-feature347 (5.1%)
angular204 (3.0%)
graphql164 (2.4%)
framework162 (2.4%)
missing-fallback148 (2.2%)
javascript144 (2.1%)
electron142 (2.1%)
incomplete-validation140 (2.1%)
fullstack133 (2.0%)
testing127 (1.9%)
missing-metadata-propagation123 (1.8%)
wrong-default120 (1.8%)
vue106 (1.6%)
missing-implementation97 (1.4%)
nextjs86 (1.3%)
无轨迹数据