SWE 任务和轨迹进度看板

最后更新时间:2026-07-04 11:49:57 BJT | 下次刷新:2026-07-04 12:49:58 BJT | 刷新间隔:3600 秒

收集 PR 总数
557,069
1h 0 / 24h -41,702
有效 SWE 总数
52,082
1h +66 / 24h +1,171
整体处理成功率
8.8%
Valid SWE / 已处理 588,932
difficulty_score 均值
5.89
median 5.9,count 52,032

语言进度

语言收集 PR过去 1h过去 24h有效 SWE过去 1h过去 24h已处理处理成功率
Cc29,4690-3,51210,267+33+55132,981
31.1%
C++cpp45,6200-3,5434,0620049,127
8.3%
Gogo126,4400-6,5828,3860+5123,518
6.8%
Javajava84,8680-5,9684,268+2+11090,730
4.7%
JavaScriptjs36,4090-3,6567,2570040,065
18.1%
Pythonpy98,8830-9,4625,555+27+436108,256
5.1%
Rustrust68,6500-3,9275,5950072,539
7.7%
TypeScriptts66,7300-5,0526,692+4+6971,716
9.3%

运行参数

语言评估模型 (OPENAI)填充模型 (ANTHROPIC)并发数min_source_filesmax_source_files
Cglm-5claude-opus-4-712215
C++glm-5claude-opus-4-78215
Goglm-5claude-opus-4-712210
Javaglm-5claude-opus-4-78210
JavaScriptglm-5claude-opus-4-712210
Pythonglm-5claude-opus-4-712315
Rustglm-5claude-opus-4-78210
TypeScriptglm-5claude-opus-4-712210

失败原因统计

语言已处理有效 SWE失败trivial_prvalidationinfra_errortimeoutworkflow_error其他
C32,98110,26722,71419,4521,1302,34310372
C++49,1274,06245,0658,7836,81030,631159662266
Go123,5188,386115,13238,74124,04849,7421,4611,033108
Java90,7304,26886,46227,01811,01841,1521,1025,0091,599
JavaScript40,0657,25732,80820,7469313,3271150
Python108,2565,555102,70144,98915,52142,639844339120
Rust72,5395,59566,94430,14910,20524,1001,0778461,233
TypeScript71,7166,69265,02422,08913,94126,8081,7717078

trivial_pr:PR 被 LLM 评估为过于简单(如仅修改配置、文档、依赖版本等),不适合作为 SWE 任务。

validation:任务生成后验证失败(NOP agent 未返回 reward=0 或 ORACLE agent 未返回 reward=1)。

infra_error:基础设施错误(Docker 构建失败、网络超时、磁盘空间不足等)。

timeout:处理超时(单个 PR 总超时或 Claude Code session 超时)。

workflow_error:工作流程错误(PR 元数据获取失败、worktree 创建失败、patch 生成失败等)。

fix.patch 复杂度

语言Valid SWE CountAvg fix.patch linesAvg fix.patch hunksAvg fix.patch files
C10,267332.7817.905.82
C++4,062286.0413.745.09
Go8,386212.0112.564.34
Java4,268166.6710.704.26
JavaScript7,25777.116.312.80
Python5,555154.8411.183.92
Rust5,595226.3513.194.11
TypeScript6,692155.269.524.10

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patchtests/instruction.md,由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分,避免中等规模 patch 过早变成 hard。权重为:patch_scope 38%logic_complexity 32%context_breadth 15%test_complexity 10%instruction_complexity 5%

label 阈值:easy <= 4.0medium <= 7.0hard > 7.0

Tags 生成与展示

tags 不是看板现场计算的,而是在 swegen 构建任务时由 LLM 根据 PR 信息生成,并写入 task.toml[metadata].tags

prompt 要求 tags 按三段式生成:编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch,并按语言扩展名过滤代码文件,口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数;Avg fix.patch hunks 统计 @@ hunk 数;Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言easy / medium / hardeasymediumhard
C
896 / 6767 / 2596
8966,7672,596
C++
433 / 2524 / 1100
4332,5241,100
Go
689 / 6041 / 1650
6896,0411,650
Java
469 / 2759 / 1036
4692,7591,036
JavaScript
1096 / 5376 / 784
1,0965,376784
Python
278 / 3538 / 1715
2783,5381,715
Rust
391 / 3312 / 1890
3913,3121,890
TypeScript
617 / 4936 / 1139
6174,9361,139

difficulty_score 概览

语言countminp25medianmeanp75max
C10,2592.44.96.05.997.19.2
C++4,0572.54.96.05.997.29.1
Go8,3802.64.95.85.856.89.1
Java4,2642.84.85.95.907.09.2
JavaScript7,2562.64.45.25.366.29.2
Python5,5312.65.26.36.257.39.1
Rust5,5932.75.26.36.267.49.0
TypeScript6,6922.74.75.65.726.69.2

全局 Top Tags

library24,270 (46.6%)
backend16,111 (31.0%)
cli6,981 (13.4%)
missing-feature3,670 (7.1%)
frontend3,176 (6.1%)
testing2,226 (4.3%)
http1,601 (3.1%)
react1,434 (2.8%)
incomplete-validation1,370 (2.6%)
framework1,250 (2.4%)
missing-implementation1,195 (2.3%)
missing-metadata-propagation949 (1.8%)
missing-fallback863 (1.7%)
kubernetes742 (1.4%)
async684 (1.3%)
wrong-default666 (1.3%)
embedded643 (1.2%)
networking629 (1.2%)
cpp604 (1.2%)
missing-validation571 (1.1%)
missing-functionality454 (0.9%)
missing-configuration424 (0.8%)
typescript401 (0.8%)
type-handling-inconsistency387 (0.7%)
parsing364 (0.7%)
eslint345 (0.7%)
graphql340 (0.7%)
race-condition336 (0.6%)
missing-configuration-option309 (0.6%)
postgresql301 (0.6%)

每语言 Tags 分布

C c

library5,448 (53.1%)
backend2,632 (25.6%)
cli1,174 (11.4%)
missing-feature709 (6.9%)
embedded617 (6.0%)
cpp601 (5.9%)
testing417 (4.1%)
networking409 (4.0%)
framework294 (2.9%)
incomplete-validation288 (2.8%)
missing-implementation284 (2.8%)
http224 (2.2%)
ruby221 (2.2%)
postgresql213 (2.1%)
firmware184 (1.8%)
kernel182 (1.8%)
quic180 (1.8%)
missing-metadata-propagation153 (1.5%)
rust141 (1.4%)
tls137 (1.3%)

C++ cpp

library2,794 (68.8%)
backend741 (18.2%)
testing496 (12.2%)
cli359 (8.8%)
missing-feature268 (6.6%)
framework186 (4.6%)
missing-implementation144 (3.5%)
http129 (3.2%)
incomplete-validation119 (2.9%)
boost114 (2.8%)
async92 (2.3%)
parsing76 (1.9%)
qt65 (1.6%)
serialization55 (1.4%)
compiler54 (1.3%)
geometry51 (1.3%)
missing-fallback50 (1.2%)
networking49 (1.2%)
missing-metadata-propagation48 (1.2%)
formatting45 (1.1%)

Go go

backend4,423 (52.8%)
library2,087 (24.9%)
cli2,027 (24.2%)
missing-feature739 (8.8%)
kubernetes665 (7.9%)
http536 (6.4%)
incomplete-validation251 (3.0%)
testing236 (2.8%)
missing-metadata-propagation207 (2.5%)
missing-fallback179 (2.1%)
missing-implementation179 (2.1%)
docker134 (1.6%)
wrong-default134 (1.6%)
terraform125 (1.5%)
grpc122 (1.5%)
aws121 (1.4%)
missing-validation120 (1.4%)
prometheus115 (1.4%)
networking97 (1.2%)
database90 (1.1%)

Java java

backend2,075 (48.7%)
library1,928 (45.2%)
missing-feature237 (5.6%)
testing222 (5.2%)
spring162 (3.8%)
framework156 (3.7%)
aem147 (3.4%)
http147 (3.4%)
android127 (3.0%)
incomplete-validation101 (2.4%)
missing-metadata-propagation96 (2.3%)
missing-implementation83 (1.9%)
missing-configuration72 (1.7%)
cli70 (1.6%)
json68 (1.6%)
missing-null-check64 (1.5%)
wrong-default63 (1.5%)
maven61 (1.4%)
sling57 (1.3%)
kafka56 (1.3%)

JavaScript js

library3,913 (53.9%)
backend1,239 (17.1%)
frontend1,043 (14.4%)
cli859 (11.8%)
missing-feature496 (6.8%)
react354 (4.9%)
typescript334 (4.6%)
testing297 (4.1%)
eslint263 (3.6%)
incomplete-validation221 (3.0%)
framework200 (2.8%)
http183 (2.5%)
fastify149 (2.1%)
webpack148 (2.0%)
missing-fallback124 (1.7%)
missing-metadata-propagation113 (1.6%)
svelte106 (1.5%)
mongoose104 (1.4%)
nodejs104 (1.4%)
missing-implementation100 (1.4%)

Python py

library2,373 (42.9%)
backend2,285 (41.3%)
cli751 (13.6%)
missing-feature465 (8.4%)
fastapi223 (4.0%)
django162 (2.9%)
missing-implementation146 (2.6%)
pytorch125 (2.3%)
incomplete-validation118 (2.1%)
testing116 (2.1%)
missing-fallback115 (2.1%)
missing-metadata-propagation113 (2.0%)
async103 (1.9%)
framework103 (1.9%)
ansible100 (1.8%)
http97 (1.8%)
aws77 (1.4%)
pydantic68 (1.2%)
aiohttp66 (1.2%)
missing-parameter63 (1.1%)

Rust rust

library3,132 (56.0%)
backend1,224 (21.9%)
cli1,138 (20.3%)
missing-feature411 (7.3%)
testing315 (5.6%)
async225 (4.0%)
http211 (3.8%)
missing-implementation162 (2.9%)
incomplete-validation133 (2.4%)
compiler120 (2.1%)
git119 (2.1%)
missing-metadata-propagation97 (1.7%)
macros93 (1.7%)
parsing92 (1.6%)
graphql81 (1.4%)
blockchain80 (1.4%)
substrate77 (1.4%)
serde73 (1.3%)
missing-fallback71 (1.3%)
sql65 (1.2%)

TypeScript ts

library2,595 (38.8%)
frontend1,839 (27.5%)
backend1,492 (22.3%)
react1,071 (16.0%)
cli603 (9.0%)
missing-feature345 (5.2%)
angular204 (3.0%)
graphql164 (2.5%)
framework159 (2.4%)
missing-fallback148 (2.2%)
javascript144 (2.2%)
electron141 (2.1%)
incomplete-validation139 (2.1%)
fullstack131 (2.0%)
testing127 (1.9%)
missing-metadata-propagation122 (1.8%)
wrong-default120 (1.8%)
vue105 (1.6%)
missing-implementation97 (1.4%)
nextjs86 (1.3%)
无轨迹数据