SWE 任务和轨迹进度看板

最后更新时间:2026-06-22 12:00:27 BJT | 下次刷新:2026-06-22 13:00:28 BJT | 刷新间隔:3600 秒

收集 PR 总数
557,067
1h 0 / 24h 0
有效 SWE 总数
49,385
1h +51 / 24h +127
整体处理成功率
10.5%
Valid SWE / 已处理 468,119
difficulty_score 均值
5.89
median 5.8,count 49,328

语言进度

语言收集 PR过去 1h过去 24h有效 SWE过去 1h过去 24h已处理处理成功率
Cc29,469009,6710+829,469
32.8%
C++cpp45,620004,0320019,246
20.9%
Gogo126,439007,925+19+4186,849
9.1%
Javajava84,868004,009+2+576,060
5.3%
JavaScriptjs36,409007,068+5+536,409
19.4%
Pythonpy98,883004,925+11+3595,214
5.2%
Rustrust68,650005,437+6+2368,611
7.9%
TypeScriptts66,729006,318+8+1056,261
11.2%

运行参数

语言评估模型 (OPENAI)填充模型 (ANTHROPIC)并发数min_source_filesmax_source_files
Cgpt-5.4claude-sonnet-4-612215
C++glm-5claude-sonnet-4-68215
GoQwen3.6-35B-A3BQwen3.6-35B-A3B12210
Javaclaude-haiku-4-5-20251001claude-sonnet-4-68210
JavaScriptQwen3.6-35B-A3BQwen3.6-35B-A3B12210
Pythonglm-5claude-sonnet-4-612315
RustQwen3.6-35B-A3BQwen3.6-35B-A3B8210
TypeScriptQwen3.6-35B-A3BQwen3.6-35B-A3B12210

失败原因统计

语言已处理有效 SWE失败trivial_prvalidationinfra_errortimeoutworkflow_error其他
C29,4699,67119,79814,6303555,10819291
C++19,2464,03215,2142,0507314,641156285266
Go86,8497,92578,92421,3857,10947,6701,507729507
Java76,0604,00972,05117,0826,58544,6851,2931,2101,602
JavaScript36,4097,06829,34115,01582614,4335431460
Python95,2144,92590,28925,9745,77958,840931357120
Rust68,6115,43763,17419,0654,52836,9561,2338091,234
TypeScript56,2616,31849,94313,4443,08031,3171,70275611

trivial_pr:PR 被 LLM 评估为过于简单(如仅修改配置、文档、依赖版本等),不适合作为 SWE 任务。

validation:任务生成后验证失败(NOP agent 未返回 reward=0 或 ORACLE agent 未返回 reward=1)。

infra_error:基础设施错误(Docker 构建失败、网络超时、磁盘空间不足等)。

timeout:处理超时(单个 PR 总超时或 Claude Code session 超时)。

workflow_error:工作流程错误(PR 元数据获取失败、worktree 创建失败、patch 生成失败等)。

fix.patch 复杂度

语言Valid SWE CountAvg fix.patch linesAvg fix.patch hunksAvg fix.patch files
C9,671334.5917.935.84
C++4,032287.0313.735.10
Go7,925215.4912.774.38
Java4,009163.4710.504.23
JavaScript7,06877.276.292.79
Python4,925151.9910.943.81
Rust5,437226.4113.164.10
TypeScript6,318158.839.594.14

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patchtests/instruction.md,由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分,避免中等规模 patch 过早变成 hard。权重为:patch_scope 38%logic_complexity 32%context_breadth 15%test_complexity 10%instruction_complexity 5%

label 阈值:easy <= 4.0medium <= 7.0hard > 7.0

Tags 生成与展示

tags 不是看板现场计算的,而是在 swegen 构建任务时由 LLM 根据 PR 信息生成,并写入 task.toml[metadata].tags

prompt 要求 tags 按三段式生成:编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch,并按语言扩展名过滤代码文件,口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数;Avg fix.patch hunks 统计 @@ hunk 数;Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言easy / medium / hardeasymediumhard
C
864 / 6391 / 2406
8646,3912,406
C++
431 / 2501 / 1092
4312,5011,092
Go
618 / 5728 / 1573
6185,7281,573
Java
443 / 2597 / 964
4432,597964
JavaScript
1063 / 5239 / 764
1,0635,239764
Python
266 / 3167 / 1469
2663,1671,469
Rust
380 / 3220 / 1835
3803,2201,835
TypeScript
561 / 4677 / 1079
5614,6771,079

difficulty_score 概览

语言countminp25medianmeanp75max
C9,6612.44.96.05.977.09.2
C++4,0242.54.96.05.997.29.1
Go7,9192.64.95.85.866.89.1
Java4,0042.84.85.95.897.09.2
JavaScript7,0662.64.45.25.366.29.2
Python4,9022.65.26.26.217.39.1
Rust5,4352.75.26.36.267.49.0
TypeScript6,3172.74.75.65.726.69.1

全局 Top Tags

library23,001 (46.6%)
backend15,171 (30.7%)
cli6,686 (13.5%)
frontend3,014 (6.1%)
testing2,149 (4.4%)
http1,526 (3.1%)
react1,377 (2.8%)
framework1,206 (2.4%)
kubernetes693 (1.4%)
async666 (1.3%)
embedded640 (1.3%)
networking610 (1.2%)
cpp589 (1.2%)
typescript373 (0.8%)
parsing354 (0.7%)
eslint339 (0.7%)
graphql330 (0.7%)
postgresql298 (0.6%)
security285 (0.6%)
compiler283 (0.6%)
git281 (0.6%)
database278 (0.6%)
aws259 (0.5%)
json247 (0.5%)
redis233 (0.5%)
api222 (0.4%)
fastapi221 (0.4%)
ruby220 (0.4%)
angular207 (0.4%)
cryptography204 (0.4%)

每语言 Tags 分布

C c

library5,069 (52.4%)
backend2,499 (25.8%)
cli1,115 (11.5%)
embedded614 (6.3%)
cpp586 (6.1%)
testing404 (4.2%)
networking400 (4.1%)
framework286 (3.0%)
postgresql212 (2.2%)
ruby209 (2.2%)
http201 (2.1%)
firmware185 (1.9%)
kernel178 (1.8%)
quic169 (1.7%)
rust140 (1.4%)
bluetooth129 (1.3%)
tls128 (1.3%)
python114 (1.2%)
scheduler111 (1.1%)
cryptography107 (1.1%)

C++ cpp

library2,779 (69.0%)
backend728 (18.1%)
testing488 (12.1%)
cli356 (8.8%)
framework185 (4.6%)
http129 (3.2%)
boost114 (2.8%)
async91 (2.3%)
parsing76 (1.9%)
qt63 (1.6%)
compiler54 (1.3%)
serialization54 (1.3%)
geometry51 (1.3%)
networking49 (1.2%)
formatting45 (1.1%)
ros244 (1.1%)
frontend40 (1.0%)
json40 (1.0%)
logging37 (0.9%)
templates36 (0.9%)

Go go

backend4,160 (52.5%)
library1,971 (24.9%)
cli1,928 (24.3%)
kubernetes634 (8.0%)
http515 (6.5%)
testing220 (2.8%)
docker131 (1.7%)
aws117 (1.5%)
grpc117 (1.5%)
terraform114 (1.4%)
prometheus100 (1.3%)
networking95 (1.2%)
database88 (1.1%)
framework86 (1.1%)
api81 (1.0%)
git76 (1.0%)
security69 (0.9%)
aws-sdk65 (0.8%)
blockchain56 (0.7%)
configuration55 (0.7%)

Java java

backend1,944 (48.5%)
library1,811 (45.2%)
testing209 (5.2%)
spring158 (3.9%)
framework151 (3.8%)
aem147 (3.7%)
http136 (3.4%)
android118 (2.9%)
json67 (1.7%)
cli64 (1.6%)
maven59 (1.5%)
sling57 (1.4%)
kafka53 (1.3%)
flink48 (1.2%)
concurrency47 (1.2%)
grpc47 (1.2%)
frontend46 (1.1%)
mybatis37 (0.9%)
nacos34 (0.8%)
security34 (0.8%)

JavaScript js

library3,807 (53.9%)
backend1,224 (17.3%)
frontend998 (14.1%)
cli843 (11.9%)
react343 (4.9%)
typescript311 (4.4%)
testing291 (4.1%)
eslint260 (3.7%)
framework196 (2.8%)
http179 (2.5%)
fastify146 (2.1%)
webpack144 (2.0%)
mongoose103 (1.5%)
nodejs101 (1.4%)
svelte99 (1.4%)
express91 (1.3%)
stylelint65 (0.9%)
vue64 (0.9%)
lighthouse63 (0.9%)
async61 (0.9%)

Python py

library2,074 (42.3%)
backend2,045 (41.7%)
cli678 (13.8%)
fastapi199 (4.1%)
django137 (2.8%)
testing109 (2.2%)
pytorch101 (2.1%)
ansible100 (2.0%)
async99 (2.0%)
framework98 (2.0%)
http92 (1.9%)
aws72 (1.5%)
aiohttp65 (1.3%)
pydantic57 (1.2%)
openai55 (1.1%)
click51 (1.0%)
litellm49 (1.0%)
beets48 (1.0%)
flask48 (1.0%)
frontend44 (0.9%)

Rust rust

library3,047 (56.1%)
backend1,172 (21.6%)
cli1,116 (20.5%)
testing307 (5.6%)
async219 (4.0%)
http204 (3.8%)
compiler119 (2.2%)
git117 (2.2%)
macros92 (1.7%)
parsing91 (1.7%)
graphql79 (1.5%)
blockchain75 (1.4%)
substrate75 (1.4%)
serde71 (1.3%)
framework62 (1.1%)
sql62 (1.1%)
datafusion57 (1.0%)
cryptography56 (1.0%)
lsp55 (1.0%)
database54 (1.0%)

TypeScript ts

library2,443 (38.7%)
frontend1,745 (27.6%)
backend1,399 (22.1%)
react1,026 (16.2%)
cli586 (9.3%)
angular201 (3.2%)
graphql161 (2.5%)
framework142 (2.2%)
javascript138 (2.2%)
electron130 (2.1%)
fullstack124 (2.0%)
testing121 (1.9%)
vue96 (1.5%)
nextjs82 (1.3%)
github-actions81 (1.3%)
eslint79 (1.3%)
express79 (1.3%)
vscode72 (1.1%)
http70 (1.1%)
mcp69 (1.1%)
无轨迹数据