Skip to content

Aggregate · proof, quantified

Stats

Aggregate stats across every published reproduction. Spend figures cover the 215 reproductions with measured cost; counts cover all 244.

244
Published
215 /244
With measured cost
$3.62
Median spend
$1768.97
Total spent
Min
$0.04
P90
$19.07
Max
$75.87

Cost distribution

215 reproductions with measured cost, bucketed by total spend.

<$0.10
1
$0.10–$0.50
22
$0.50–$1.00
12
$1.00–$2.00
32
$2.00–$5.00
60
≥$5.00
88

Spend by agent and model

Total dollars charged to each agent, split by LLM. The sum may exceed the measured-cost total because each reproduction's spend is fully attributed.

repro
$1211.29
vuln_variant
$446.76
judge
$57.09
support
$24.51
coding
$23.93
hypothesis_generator
$1.69
discovery
$1.51
claim_matcher
$1.47
learning_policy
$0.73
accounts/fireworks/models/glm-5p2
accounts/fireworks/models/glm-5p3
accounts/fireworks/models/kimi-k2p5
accounts/fireworks/models/kimi-k2p6
accounts/fireworks/models/kimi-k2p7-code
accounts/fireworks/models/kimi-k3
accounts/fireworks/routers/glm-5p2-fast
claude-opus-4-7
gpt-5.1-codex
gpt-5.2-codex
gpt-5.4-mini
gpt-5.4-mini-2026-03-17
gpt-5.5
gpt-5.5-2026-04-23
gpt-5.6-sol

By ecosystem

Count, median cost, and median duration per package ecosystem.

Ecosystem Count Median cost Median duration Share
github 64 $6.23 40m 47s
npm 33 $0.91 16m 1s
pip 28 $2.45 17m 47s
composer 11 $0.55 13m 7s
go 10 $1.77 23m 47s
c 7 $1.33 29m 29s
maven 6 $7.61 43m 30s
PyPI 4 $10.00 38m 36s
generic 3 $1.64 21m 31s
source 3 $1.68 16m 28s
Composer 2 $12.42 61m 3s
Go 2 $14.78 26m 51s
Maven 2 $15.34 45m 9s
firmware 2 $18.88 61m 51s
linux 2 $6.90 67m 57s
other 2 $2.46 20m 50s
CPAN 1 $4.14 17m 47s
GitHub / Node.js web application 1 $1.48 14m 14s
Go module 1 38m 55s
Joomla extension 1 $10.73 77m 51s
Ruby 1 $1.67 18m 33s
Ruby on Rails self-hosted application, also shipped as Docker image pglombardo/pwpush 1 $2.32 21m 33s
WordPress plugin (hosted on WordPress.org SVN, not GitHub) 1 $7.05 22m 56s
cargo 1 $4.18 33m 23s
cpp 1 47m 53s
docker 1 $3.15 44m 34s
gnu 1 35m 50s
joomla 1 $18.76 107m 17s
nodejs 1 $3.26 47m 12s
npm / JavaScript (Node.js, Express) 1 $2.01 12m 11s
other (commercial, Java-based server application) 1 $37.97 94m 25s
pip (per GitHub advisory) 1 8m 19s
product 1 $6.41 122m 25s
pypi 1 4m 50s
rubygems 1 $0.67 10m 15s
rust 1 $0.27 10m 6s
standalone application (Python/FastAPI) 1 $2.02 14m 56s
vendor 1 $27.17 163m 48s
wordpress 1 $7.43 20m 35s

By severity

Count and median cost per CVSS severity bucket.

critical 106 · median $5.39
high 108 · median $2.98
medium 24 · median $2.18
low 4 · median $3.14

Top CWEs

Most common weakness types across published reproductions.