Skip to content
BetaBenchAlert v0.1 is in Beta.Numbers are real, but pages and rules can still change.See what changed

Raw data

Logs

Every check our lab has saved: the good ones, the failed ones, and the tokens they cost us. This is the ledger behind every board on the site.

What our lab spent

Tokens the paid apps reported back to us for our own test runs. A token is a small chunk of text, about four letters. Total is new input + cache + output.

Pick a time window

Every count on this page follows the window you pick here. The default is the last 24 hours. 30d is as far back as we serve.

Total tokens · last 720 hours

16,784,183

2383 samples · $15.1617 at published API list prices

Apps reported $11.1933 of their own. 960 of 2383 samples report no cost at all — those rows are blank, not free.

68 samples are missing a token count, so the totals above are short by whatever they used.

How to read this

Two dollar columns, and they are not the same. Cost is the figure the app itself sent back with the answer — Claude and Grok send one, Codex sends none. API $ is our own recomputation of the same tokens at the vendor's published API list price, so all three apps sit on one scale. Neither is our bill: we pay flat monthly plans. A blank means not measured, never $0. The same API dollars, rolled up to a whole usage window, are what the quota board prices.

How to read this

New in is uncached prompt tokens. Cache is cache reads plus writes — cheaper, but still usage. Out is everything the model wrote, including think. Total adds those three. Bigger is not better here. It is what our own testing used.

By app

SplitnNew inCacheOutTotalAPI $
Codex9458.75M1.55M181.3k10.48M$8.9688
Grok Build4965.22M105.0k99.0k5.43M$4.3439
Claude Code942358.5k261.4k252.6k872.5k$1.8490

By check

SplitnNew inCacheOutTotalAPI $
speed179910.67M1.66M513.5k12.84M$13.8769
ping5843.67M252.7k19.3k3.94M$1.2848

By model

SplitnNew inCacheOutTotalAPI $
GPT-5.6 Luna3824.03M52.5k49.5k4.13M$0.2774
Grok 4.63303.34M77.3k52.9k3.47M$2.7239
GPT-5.6 Terra1941.58M683.5k45.9k2.31M$1.4732
GPT-5.6 Sol1801.89M194.0k43.0k2.12M$3.9121
Grok 4.51661.88M27.6k46.1k1.96M$1.6200
GPT-5.51671.24M558.6k42.7k1.84M$3.3060
Haiku 4.5389198.9k36.1k123.1k358.1k$0.2253
Sonnet 518256.0k44.3k44.5k144.9k$0.1952
claude1910144.0k76144.1k
Fable 517651.8k19.1k42.4k113.4k$0.9525
Opus 517651.7k17.9k42.4k112.0k$0.4760
codex1922.0k60.2k9082.2k
GPT-5.230000

Test runs

234 launches in this window · 104 failed samples. Open a run to see every model it touched and what that cost.

Aug 23, 7:00:01 PMpulsescheduled1m 45s · 13 rec · 0 skip · 1 fail · 98.0k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok4.70s9,691256299,976$0.0197
pingclaudeok4.50s250085335$0.0007
pingcodexok9.60s12.0k0512.0k$0.0024
speedcodex/terraok14.0s12.3k024312.6k$0.0276
speedcodex/solok10.1s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok9.97s11.4k025711.6k$0.0646
speedgrok/grok-4.6ok7.11s11.9k51229712.7k$0.0258
speedgrok/grok-4.5ok7.25s12.0k38428512.7k$0.0258
speedclaude/haikuok6.36s2720533805$0.0029
speedclaude/sonnetok4.16s3220241563$0.0031
speedclaude/opusok5.32s3060241547$0.0076
speedclaude/fablerate limit warningserved with a rate limit warning: seven_day_overage_included at 0.77 utilization4.53s3070241548$0.0151
speedcodex/lunaok9.45s10.8k025411.0k$0.0025
Aug 23, 6:00:01 PMpulsescheduled1m 23s · 13 rec · 0 skip · 5 fail · 38.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexfailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.13s0000$0.0000
pinggrokok8.01s9,819128299,976$0.0199
pingclaudeok3.19s250066316$0.0006
speedcodex/lunafailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:29 PM.8.23s0000$0.0000
speedcodex/terrafailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.12s0000$0.0000
speedcodex/solfailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.5.79s0000$0.0000
speedcodex/gpt-5.5failedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.00s0000$0.0000
speedgrok/grok-4.6ok5.85s12.1k25628312.7k$0.0261
speedgrok/grok-4.5ok5.35s12.1k25628312.7k$0.0260
speedclaude/haikuok8.11s2720560832$0.0031
speedclaude/sonnetok5.38s3220241563$0.0031
speedclaude/opusok4.55s3060241547$0.0076
speedclaude/fableok5.56s3070241548$0.0151
Aug 23, 5:00:00 PMpulsescheduled1m 25s · 13 rec · 0 skip · 6 fail · 38.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok3.48s250075325$0.0006
pingcodexfailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.91s0000$0.0000
pinggrokok6.61s9,691256299,976$0.0197
speedclaude/fablerate limit warningserved with a rate limit warning: seven_day_overage_included at 0.76 utilization6.46s3060241547$0.0151
speedcodex/lunafailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.7.09s0000$0.0000
speedcodex/terrafailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.42s0000$0.0000
speedcodex/solfailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.5.96s0000$0.0000
speedcodex/gpt-5.5failedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.33s0000$0.0000
speedgrok/grok-4.6ok7.25s12.3k12829312.7k$0.0264
speedgrok/grok-4.5ok6.25s12.1k25628512.7k$0.0261
speedclaude/haikuok6.62s2720531803$0.0029
speedclaude/sonnetok5.24s3220241563$0.0031
speedclaude/opusok4.80s3060241547$0.0076
Aug 23, 4:10:14 PMpulsecatch-up5.80s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokskipped · already recorded this slot
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
Aug 23, 4:00:01 PMpulsescheduled1m 38s · 13 rec · 0 skip · 6 fail · 38.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok7.28s9,691256299,976$0.0197
pingclaudeok4.37s250078328$0.0006
pingcodexfailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.7.13s0000$0.0000
speedclaude/opusok6.84s3060241547$0.0076
speedclaude/fablerate limit warningserved with a rate limit warning: seven_day_overage_included at 0.75 utilization8.43s3060241547$0.0151
speedcodex/lunafailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.7.38s0000$0.0000
speedcodex/terrafailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.00s0000$0.0000
speedcodex/solfailedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.7.38s0000$0.0000
speedcodex/gpt-5.5failedYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.6.32s0000$0.0000
speedgrok/grok-4.6ok6.63s12.1k25629312.7k$0.0262
speedgrok/grok-4.5ok6.54s12.1k25628512.7k$0.0261
speedclaude/haikuok9.44s2720550822$0.0030
speedclaude/sonnetok8.48s3220241563$0.0031
Aug 23, 3:00:00 PMpulsescheduled2m 3s · 13 rec · 0 skip · 0 fail · 99.2k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok8.52s12.0k0512.0k$0.0024
pinggrokok5.80s9,690256179,963$0.0196
pingclaudeok4.94s250073323$0.0006
speedclaude/sonnetok10.5s3220270592$0.0033
speedclaude/opusok7.25s3060241547$0.0076
speedclaude/fableok9.15s3070241548$0.0151
speedcodex/lunaok13.7s10.8k025511.0k$0.0025
speedcodex/terraok10.5s12.3k024312.6k$0.0276
speedcodex/solok12.4s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok13.0s6,9955,63225512.9k$0.0454
speedgrok/grok-4.6ok6.11s12.1k25629312.7k$0.0261
speedgrok/grok-4.5ok6.76s12.4k029212.7k$0.0265
speedclaude/haikuok9.69s2720554826$0.0030
Aug 23, 2:00:00 PMpulsescheduled1m 49s · 13 rec · 0 skip · 0 fail · 96.9k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok5.14s2500106356$0.0008
pingcodexok6.40s10.8k0510.8k$0.0022
pinggrokok5.19s9,436512299,977$0.0193
speedclaude/haikuok8.54s2720546818$0.0030
speedclaude/sonnetok7.75s3220241563$0.0031
speedclaude/opusok7.24s3060241547$0.0076
speedclaude/fableok7.89s3070241548$0.0151
speedcodex/lunaok12.4s10.8k025511.0k$0.0025
speedcodex/terraok9.68s12.3k024312.6k$0.0276
speedcodex/solok10.9s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok10.7s11.4k025711.6k$0.0646
speedgrok/grok-4.6ok8.53s11.9k51228312.7k$0.0258
speedgrok/grok-4.5ok5.50s11.9k51228312.7k$0.0257
Aug 23, 1:00:01 PMpulsescheduled1m 53s · 13 rec · 0 skip · 1 fail · 98.0k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok5.23s9,692256179,965$0.0196
pingclaudeok4.69s2500104354$0.0008
pingcodexok6.54s10.8k0510.8k$0.0022
speedgrok/grok-4.5ok7.10s12.4k028312.7k$0.0265
speedclaude/haikuok6.21s2720531803$0.0029
speedclaude/sonnetok7.27s3220241563$0.0031
speedclaude/opusok6.97s3060241547$0.0076
speedclaude/fableok7.76s3070241548$0.0151
speedcodex/lunaok12.8s10.8k025411.0k$0.0025
speedcodex/terrawrong answerReading additional input from stdin...10.0s12.3k016912.5k$0.0267
speedcodex/solok15.8s13.6k024313.8k$0.0752
speedcodex/gpt-5.5ok11.8s11.4k025711.6k$0.0646
speedgrok/grok-4.6ok5.96s12.2k25629712.7k$0.0262
Aug 23, 12:00:01 PMpulsescheduled2m 3s · 13 rec · 0 skip · 0 fail · 99.2k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok10.1s12.0k0512.0k$0.0024
pinggrokok4.79s9,691256189,965$0.0196
pingclaudeok4.73s250062312$0.0006
speedgrok/grok-4.6ok8.08s12.1k25629212.7k$0.0262
speedgrok/grok-4.5ok5.84s12.1k25628012.7k$0.0260
speedclaude/haikuok9.94s2720531803$0.0029
speedclaude/sonnetok7.33s3220241563$0.0031
speedclaude/opusok7.20s3060241547$0.0076
speedclaude/fableok10.0s3070241548$0.0151
speedcodex/lunaok15.3s12.0k025512.3k$0.0027
speedcodex/terraok11.3s12.3k024312.6k$0.0276
speedcodex/solok12.0s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok11.6s63310.8k25711.6k$0.0163
Aug 23, 11:00:01 AMpulsescheduled1m 59s · 13 rec · 0 skip · 0 fail · 98.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok4.90s250096346$0.0007
pingcodexok4.73s10.8k0510.8k$0.0022
pinggrokok15.3s9,692256299,977$0.0197
speedcodex/gpt-5.5ok10.1s11.4k025411.6k$0.0646
speedgrok/grok-4.6ok6.10s11.9k51229412.7k$0.0258
speedgrok/grok-4.5ok5.96s12.4k028012.7k$0.0265
speedclaude/haikuok10.4s2720549821$0.0030
speedclaude/sonnetok6.94s3220241563$0.0031
speedclaude/opusok8.18s3060241547$0.0076
speedclaude/fableok7.34s3070241548$0.0151
speedcodex/lunaok12.3s12.0k025412.3k$0.0027
speedcodex/terraok11.0s12.3k024312.6k$0.0276
speedcodex/solok10.5s12.3k024312.6k$0.0690
Aug 23, 10:14:58 AMpulsecatch-up3.30s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokskipped · already recorded this slot
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
Aug 23, 10:00:01 AMpulsescheduled1m 55s · 13 rec · 0 skip · 0 fail · 98.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok5.26s9,435512299,976$0.0193
pingclaudeok7.62s2500125375$0.0009
pingcodexok4.72s10.8k0510.8k$0.0022
speedcodex/solok10.6s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok10.6s11.4k025411.6k$0.0646
speedgrok/grok-4.6ok6.43s11.9k51229512.7k$0.0258
speedgrok/grok-4.5ok7.15s12.3k12828012.7k$0.0262
speedclaude/haikuok8.85s2720530802$0.0029
speedclaude/sonnetok7.31s3220241563$0.0031
speedclaude/opusok6.78s3060241547$0.0076
speedclaude/fableok9.20s3070241548$0.0151
speedcodex/lunaok11.8s12.0k025412.3k$0.0027
speedcodex/terraok10.4s12.3k024312.6k$0.0276
Aug 23, 9:00:01 AMpulsescheduled1m 58s · 13 rec · 0 skip · 0 fail · 98.0k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok4.76s10.8k0510.8k$0.0022
pinggrokok5.47s9,9480309,978$0.0201
pingclaudeok8.36s250059309$0.0005
speedcodex/terraok10.1s12.3k024312.6k$0.0276
speedcodex/solok12.0s13.6k024313.8k$0.0752
speedcodex/gpt-5.5ok9.71s63510.8k25711.6k$0.0163
speedgrok/grok-4.6ok16.1s12.3k12829312.7k$0.0264
speedgrok/grok-4.5ok6.88s12.4k028312.7k$0.0265
speedclaude/haikuok8.48s2720531803$0.0029
speedclaude/sonnetok6.49s3220241563$0.0031
speedclaude/opusok7.79s3060241547$0.0076
speedclaude/fableok8.03s3070241548$0.0151
speedcodex/lunaok9.15s10.8k025411.0k$0.0025
Aug 23, 8:00:01 AMpulsescheduled1m 52s · 13 rec · 0 skip · 0 fail · 98.0k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok3.96s250066316$0.0006
pingcodexok5.30s10.8k0510.8k$0.0022
pinggrokok7.23s9,9480189,966$0.0200
speedcodex/lunaok10.3s12.0k025412.3k$0.0027
speedcodex/terraok10.4s12.3k024312.6k$0.0276
speedcodex/solok12.5s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok11.3s63510.8k26311.7k$0.0164
speedgrok/grok-4.6ok8.32s12.2k25628212.7k$0.0261
speedgrok/grok-4.5ok6.27s12.3k12828312.7k$0.0263
speedclaude/haikuok9.03s2720546818$0.0030
speedclaude/sonnetok7.28s3220241563$0.0031
speedclaude/opusok7.76s3060241547$0.0076
speedclaude/fableok7.90s3070241548$0.0151
Aug 23, 7:00:01 AMpulsescheduled1m 53s · 13 rec · 0 skip · 0 fail · 98.0k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok5.31s9,9470179,964$0.0200
pingclaudeok4.95s250080330$0.0006
pingcodexok12.1s12.0k0512.0k$0.0024
speedclaude/fableok7.63s3070241548$0.0151
speedcodex/lunaok9.13s10.8k025411.0k$0.0025
speedcodex/terraok10.1s12.4k024312.6k$0.0276
speedcodex/solok11.8s12.4k024312.6k$0.0690
speedcodex/gpt-5.5ok9.81s11.4k026511.7k$0.0649
speedgrok/grok-4.6ok6.32s12.4k028312.7k$0.0265
speedgrok/grok-4.5ok6.49s12.3k12828012.7k$0.0262
speedclaude/haikuok8.79s2720539811$0.0030
speedclaude/sonnetok8.23s3220241563$0.0031
speedclaude/opusok8.44s3060241547$0.0076
Aug 23, 6:00:01 AMpulsescheduled1m 46s · 13 rec · 0 skip · 0 fail · 96.9k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok5.69s10.8k0510.8k$0.0022
pinggrokok5.11s9,692256299,977$0.0197
pingclaudeok5.72s250070320$0.0006
speedclaude/opusok6.18s3060241547$0.0076
speedclaude/fableok7.98s3070241548$0.0151
speedcodex/lunaok10.6s10.8k025411.0k$0.0025
speedcodex/terraok11.2s31912.0k24312.6k$0.0060
speedcodex/solok10.6s12.4k024312.6k$0.0690
speedcodex/gpt-5.5ok10.4s11.4k025711.6k$0.0647
speedgrok/grok-4.6ok6.89s12.4k029512.7k$0.0266
speedgrok/grok-4.5ok5.88s12.4k028312.7k$0.0265
speedclaude/haikuok9.35s2720547819$0.0030
speedclaude/sonnetok6.57s3220273595$0.0034
Aug 23, 5:00:00 AMpulsescheduled1m 41s · 13 rec · 0 skip · 0 fail · 96.8k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok4.37s250091341$0.0007
pingcodexok4.97s10.8k0510.8k$0.0022
pinggrokok4.58s9,435512179,964$0.0192
speedclaude/sonnetok7.04s3220265587$0.0033
speedclaude/opusok7.58s3060241547$0.0076
speedclaude/fableok8.24s3070241548$0.0151
speedcodex/lunaok10.6s10.8k025511.0k$0.0025
speedcodex/terraok8.95s12.3k024312.6k$0.0276
speedcodex/solok11.1s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok9.50s63510.8k25711.6k$0.0163
speedgrok/grok-4.6ok6.46s12.1k25629512.7k$0.0262
speedgrok/grok-4.5ok6.19s12.3k12829212.7k$0.0263
speedclaude/haikuok8.12s2720533805$0.0029
Aug 23, 4:00:00 AMpulsescheduled1m 44s · 13 rec · 0 skip · 1 fail · 96.7k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok4.62s9,9480179,965$0.0200
pingclaudeok4.39s250047297$0.0005
pingcodexok4.63s10.8k0510.8k$0.0022
speedclaude/haikuok6.75s2720560832$0.0031
speedclaude/sonnetok7.69s3220241563$0.0031
speedclaude/opusok7.35s3060241547$0.0076
speedclaude/fableok8.17s3070241548$0.0151
speedcodex/lunaok9.69s10.8k025611.1k$0.0025
speedcodex/terrawrong answerReading additional input from stdin...8.21s12.4k06812.4k$0.0255
speedcodex/solok11.5s12.4k024312.6k$0.0691
speedcodex/gpt-5.5ok10.4s11.4k026411.7k$0.0649
speedgrok/grok-4.6ok6.35s12.2k25628712.7k$0.0262
speedgrok/grok-4.5ok7.44s11.9k51228312.7k$0.0257
Aug 23, 3:00:01 AMpulsescheduled1m 44s · 13 rec · 0 skip · 0 fail · 96.8k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok6.08s10.8k0510.8k$0.0022
pinggrokok6.94s9,436512299,977$0.0193
pingclaudeok4.10s250085335$0.0007
speedgrok/grok-4.5ok5.46s12.3k12828012.7k$0.0263
speedclaude/haikuok9.87s2720531803$0.0029
speedclaude/sonnetok6.23s3220241563$0.0031
speedclaude/opusok8.56s3060241547$0.0076
speedclaude/fableok7.90s3070241548$0.0151
speedcodex/lunaok10.1s10.8k026111.1k$0.0025
speedcodex/terraok8.61s12.3k024312.6k$0.0276
speedcodex/solok9.88s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok9.74s11.4k026911.7k$0.0650
speedgrok/grok-4.6ok6.62s12.4k028312.7k$0.0265
Aug 23, 2:00:01 AMpulsescheduled1m 45s · 13 rec · 0 skip · 0 fail · 96.8k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok5.58s250090340$0.0007
pingcodexok4.64s10.8k0510.8k$0.0022
pinggrokok5.21s9,691256179,964$0.0196
speedgrok/grok-4.6ok7.35s12.1k25629312.7k$0.0262
speedgrok/grok-4.5ok6.37s12.4k028012.7k$0.0265
speedclaude/haikuok9.13s2720550822$0.0030
speedclaude/sonnetok7.14s3220241563$0.0031
speedclaude/opusok7.69s3060241547$0.0076
speedclaude/fableok7.62s3070241548$0.0151
speedcodex/lunaok9.93s10.8k025511.0k$0.0025
speedcodex/terraok8.61s12.3k024312.6k$0.0276
speedcodex/solok10.8s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok9.91s63310.8k26011.6k$0.0163
Aug 23, 1:00:01 AMpulsescheduled1m 49s · 13 rec · 0 skip · 0 fail · 96.8k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok4.64s9,9470309,977$0.0201
pingclaudeok7.77s2500102352$0.0008
pingcodexok5.34s8,9771,792510.8k$0.0018
speedcodex/gpt-5.5ok9.68s11.4k025411.6k$0.0645
speedgrok/grok-4.6ok6.39s12.4k029312.7k$0.0265
speedgrok/grok-4.5ok5.55s12.3k12828312.7k$0.0263
speedclaude/haikuok9.31s2720563835$0.0031
speedclaude/sonnetok6.57s3220241563$0.0031
speedclaude/opusok10.6s3060241547$0.0076
speedclaude/fableok8.45s3070241548$0.0151
speedcodex/lunaok9.57s8,9971,79225411.0k$0.0021
speedcodex/terraok10.1s31512.0k24312.6k$0.0060
speedcodex/solok9.88s12.3k024312.6k$0.0690
Aug 23, 12:00:01 AMpulsescheduled1m 42s · 13 rec · 0 skip · 0 fail · 96.8k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok6.67s10.8k0510.8k$0.0022
pinggrokok4.57s9,436512179,965$0.0192
pingclaudeok3.76s250044294$0.0005
speedcodex/solok11.1s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok9.68s11.4k025611.6k$0.0646
speedgrok/grok-4.6ok6.27s12.2k25629312.7k$0.0262
speedgrok/grok-4.5ok6.30s11.9k51228312.7k$0.0257
speedclaude/haikuok7.91s2720560832$0.0031
speedclaude/sonnetok5.88s3220241563$0.0031
speedclaude/opusok7.21s3060241547$0.0076
speedclaude/fableok7.65s3070241548$0.0151
speedcodex/lunaok9.79s10.8k025411.0k$0.0025
speedcodex/terraok10.4s12.3k024312.6k$0.0276
Aug 22, 11:00:01 PMpulsescheduled1m 50s · 13 rec · 0 skip · 0 fail · 98.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok3.60s250044294$0.0005
pingcodexok6.53s10.8k0510.8k$0.0022
pinggrokok4.43s9,693256179,966$0.0196
speedcodex/terraok13.0s31912.0k24312.6k$0.0060
speedcodex/solok12.1s31912.0k24312.6k$0.0149
speedcodex/gpt-5.5ok10.4s11.4k026611.7k$0.0649
speedgrok/grok-4.6ok5.41s12.3k12828212.7k$0.0264
speedgrok/grok-4.5ok7.19s12.2k25628012.7k$0.0261
speedclaude/haikuok9.30s2720556828$0.0031
speedclaude/sonnetok6.95s3220241563$0.0031
speedclaude/opusok7.06s3060241547$0.0076
speedclaude/fableok8.53s3060241547$0.0151
speedcodex/lunaok11.9s12.0k025412.3k$0.0027
Aug 22, 10:30:35 PMpulsecatch-up22.1s · 3 rec · 10 skip · 0 fail · 35.3k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok4.96s9,691256299,976$0.0197
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6ok7.59s12.3k12828312.7k$0.0263
speedgrok/grok-4.5ok6.19s12.4k028312.7k$0.0265
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
Aug 22, 10:00:00 PMpulsescheduled1m 20s · 10 rec · 3 skip · 0 fail · 62.7k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokskipped · subscription auth missing
pingclaudeok3.10s250091341$0.0007
pingcodexok5.93s10.2k1,792512.0k$0.0021
speedcodex/lunaok10.6s10.8k025411.0k$0.0025
speedcodex/terraok9.40s12.3k024312.6k$0.0276
speedcodex/solok10.4s5,4356,91224312.6k$0.0379
speedcodex/gpt-5.5ok10.8s63310.8k25811.6k$0.0163
speedgrok/grok-4.6skipped · subscription auth missing
speedgrok/grok-4.5skipped · subscription auth missing
speedclaude/haikuok4.16s2720543815$0.0030
speedclaude/sonnetok4.61s3220261583$0.0033
speedclaude/opusok5.45s3060241547$0.0076
speedclaude/fableok4.72s3070241548$0.0151
Aug 22, 9:00:00 PMpulsescheduled1m 35s · 13 rec · 0 skip · 0 fail · 96.8k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok7.32s8,9771,792510.8k$0.0018
pinggrokok5.17s9,9460179,963$0.0200
pingclaudeok4.11s2500128378$0.0009
speedclaude/fableok4.75s3070241548$0.0151
speedcodex/lunaok11.6s10.8k025411.0k$0.0025
speedcodex/terraok9.15s12.3k024312.6k$0.0276
speedcodex/solok12.1s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok10.1s11.4k026611.7k$0.0649
speedgrok/grok-4.6ok5.80s12.1k25629412.7k$0.0261
speedgrok/grok-4.5ok6.05s12.2k12828012.7k$0.0262
speedclaude/haikuok6.38s2720532804$0.0029
speedclaude/sonnetok4.35s3220241563$0.0031
speedclaude/opusok4.68s3060241547$0.0076
Aug 22, 8:26:19 PMpulsecatch-up1.86s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
pinggrokskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
Aug 22, 8:24:43 PMpulsecatch-up1.50s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
pinggrokskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
Aug 22, 8:24:12 PMpulsecatch-up1.95s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
pinggrokskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
Aug 22, 8:23:24 PMpulsecatch-up1.96s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
pinggrokskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
Aug 22, 8:19:44 PMpulsecatch-up2.58s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
pinggrokskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
Aug 22, 8:00:01 PMpulsescheduled2m 6s · 13 rec · 0 skip · 0 fail · 98.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok2.87s250082332$0.0007
pingcodexok7.34s10.2k1,792512.0k$0.0021
pinggrokok5.21s9,9480179,965$0.0200
speedclaude/opusok5.11s3060241547$0.0076
speedclaude/fableok6.86s3070241548$0.0151
speedcodex/lunaok18.9s10.8k025411.0k$0.0025
speedcodex/terraok14.3s12.3k025412.6k$0.0277
speedcodex/solok13.5s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok11.6s63510.8k26811.7k$0.0166
speedgrok/grok-4.6ok6.46s12.2k25628212.7k$0.0261
speedgrok/grok-4.5ok5.63s12.3k12828012.7k$0.0263
speedclaude/haikuok5.48s2720559831$0.0031
speedclaude/sonnetok7.75s3220241563$0.0031
Aug 22, 7:32:03 PMpulsecatch-up7.61s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokskipped · already recorded this slot
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
Aug 22, 7:08:58 PMpulsecatch-up1m 38s · 13 rec · 0 skip · 0 fail · 99.2k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok5.04s9,9470309,977$0.0201
pingclaudeok2.63s250040290$0.0004
pingcodexok8.58s12.0k0512.0k$0.0024
speedclaude/sonnetok4.20s3220241563$0.0031
speedclaude/opusok7.09s3060241547$0.0076
speedclaude/fableok4.37s3070241548$0.0151
speedcodex/lunaok9.77s10.8k025311.0k$0.0025
speedcodex/terraok13.9s13.6k024313.8k$0.0301
speedcodex/solok11.2s5,4376,91224312.6k$0.0379
speedcodex/gpt-5.5ok10.1s11.4k025411.6k$0.0646
speedgrok/grok-4.6ok6.79s11.9k51228312.7k$0.0257
speedgrok/grok-4.5ok4.41s12.1k25628012.7k$0.0260
speedclaude/haikuok5.99s2720533805$0.0029
Aug 22, 6:00:00 PMpulsescheduled1m 47s · 13 rec · 0 skip · 0 fail · 99.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok8.15s10.8k0510.8k$0.0022
pinggrokok4.85s9,434512299,975$0.0193
pingclaudeok5.44s2500133383$0.0009
speedclaude/haikuok7.08s2720327599$0.0019
speedclaude/sonnetok4.91s3220241563$0.0031
speedclaude/opusok5.13s3060241547$0.0076
speedclaude/fableok5.58s3070241548$0.0151
speedcodex/lunaok17.1s12.0k025412.3k$0.0027
speedcodex/terraok9.64s12.3k024312.6k$0.0276
speedcodex/solok11.7s13.6k024313.8k$0.0752
speedcodex/gpt-5.5ok9.87s11.4k025411.6k$0.0646
speedgrok/grok-4.6ok5.42s12.2k12829312.7k$0.0263
speedgrok/grok-4.5ok6.39s12.2k12828012.7k$0.0262
Aug 22, 5:00:00 PMpulsescheduled1m 45s · 13 rec · 0 skip · 0 fail · 98.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok2.89s250076326$0.0006
pingcodexok7.55s10.8k0510.8k$0.0022
pinggrokok5.46s9,9480179,965$0.0200
speedgrok/grok-4.5ok6.43s12.3k12829212.7k$0.0264
speedclaude/haikuok6.52s2720540812$0.0030
speedclaude/sonnetok4.91s3220241563$0.0031
speedclaude/opusok4.48s3060241547$0.0076
speedclaude/fableok5.35s3070241548$0.0151
speedcodex/lunaok13.4s10.8k025411.0k$0.0025
speedcodex/terraok13.5s9,7513,84024313.8k$0.0232
speedcodex/solok10.2s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok9.93s11.4k026011.6k$0.0647
speedgrok/grok-4.6ok6.39s12.2k25629412.7k$0.0262
Aug 22, 4:00:01 PMpulsescheduled1m 30s · 10 rec · 3 skip · 0 fail · 63.9k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokskipped · subscription auth missing
pingclaudeok2.65s250042292$0.0005
pingcodexok12.7s12.0k0512.0k$0.0024
speedgrok/grok-4.6skipped · subscription auth missing
speedgrok/grok-4.5skipped · subscription auth missing
speedclaude/haikuok6.03s2720562834$0.0031
speedclaude/sonnetok6.49s3220241563$0.0031
speedclaude/opusok5.33s3060241547$0.0076
speedclaude/fableok4.91s3070241548$0.0151
speedcodex/lunaok10.1s10.8k025411.0k$0.0025
speedcodex/terraok15.9s13.6k024313.8k$0.0301
speedcodex/solok10.9s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok11.5s11.4k026811.7k$0.0650
Aug 22, 3:00:00 PMpulsescheduled1m 47s · 13 rec · 0 skip · 0 fail · 99.3k tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexok7.53s12.0k0512.0k$0.0024
pinggrokok4.62s9,435512189,965$0.0192
pingclaudeok2.94s250087337$0.0007
speedcodex/gpt-5.5ok11.5s63310.8k26611.7k$0.0165
speedgrok/grok-4.6ok5.45s12.1k25629312.7k$0.0262
speedgrok/grok-4.5ok5.26s12.3k12828012.7k$0.0262
speedclaude/haikuok9.08s2720536808$0.0030
speedclaude/sonnetok3.98s3220241563$0.0031
speedclaude/opusok4.80s3060241547$0.0076
speedclaude/fableok5.69s3070241548$0.0151
speedcodex/lunaok20.1s12.0k025412.3k$0.0027
speedcodex/terraok9.89s31512.0k24312.6k$0.0060
speedcodex/solok12.0s31512.0k24312.6k$0.0149
Aug 22, 2:21:30 PMpulsemanual-accuracy-audit-r31m 24s · 10 rec · 0 skip · 0 fail · 74.4k tok
TargetResultWallNew inCacheOutTotalAPI $
speedclaude/opusok5.26s3060241547$0.0076
speedclaude/fableok4.75s3070241548$0.0151
speedcodex/lunaok11.7s10.8k025411.0k$0.0025
speedcodex/terraok11.7s6,6756,91224313.8k$0.0176
speedcodex/solok10.7s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok12.3s63110.8k25811.6k$0.0163
speedgrok/grok-4.6ok7.55s9,947028610.2k$0.0216
speedgrok/grok-4.5ok6.46s12.2k12828312.6k$0.0262
speedclaude/haikuok4.68s2720545817$0.0030
speedclaude/sonnetok4.35s3220241563$0.0031
Aug 22, 2:19:47 PMpulsemanual-accuracy-audit-r21m 36s · 10 rec · 0 skip · 0 fail · 75.7k tok
TargetResultWallNew inCacheOutTotalAPI $
speedgrok/grok-4.5ok7.95s9,81912828310.2k$0.0214
speedclaude/haikuok6.41s2720542814$0.0030
speedclaude/sonnetok4.61s3220265587$0.0033
speedclaude/opusok4.59s3060241547$0.0076
speedclaude/fableok5.83s3070241548$0.0151
speedcodex/lunaok16.5s12.0k025412.3k$0.0027
speedcodex/terraok16.4s6,6776,91224313.8k$0.0177
speedcodex/solok11.6s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok11.3s11.4k026011.6k$0.0647
speedgrok/grok-4.6ok6.21s11.9k51229512.7k$0.0257
Aug 22, 2:18:10 PMpulsemanual-accuracy-audit-r11m 31s · 10 rec · 0 skip · 0 fail · 74.3k tok
TargetResultWallNew inCacheOutTotalAPI $
speedcodex/solok13.2s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok15.2s12.6k026612.9k$0.0711
speedgrok/grok-4.6ok7.59s9,43651229310.2k$0.0209
speedgrok/grok-4.5ok5.78s12.2k12828312.7k$0.0262
speedclaude/haikuok7.50s2720551823$0.0030
speedclaude/sonnetok4.64s3220241563$0.0031
speedclaude/opusok4.81s3060241547$0.0076
speedclaude/fableok5.58s3070241548$0.0151
speedcodex/lunaok8.25s10.6k025410.9k$0.0024
speedcodex/terraok13.9s12.3k024312.6k$0.0276
Aug 22, 2:00:01 PMpulsescheduled1m 44s · 13 rec · 0 skip · 0 fail · 98.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok3.70s2500113363$0.0008
pingcodexok7.65s10.8k0510.8k$0.0022
pinggrokok4.25s9,692256299,977$0.0197
speedcodex/solok19.0s13.6k024313.8k$0.0752
speedcodex/gpt-5.5ok11.3s11.4k026611.7k$0.0649
speedgrok/grok-4.6ok5.90s12.0k38430512.7k$0.0261
speedgrok/grok-4.5ok5.79s12.4k028012.7k$0.0265
speedclaude/haikuok6.17s2720531803$0.0029
speedclaude/sonnetok4.37s3220241563$0.0031
speedclaude/opusok4.80s3060241547$0.0076
speedclaude/fableok5.05s3070241548$0.0151
speedcodex/lunaok10.4s10.8k025411.0k$0.0025
speedcodex/terraok12.0s12.3k024312.6k$0.0276
Aug 22, 1:11:57 PMpulsecatch-up2.39s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokskipped · already recorded this slot
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
Aug 22, 1:10:43 PMpulsemodel-verification-fix13.4s · 1 rec · 0 skip · 0 fail · 12.6k tok
TargetResultWallNew inCacheOutTotalAPI $
speedcodex/solok11.6s12.4k024312.6k$0.0690
Aug 22, 1:00:01 PMpulsescheduled1m 47s · 13 rec · 0 skip · 0 fail · 98.1k tok
TargetResultWallNew inCacheOutTotalAPI $
pinggrokok5.20s9,692256189,966$0.0196
pingclaudeok3.35s250088338$0.0007
pingcodexok11.5s12.0k0512.0k$0.0024
speedcodex/terraok13.5s12.3k024312.6k$0.0276
speedcodex/solok12.1s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok11.8s63310.8k25711.6k$0.0163
speedgrok/grok-4.6ok5.88s11.9k51230112.7k$0.0259
speedgrok/grok-4.5ok7.37s12.4k028012.7k$0.0265
speedclaude/haikuok4.41s2720531803$0.0029
speedclaude/sonnetok5.51s3220241563$0.0031
speedclaude/opusok6.94s3060241547$0.0076
speedclaude/fableok4.68s3070241548$0.0151
speedcodex/lunaok11.7s10.8k025411.0k$0.0025
Aug 22, 12:36:01 PMpulsecatch-up1.28s · 0 rec · 13 skip · 0 fail · 0 tok
TargetResultWallNew inCacheOutTotalAPI $
pingcodexskipped · already recorded this slot
pinggrokskipped · already recorded this slot
pingclaudeskipped · already recorded this slot
speedcodex/lunaskipped · already recorded this slot
speedcodex/terraskipped · already recorded this slot
speedcodex/solskipped · already recorded this slot
speedcodex/gpt-5.5skipped · already recorded this slot
speedgrok/grok-4.6skipped · already recorded this slot
speedgrok/grok-4.5skipped · already recorded this slot
speedclaude/haikuskipped · already recorded this slot
speedclaude/sonnetskipped · already recorded this slot
speedclaude/opusskipped · already recorded this slot
speedclaude/fableskipped · already recorded this slot
Aug 22, 12:29:00 PMpulseaccuracy-v021m 23s · 10 rec · 0 skip · 1 fail · 74.5k tok
TargetResultWallNew inCacheOutTotalAPI $
speedcodex/lunaok13.7s12.0k025412.3k$0.0027
speedcodex/terrawrong answerReading additional input from stdin... 2026-08-22T16:29:15.635778Z WARN codex_core::shell_snapshot: Failed to create shell snapshot for powershell: Shell snapshot not supported yet for PowerShell10.8s12.3k024112.6k$0.0276
speedcodex/solok11.0s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok10.1s11.4k025411.6k$0.0646
speedgrok/grok-4.6ok7.13s9,82112829410.2k$0.0215
speedgrok/grok-4.5ok7.69s12.4k028312.7k$0.0265
speedclaude/haikuok6.06s2720546818$0.0030
speedclaude/sonnetok4.15s3220241563$0.0031
speedclaude/opusok5.31s3060241547$0.0076
speedclaude/fableok4.56s3070241548$0.0151
Aug 22, 12:00:00 PMpulsescheduled1m 37s · 13 rec · 0 skip · 0 fail · 97.9k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok3.81s250064314$0.0006
pingcodexok7.55s10.8k0510.8k$0.0022
pinggrokok4.05s9,434512179,963$0.0192
speedclaude/haikuok5.79s2720543815$0.0030
speedclaude/sonnetok4.80s3220241563$0.0031
speedclaude/opusok4.21s3060241547$0.0076
speedclaude/fableok4.86s3060241547$0.0151
speedcodex/lunaok15.3s12.0k025312.3k$0.0027
speedcodex/terraok10.9s12.3k024312.6k$0.0276
speedcodex/solok11.0s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok11.2s11.4k026411.6k$0.0648
speedgrok/grok-4.6ok5.41s11.9k51228712.7k$0.0257
speedgrok/grok-4.5ok5.05s12.2k12828312.7k$0.0262
Aug 22, 11:00:00 AMpulsescheduled1m 37s · 13 rec · 0 skip · 0 fail · 99.2k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeok3.41s250070320$0.0006
pingcodexok5.97s12.0k0512.0k$0.0024
pinggrokok4.17s9,818128309,976$0.0199
speedclaude/haikuok6.16s2720550822$0.0030
speedclaude/sonnetok4.25s3220241563$0.0031
speedclaude/opusok4.41s3060241547$0.0076
speedclaude/fableok4.63s3070241548$0.0151
speedcodex/lunaok12.6s12.0k025412.3k$0.0027
speedcodex/terraok11.8s12.3k024312.6k$0.0276
speedcodex/solok10.7s5,4356,91224312.6k$0.0379
speedcodex/gpt-5.5ok11.7s9,8491,53625711.6k$0.0577
speedgrok/grok-4.6ok9.30s12.4k029512.7k$0.0265
speedgrok/grok-4.5ok4.91s12.1k25628312.7k$0.0260
Aug 22, 10:49:20 AMpulsecatch-up1m 18s · 10 rec · 3 skip · 0 fail · 74.6k tok
TargetResultWallNew inCacheOutTotalAPI $
pingclaudeskipped · already recorded this slot
pingcodexskipped · already recorded this slot
pinggrokskipped · already recorded this slot
speedclaude/haikuok6.46s2720570842$0.0031
speedclaude/sonnetok4.85s3220241563$0.0031
speedclaude/opusok4.89s3060241547$0.0076
speedclaude/fableok4.77s3070241548$0.0151
speedcodex/lunaok12.3s12.0k025412.3k$0.0027
speedcodex/terraok9.44s12.3k024312.6k$0.0276
speedcodex/solok9.51s12.3k024312.6k$0.0690
speedcodex/gpt-5.5ok10.6s11.4k025811.7k$0.0647
speedgrok/grok-4.6ok7.08s9,45651229310.3k$0.0209
speedgrok/grok-4.5ok5.22s12.2k25628012.7k$0.0261

Showing the newest 50 of 234 runs.

Each row: start time · kind · trigger (cron means the timer, anything else means by hand) · wall time · rec / skip / fail · total tokens. Skipped means it was not that target's turn, or a rate limit stopped the app. Failed is a real error, and we keep it.

Sample log

Every measurement we saved, newest first. Filter by check or by app. Most old test-kit rows stay in Logs only. Older speed rows that can be rebuilt exactly from their raw files may return to the history. The counts above always cover the full window, not the filter.

This window, counted by outcome

  • ok · 2279
  • rate limit · 45
  • failed · 19
  • rate limit warning · 18
  • wrong answer · 18
  • auth · 3
  • · 1

Every saved sample in the window, sorted into its label. The filters below change the table, never these counts.

The status words

ok
The app answered and the answer passed our grader.
rate limit
The vendor refused the request. We stop the rest of that app for the round. Busy plan, not a slow model.
rate limit warning
The vendor served the correct answer but flagged that the plan's usage window is getting full. Its real wait stays in experienced-speed summaries, and the warning is labeled. It never stops the round.
timeout
The app never finished in the time we allow.
auth
The sign-in was not accepted. We skip that app until it is fixed.
used tools
The app reached for a tool even though we said not to. The row does not count.
wrong answer
Text came back, but it was not what we asked for. Speed with a wrong answer never counts.
remapped
We asked for one model and the app served another. We save both names and mark the row, and the boards treat it with care.
parse
The app’s own output was not readable, so we could not trust the timings.
overloaded / credits / failed
The vendor said it was busy, out of credit, or gave a plain error.
StartedCheckTargetStatusWallTotalCostAPI $
Aug 23, 7:00:17 PMpingcodex/lunaok9.60s12.0k$0.0024
Aug 23, 6:00:04 PMpingcodex/lunaYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.failed6.13s0$0.0000
Aug 23, 5:00:08 PMpingcodex/lunaYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.failed6.91s0$0.0000
Aug 23, 4:00:17 PMpingcodex/lunaYou've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Aug 24th, 2026 8:30 PM.failed7.13s0$0.0000
Aug 23, 3:00:04 PMpingcodex/lunaok8.52s12.0k$0.0024
Aug 23, 2:00:08 PMpingcodex/lunaok6.40s10.8k$0.0022
Aug 23, 1:00:14 PMpingcodex/lunaok6.54s10.8k$0.0022
Aug 23, 12:00:04 PMpingcodex/lunaok10.1s12.0k$0.0024
Aug 23, 11:00:09 AMpingcodex/lunaok4.73s10.8k$0.0022
Aug 23, 10:00:21 AMpingcodex/lunaok4.72s10.8k$0.0022
Aug 23, 9:00:04 AMpingcodex/lunaok4.76s10.8k$0.0022
Aug 23, 8:00:08 AMpingcodex/lunaok5.30s10.8k$0.0022
Aug 23, 7:00:14 AMpingcodex/lunaok12.1s12.0k$0.0024
Aug 23, 6:00:03 AMpingcodex/lunaok5.69s10.8k$0.0022
Aug 23, 5:00:07 AMpingcodex/lunaok4.97s10.8k$0.0022
Aug 23, 4:00:16 AMpingcodex/lunaok4.63s10.8k$0.0022
Aug 23, 3:00:03 AMpingcodex/lunaok6.08s10.8k$0.0022
Aug 23, 2:00:11 AMpingcodex/lunaok4.64s10.8k$0.0022
Aug 23, 1:00:18 AMpingcodex/lunaok5.34s10.8k$0.0018
Aug 23, 12:00:04 AMpingcodex/lunaok6.67s10.8k$0.0022
Aug 22, 11:00:06 PMpingcodex/lunaok6.53s10.8k$0.0022
Aug 22, 10:00:14 PMpingcodex/lunaok5.93s12.0k$0.0021
Aug 22, 9:00:02 PMpingcodex/lunaok7.32s10.8k$0.0018
Aug 22, 8:00:07 PMpingcodex/lunaok7.34s12.0k$0.0021
Aug 22, 7:09:09 PMpingcodex/lunaok8.58s12.0k$0.0024
Aug 22, 6:00:05 PMpingcodex/lunaok8.15s10.8k$0.0022
Aug 22, 5:00:08 PMpingcodex/lunaok7.55s10.8k$0.0022
Aug 22, 4:00:07 PMpingcodex/lunaok12.7s12.0k$0.0024
Aug 22, 3:00:03 PMpingcodex/lunaok7.53s12.0k$0.0024
Aug 22, 2:00:07 PMpingcodex/lunaok7.65s10.8k$0.0022
Aug 22, 1:00:12 PMpingcodex/lunaok11.5s12.0k$0.0024
Aug 22, 12:00:06 PMpingcodex/lunaok7.55s10.8k$0.0022
Aug 22, 11:00:05 AMpingcodex/lunaok5.97s12.0k$0.0024
Aug 22, 10:00:08 AMpingcodex/lunaok7.66s12.0k$0.0024
Aug 22, 9:00:10 AMpingcodex/lunaok8.15s12.0k$0.0024
Aug 22, 8:00:06 AMpingcodex/lunaok6.35s12.0k$0.0024
Aug 22, 7:00:08 AMpingcodex/lunaok7.72s12.0k$0.0024
Aug 22, 6:00:06 AMpingcodex/lunaok6.41s10.8k$0.0022
Aug 22, 5:00:07 AMpingcodex/lunaok7.20s12.0k$0.0024
Aug 22, 4:00:08 AMpingcodex/lunaok4.94s10.8k$0.0022
Aug 22, 3:00:10 AMpingcodex/lunaok5.64s12.0k$0.0024
Aug 22, 2:00:08 AMpingcodex/lunaok7.24s12.0k$0.0024
Aug 22, 1:00:07 AMpingcodex/lunaok8.25s12.0k$0.0024
Aug 22, 12:00:05 AMpingcodex/lunaok8.80s12.0k$0.0024
Aug 21, 11:00:10 PMpingcodex/lunaok7.93s12.0k$0.0024
Aug 21, 10:00:11 PMpingcodex/lunaok6.91s12.0k$0.0024
Aug 21, 9:00:06 PMpingcodex/lunaok11.4s12.0k$0.0024
Aug 21, 8:00:06 PMpingcodex/lunaok8.16s12.2k$0.0024
Aug 21, 7:00:07 PMpingcodex/lunaok7.92s12.2k$0.0024
Aug 21, 6:00:06 PMpingcodex/lunaok7.26s12.2k$0.0024
Aug 21, 5:00:07 PMpingcodex/lunaok6.38s12.2k$0.0024
Aug 21, 4:00:08 PMpingcodex/lunaok7.49s12.2k$0.0024
Aug 21, 3:00:08 PMpingcodex/lunaok8.56s12.2k$0.0024
Aug 21, 2:00:07 PMpingcodex/lunaok9.70s12.2k$0.0024
Aug 21, 1:00:07 PMpingcodex/lunaok5.96s12.2k$0.0024
Aug 21, 12:00:11 PMpingcodex/lunaok9.31s12.2k$0.0024
Aug 21, 11:00:23 AMpingcodex/lunaok9.71s12.2k$0.0024
Aug 21, 10:16:55 AMpingcodex/lunaok11.1s12.2k$0.0024
Aug 21, 1:00:08 AMpingcodex/lunaok8.54s12.2k
Aug 21, 12:00:10 AMpingcodex/lunaok8.59s12.2k
Aug 20, 11:00:09 PMpingcodex/lunaok9.19s12.2k
Aug 20, 10:00:07 PMpingcodex/lunaok8.67s12.2k
Aug 20, 9:00:06 PMpingcodex/lunaok8.51s12.2k
Aug 20, 8:00:07 PMpingcodex/lunaok8.96s12.2k
Aug 20, 7:00:05 PMpingcodex/lunaok9.01s12.2k
Aug 20, 6:00:07 PMpingcodex/lunaok8.39s12.2k
Aug 20, 5:00:11 PMpingcodex/lunaok5.16s10.6k
Aug 20, 4:00:06 PMpingcodex/lunaok6.71s10.6k
Aug 20, 3:00:10 PMpingcodex/lunaok7.25s12.2k
Aug 20, 2:00:10 PMpingcodex/lunaok7.71s12.2k
Aug 20, 1:00:06 PMpingcodex/lunaok7.88s12.2k
Aug 20, 12:00:09 PMpingcodex/lunaok9.57s12.2k
Aug 20, 11:00:08 AMpingcodex/lunaok9.20s12.2k
Aug 20, 10:00:05 AMpingcodex/lunaok7.21s10.8k
Aug 20, 9:00:06 AMpingcodex/lunaok11.1s12.2k
Aug 20, 8:00:06 AMpingcodex/lunaok11.6s12.2k
Aug 20, 7:00:06 AMpingcodex/lunaok6.67s12.2k
Aug 20, 6:00:06 AMpingcodex/lunaok7.32s12.2k
Aug 20, 5:00:05 AMpingcodex/lunaok8.30s12.2k
Aug 20, 4:45:07 AMpingcodex/lunaok7.75s12.2k
Aug 20, 4:30:07 AMpingcodex/lunaok11.8s12.2k
Aug 20, 4:15:07 AMpingcodex/lunaok7.79s12.2k
Aug 20, 4:00:06 AMpingcodex/lunaok7.18s12.2k
Aug 20, 3:45:06 AMpingcodex/lunaok7.71s12.2k
Aug 20, 3:30:06 AMpingcodex/lunaok11.5s12.2k
Aug 20, 3:15:07 AMpingcodex/lunaok6.15s12.2k
Aug 20, 3:00:06 AMpingcodex/lunaok8.79s12.2k
Aug 20, 2:45:09 AMpingcodex/lunaok8.42s12.2k
Aug 20, 2:30:05 AMpingcodex/lunaok10.9s12.2k
Aug 20, 1:30:07 AMpingcodex/lunaok9.61s12.2k
Aug 20, 1:15:09 AMpingcodex/lunaok13.6s12.2k
Aug 20, 1:00:06 AMpingcodex/lunaok11.2s12.2k
Aug 20, 12:45:08 AMpingcodex/lunaok12.6s12.2k
Aug 20, 12:30:09 AMpingcodex/lunaok8.19s10.7k
Aug 20, 12:03:30 AMpingcodex/lunaok7.05s9,361
Aug 20, 12:00:06 AMpingcodex/lunaok9.87s10.7k
Aug 19, 11:45:06 PMpingcodex/lunaok7.22s10.7k
Aug 19, 11:30:09 PMpingcodex/lunaok9.95s10.7k
Aug 19, 11:00:07 PMpingcodex/lunaok8.83s10.7k
Aug 19, 10:45:07 PMpingcodex/lunaok7.13s10.7k
Aug 19, 10:30:06 PMpingcodex/lunaok7.69s10.7k
Aug 19, 10:15:07 PMpingcodex/lunaok7.04s10.7k
Aug 19, 10:00:08 PMpingcodex/lunaok7.47s10.7k
Aug 19, 9:45:09 PMpingcodex/lunaok9.74s10.7k
Aug 19, 9:30:07 PMpingcodex/lunaok7.33s10.7k
Aug 19, 9:15:07 PMpingcodex/lunaok8.80s10.7k
Aug 19, 9:00:07 PMpingcodex/lunaok7.36s10.7k
Aug 19, 8:45:09 PMpingcodex/lunaok5.70s10.7k
Aug 19, 8:30:06 PMpingcodex/lunaok5.90s9,180
Aug 19, 8:15:05 PMpingcodex/lunaok8.01s10.7k
Aug 19, 8:00:05 PMpingcodex/lunaok9.28s10.7k
Aug 19, 7:45:09 PMpingcodex/lunaok6.16s10.7k
Aug 19, 7:30:06 PMpingcodex/lunaok8.19s10.7k
Aug 19, 7:15:06 PMpingcodex/lunaok11.7s10.7k
Aug 19, 7:00:06 PMpingcodex/lunaok6.94s10.7k
Aug 19, 6:45:08 PMpingcodex/lunaok8.23s11.0k
Aug 19, 6:30:06 PMpingcodex/lunaok8.91s11.0k
Aug 19, 6:15:07 PMpingcodex/lunaok6.65s11.0k
Aug 19, 6:00:05 PMpingcodex/lunaok7.25s11.0k
Aug 19, 5:45:06 PMpingcodex/lunaok5.75s9,361
Aug 19, 5:30:05 PMpingcodex/lunaok8.62s11.0k
Aug 19, 5:15:13 PMpingcodex/lunaok7.95s11.0k
Aug 19, 5:00:07 PMpingcodex/lunaok8.24s11.0k
Aug 19, 4:45:06 PMpingcodex/lunaok10.0s11.0k
Aug 19, 4:30:06 PMpingcodex/lunaok5.77s9,363
Aug 19, 4:15:06 PMpingcodex/lunaok8.14s11.0k
Aug 19, 4:00:06 PMpingcodex/lunaok7.95s11.0k
Aug 19, 3:45:12 PMpingcodex/lunaok9.07s11.0k
Aug 19, 3:30:05 PMpingcodex/lunaok8.38s11.0k
Aug 19, 3:15:06 PMpingcodex/lunaok9.02s11.0k
Aug 19, 3:00:07 PMpingcodex/lunaok10.2s11.0k
Aug 19, 2:45:06 PMpingcodex/lunaok8.02s11.0k
Aug 19, 2:30:06 PMpingcodex/lunaok10.9s11.0k
Aug 19, 2:15:06 PMpingcodex/lunaok8.94s11.0k
Aug 19, 2:00:07 PMpingcodex/lunaok8.05s11.0k
Aug 19, 1:45:07 PMpingcodex/lunaok7.18s11.0k
Aug 19, 1:30:05 PMpingcodex/lunaok8.14s11.0k
Aug 19, 1:15:06 PMpingcodex/lunaok7.67s11.0k
Aug 19, 1:00:06 PMpingcodex/lunaok8.72s11.0k
Aug 19, 12:45:07 PMpingcodex/lunaok7.42s11.0k
Aug 19, 12:30:06 PMpingcodex/lunaok8.42s11.0k
Aug 19, 12:00:07 PMpingcodex/lunaok6.11s11.0k
Aug 19, 11:45:08 AMpingcodex/lunaok7.53s11.0k
Aug 19, 11:30:07 AMpingcodex/lunaok6.15s11.0k
Aug 19, 11:15:06 AMpingcodex/lunaok9.88s11.0k
Aug 19, 11:00:06 AMpingcodex/lunaok8.48s11.0k
Aug 19, 10:45:08 AMpingcodex/lunaok8.26s11.0k
Aug 19, 10:30:06 AMpingcodex/lunaok10.9s11.0k
Aug 19, 10:15:05 AMpingcodex/lunaok8.32s11.0k
Aug 19, 10:00:06 AMpingcodex/lunaok8.49s11.0k
Aug 19, 9:45:06 AMpingcodex/lunaok8.32s11.0k
Aug 19, 9:30:06 AMpingcodex/lunaok8.88s11.0k
Aug 19, 9:15:07 AMpingcodex/lunaok8.04s11.0k
Aug 19, 9:00:07 AMpingcodex/lunaok6.10s9,361
Aug 19, 8:45:09 AMpingcodex/lunaok6.86s11.0k
Aug 19, 8:30:06 AMpingcodex/lunaok7.67s9,361
Aug 19, 8:15:08 AMpingcodex/lunaok5.00s9,363
Aug 19, 8:00:06 AMpingcodex/lunaok4.91s9,363
Aug 19, 7:45:06 AMpingcodex/lunaok5.62s9,361
Aug 19, 7:30:07 AMpingcodex/lunaok5.88s9,365
Aug 19, 7:15:05 AMpingcodex/lunaok5.90s9,361
Aug 19, 7:00:08 AMpingcodex/lunaok4.49s9,365
Aug 19, 6:45:07 AMpingcodex/lunaok4.57s9,363
Aug 19, 6:38:23 AMpingcodex/lunaok5.69s11.0k
Aug 19, 6:00:07 AMpingcodex/lunaok6.04s9,361
Aug 19, 5:38:40 AMpingcodex/lunaok4.41s9,365
Aug 19, 5:30:06 AMpingcodex/lunaok5.70s11.0k
Aug 19, 5:00:10 AMpingcodex/lunaok9.55s11.0k
Aug 19, 4:30:06 AMpingcodex/lunaok8.85s11.0k
Aug 19, 4:00:05 AMpingcodex/lunaok11.9s11.0k
Aug 19, 3:30:05 AMpingcodex/lunaok8.96s11.0k
Aug 19, 3:00:07 AMpingcodex/lunaok13.7s11.0k
Aug 19, 2:30:05 AMpingcodex/lunaok8.63s9,153
Aug 19, 2:00:05 AMpingcodex/lunaok9.97s11.0k
Aug 19, 1:30:03 AMpingcodex/lunaok8.76s11.0k
Aug 19, 1:00:05 AMpingcodex/lunaok7.14s11.0k
Aug 19, 12:30:48 AMpingcodex/lunaok5.20s9,363
Aug 19, 12:00:03 AMpingcodex/lunaReading additional input from stdin... 2026-08-19T04:00:09.849792Z ERROR codex_rmcp_client::oauth::refresh_transaction: error=failed to refresh OAuth tokens for server cloudflare-apiauth6.63s11.0k
Aug 18, 11:30:04 PMpingcodex/lunaok10.3s11.0k
Aug 18, 11:00:03 PMpingcodex/lunaReading additional input from stdin... 2026-08-19T03:00:15.094076Z ERROR codex_rmcp_client::oauth::refresh_transaction: error=failed to refresh OAuth tokens for server cloudflare-apiauth11.4s11.0k
Aug 18, 10:30:05 PMpingcodex/lunaok10.7s11.0k
Aug 18, 10:00:04 PMpingcodex/lunaok7.12s11.0k
Aug 18, 9:30:05 PMpingcodex/lunaok6.43s11.0k
Aug 18, 9:00:03 PMpingcodex/lunaok9.28s11.0k
Aug 18, 8:30:04 PMpingcodex/lunaok3.61s9,182
Aug 18, 8:00:04 PMpingcodex/lunaReading additional input from stdin... 2026-08-19T00:00:12.301038Z ERROR codex_rmcp_client::oauth::refresh_transaction: error=failed to refresh OAuth tokens for server cloudflare-apiauth7.58s11.0k
Aug 18, 7:30:03 PMpingcodex/lunaok9.57s10.2k
Aug 18, 7:13:10 PMpingcodex/lunaok10.5s10.2k
Aug 18, 7:00:04 PMpingcodex/codexok15.9s16.4k
Aug 18, 6:30:06 PMpingcodex/codexok10.4s16.4k
Aug 18, 6:00:08 PMpingcodex/codexok14.5s16.4k
Aug 18, 5:30:06 PMpingcodex/codexok8.94s16.4k
Aug 18, 5:10:38 PMpingcodex/codexok9.30s16.4k
Aug 18, 5:00:04 PMpingcodex/codexok7.00s5
Aug 18, 4:00:07 PMpingcodex/codexok9.83s5
Aug 18, 3:00:07 PMpingcodex/codexok8.81s5
Aug 18, 2:00:13 PMpingcodex/codexok11.7s5
Aug 18, 1:04:24 PMpingcodex/codexok11.3s5
Aug 18, 12:00:07 PMpingcodex/codexok10.8s5
Aug 18, 11:00:07 AMpingcodex/codexok8.81s5

Showing 200 of 207 filtered samples · 2383 in the full window. Same rows as JSON: /api/probes · /api/speed · /api/runs

Read next