Raw data
Logs
Every check our lab has saved: the good ones, the failed ones, and the tokens they cost us. This is the ledger behind every board on the site.
What our lab spent
Tokens the paid apps reported back to us for our own test runs. A token is a small chunk of text, about four letters. Total is new input + cache + output.
Pick a time window
Every count on this page follows the window you pick here. The default is the last 24 hours. 30d is as far back as we serve.
Total tokens · last 720 hours
10,916,860
1581 samples · Claude API-eq $8.0195 · not our bill (see note)
How to read this
Cost is a price some apps report with each answer — what the same work would cost at API rates. It is not our bill; we pay flat monthly plans, and Codex reports no figure at all. Quotas are a different thing, and we cannot see them.
How to read this
New in is uncached prompt tokens. Cache is cache reads plus writes — cheaper, but still usage. Out is everything the model wrote, including think. Total adds those three. Bigger is not better here. It is what our own testing used.
By app
| Split | n | New in | Cache | Out | Total |
|---|---|---|---|---|---|
| Codex | 634 | 5.58M | 1.22M | 120.9k | 6.92M |
| Grok Build | 315 | 3.17M | 65.5k | 62.0k | 3.30M |
| Claude Code | 632 | 267.9k | 261.4k | 168.0k | 697.4k |
By check
| Split | n | New in | Cache | Out | Total |
|---|---|---|---|---|---|
| speed | 1170 | 6.55M | 1.31M | 337.9k | 8.20M |
| ping | 411 | 2.47M | 231.3k | 13.0k | 2.72M |
By model
| Split | n | New in | Cache | Out | Total |
|---|---|---|---|---|---|
| GPT-5.6 Luna | 261 | 2.73M | 37.6k | 34.0k | 2.80M |
| Grok 4.6 | 211 | 2.04M | 47.9k | 33.4k | 2.13M |
| GPT-5.6 Terra | 131 | 936.5k | 574.7k | 31.6k | 1.54M |
| GPT-5.6 Sol | 116 | 1.20M | 120.8k | 28.2k | 1.35M |
| Grok 4.5 | 104 | 1.13M | 17.7k | 28.6k | 1.17M |
| GPT-5.5 | 104 | 688.0k | 424.4k | 27.1k | 1.14M |
| Haiku 4.5 | 268 | 167.3k | 36.1k | 84.4k | 287.7k |
| claude | 19 | 10 | 144.0k | 76 | 144.1k |
| Sonnet 5 | 119 | 35.8k | 44.3k | 29.1k | 109.1k |
| codex | 19 | 22.0k | 60.2k | 90 | 82.2k |
| Fable 5 | 113 | 32.5k | 19.1k | 27.2k | 78.8k |
| Opus 5 | 113 | 32.4k | 17.9k | 27.2k | 77.5k |
| GPT-5.2 | 3 | 0 | 0 | 0 | 0 |
Test runs
159 launches in this window · 82 failed samples. Open a run to see every model it touched and what that cost.
Aug 21, 1:00:00 AMpulsescheduled1m 43s · 13 rec · 0 skip · 5 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | rate limit warningserved with a rate limit warning: seven_day at 0.29 utilization | 4.99s | 250 | 0 | 133 | 383 |
| pingcodex | ok | 8.54s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.29s | 9,435 | 512 | 30 | 9,977 |
| speedclaude/haiku | rate limit warningserved with a rate limit warning: seven_day at 0.29 utilization | 6.29s | 272 | 0 | 543 | 815 |
| speedclaude/sonnet | rate limit warningserved with a rate limit warning: seven_day at 0.29 utilization | 6.93s | 322 | 0 | 241 | 563 |
| speedclaude/opus | rate limit warningserved with a rate limit warning: seven_day at 0.29 utilization | 6.15s | 306 | 0 | 241 | 547 |
| speedclaude/fable | rate limit warningserved with a rate limit warning: seven_day at 0.29 utilization | 7.42s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.7s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.4s | 12.3k | 0 | 254 | 12.6k |
| speedcodex/sol | ok | 9.63s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.3s | 11.4k | 0 | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 7.28s | 12.3k | 128 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 5.68s | 12.1k | 256 | 283 | 12.7k |
Aug 21, 12:00:00 AMpulsescheduled1m 44s · 13 rec · 0 skip · 5 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | rate limit warningserved with a rate limit warning: seven_day at 0.28 utilization | 6.91s | 250 | 0 | 130 | 380 |
| pingcodex | ok | 8.59s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.14s | 9,691 | 256 | 18 | 9,965 |
| speedclaude/haiku | rate limit warningserved with a rate limit warning: seven_day at 0.28 utilization | 6.09s | 272 | 0 | 558 | 830 |
| speedclaude/sonnet | rate limit warningserved with a rate limit warning: seven_day at 0.28 utilization | 6.91s | 322 | 0 | 241 | 563 |
| speedclaude/opus | rate limit warningserved with a rate limit warning: seven_day at 0.28 utilization | 6.79s | 306 | 0 | 241 | 547 |
| speedclaude/fable | rate limit warningserved with a rate limit warning: seven_day at 0.28 utilization | 7.16s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.8s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 9.05s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/sol | ok | 9.49s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.63s | 11.4k | 0 | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 6.92s | 12.1k | 256 | 294 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.09s | 12.1k | 256 | 280 | 12.7k |
Aug 20, 11:00:02 PMpulsescheduled1m 35s · 10 rec · 3 skip · 5 fail · 64.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | rate limit warningserved with a rate limit warning: seven_day at 0.26 utilization | 4.20s | 250 | 0 | 85 | 335 |
| pingcodex | ok | 9.19s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | skipped · subscription auth missing | — | — | — | — | — |
| speedclaude/haiku | rate limit warningserved with a rate limit warning: seven_day at 0.26 utilization | 11.7s | 272 | 0 | 531 | 803 |
| speedclaude/sonnet | rate limit warningserved with a rate limit warning: seven_day at 0.26 utilization | 6.57s | 322 | 0 | 241 | 563 |
| speedclaude/opus | rate limit warningserved with a rate limit warning: seven_day at 0.26 utilization | 8.12s | 306 | 0 | 241 | 547 |
| speedclaude/fable | rate limit warningserved with a rate limit warning: seven_day at 0.26 utilization | 7.68s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 14.4s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 9.83s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 9.71s | 10.6k | 1,792 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.4s | 11.4k | 0 | 254 | 11.6k |
| speedgrok/grok-4.6 | skipped · subscription auth missing | — | — | — | — | — |
| speedgrok/grok-4.5 | skipped · subscription auth missing | — | — | — | — | — |
Aug 20, 10:00:00 PMpulsescheduled2m 8s · 13 rec · 0 skip · 0 fail · 101.0k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.56s | 250 | 0 | 44 | 294 |
| pingcodex | ok | 8.67s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.24s | 9,948 | 0 | 30 | 9,978 |
| speedclaude/haiku | ok | 10.3s | 272 | 0 | 552 | 824 |
| speedclaude/sonnet | ok | 7.47s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.45s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.41s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 14.9s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 12.4s | 9,535 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 15.8s | 5,439 | 6,912 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 12.9s | 12.8k | 0 | 267 | 13.0k |
| speedgrok/grok-4.6 | ok | 7.59s | 12.2k | 256 | 313 | 12.7k |
| speedgrok/grok-4.5 | ok | 8.33s | 11.9k | 512 | 283 | 12.7k |
Aug 20, 9:44:13 PMpulsecatch-up4.02s · 0 rec · 13 skip · 0 fail · 0 tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | skipped · already recorded this slot | — | — | — | — | — |
| pingcodex | skipped · already recorded this slot | — | — | — | — | — |
| pinggrok | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/haiku | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/sonnet | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/opus | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/fable | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/luna | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/terra | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/sol | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/gpt-5.5 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.6 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.5 | skipped · already recorded this slot | — | — | — | — | — |
Aug 20, 9:00:00 PMpulsescheduled1m 54s · 13 rec · 0 skip · 0 fail · 99.4k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.62s | 250 | 0 | 62 | 312 |
| pingcodex | ok | 8.51s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.50s | 9,436 | 512 | 30 | 9,978 |
| speedclaude/haiku | ok | 8.82s | 272 | 0 | 545 | 817 |
| speedclaude/sonnet | ok | 7.17s | 322 | 0 | 261 | 583 |
| speedclaude/opus | ok | 8.38s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.90s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 13.7s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 11.6s | 5,437 | 6,912 | 254 | 12.6k |
| speedcodex/sol | ok | 10.9s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 8.86s | 11.2k | 0 | 265 | 11.5k |
| speedgrok/grok-4.6 | ok | 7.20s | 12.2k | 256 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.68s | 12.2k | 256 | 283 | 12.7k |
Aug 20, 8:00:00 PMpulsescheduled1m 54s · 13 rec · 0 skip · 0 fail · 99.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.79s | 250 | 0 | 43 | 293 |
| pingcodex | ok | 8.96s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.53s | 9,564 | 384 | 17 | 9,965 |
| speedclaude/haiku | ok | 9.08s | 272 | 0 | 559 | 831 |
| speedclaude/sonnet | ok | 7.44s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 6.86s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.58s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 14.0s | 12.2k | 0 | 255 | 12.4k |
| speedcodex/terra | ok | 10.6s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 9.26s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.4s | 11.4k | 0 | 257 | 11.7k |
| speedgrok/grok-4.6 | ok | 7.42s | 12.2k | 256 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 7.86s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 7:00:00 PMpulsescheduled1m 54s · 13 rec · 0 skip · 0 fail · 99.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.27s | 250 | 0 | 97 | 347 |
| pingcodex | ok | 9.01s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 4.47s | 9,691 | 256 | 17 | 9,964 |
| speedclaude/haiku | ok | 8.90s | 272 | 0 | 545 | 817 |
| speedclaude/sonnet | ok | 8.66s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 7.96s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.52s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 13.9s | 12.2k | 0 | 261 | 12.4k |
| speedcodex/terra | ok | 11.6s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/sol | ok | 10.3s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 11.8s | 633 | 10.8k | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 6.01s | 12.3k | 128 | 297 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.60s | 11.9k | 512 | 287 | 12.7k |
Aug 20, 6:00:00 PMpulsescheduled1m 53s · 13 rec · 0 skip · 0 fail · 98.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 5.08s | 250 | 0 | 98 | 348 |
| pingcodex | ok | 8.39s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.16s | 9,692 | 256 | 30 | 9,978 |
| speedclaude/haiku | ok | 11.0s | 272 | 0 | 881 | 1,153 |
| speedclaude/sonnet | ok | 7.57s | 322 | 0 | 270 | 592 |
| speedclaude/opus | ok | 7.19s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.67s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.3s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 9.38s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 9.08s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.20s | 635 | 10.8k | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 7.70s | 12.2k | 256 | 295 | 12.7k |
| speedgrok/grok-4.5 | ok | 10.3s | 12.3k | 128 | 283 | 12.7k |
Aug 20, 5:00:00 PMpulsescheduled1m 54s · 13 rec · 0 skip · 0 fail · 96.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 5.69s | 250 | 0 | 98 | 348 |
| pingcodex | ok | 5.16s | 10.6k | 0 | 5 | 10.6k |
| pinggrok | ok | 6.82s | 9,690 | 256 | 30 | 9,976 |
| speedclaude/haiku | ok | 9.65s | 272 | 0 | 533 | 805 |
| speedclaude/sonnet | ok | 7.22s | 322 | 0 | 255 | 577 |
| speedclaude/opus | ok | 5.80s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.01s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 11.9s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 9.60s | 5,435 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 10.5s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 13.5s | 9,855 | 1,536 | 269 | 11.7k |
| speedgrok/grok-4.6 | ok | 6.28s | 12.4k | 0 | 309 | 12.7k |
| speedgrok/grok-4.5 | ok | 7.62s | 11.9k | 512 | 283 | 12.7k |
Aug 20, 4:00:00 PMpulsescheduled1m 56s · 13 rec · 0 skip · 0 fail · 96.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.64s | 250 | 0 | 111 | 361 |
| pingcodex | ok | 6.71s | 10.6k | 0 | 5 | 10.6k |
| pinggrok | ok | 4.61s | 9,435 | 512 | 17 | 9,964 |
| speedclaude/haiku | ok | 8.82s | 272 | 0 | 553 | 825 |
| speedclaude/sonnet | ok | 6.88s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.31s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.13s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.7s | 10.8k | 0 | 260 | 11.0k |
| speedcodex/terra | ok | 10.4s | 5,435 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 14.0s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.0s | 11.4k | 0 | 258 | 11.6k |
| speedgrok/grok-4.6 | ok | 6.77s | 12.3k | 128 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 14.0s | 12.4k | 0 | 280 | 12.7k |
Aug 20, 3:00:00 PMpulsescheduled1m 53s · 13 rec · 0 skip · 0 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 7.36s | 250 | 0 | 73 | 323 |
| pingcodex | ok | 7.25s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.60s | 9,435 | 512 | 28 | 9,975 |
| speedclaude/haiku | ok | 9.50s | 272 | 0 | 533 | 805 |
| speedclaude/sonnet | ok | 7.26s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 6.59s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.33s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.7s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.8s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 9.74s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.4s | 11.4k | 0 | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 6.15s | 11.9k | 512 | 294 | 12.7k |
| speedgrok/grok-4.5 | ok | 8.99s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 2:00:00 PMpulsescheduled2m 1s · 13 rec · 0 skip · 0 fail · 99.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 7.75s | 250 | 0 | 108 | 358 |
| pingcodex | ok | 7.71s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 8.83s | 9,435 | 512 | 30 | 9,977 |
| speedclaude/haiku | ok | 9.47s | 272 | 0 | 573 | 845 |
| speedclaude/sonnet | ok | 7.00s | 322 | 0 | 254 | 576 |
| speedclaude/opus | ok | 7.19s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.83s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 12.7s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.7s | 5,435 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 9.73s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 13.2s | 12.8k | 0 | 262 | 13.0k |
| speedgrok/grok-4.6 | ok | 7.94s | 12.1k | 256 | 294 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.64s | 11.9k | 512 | 280 | 12.7k |
Aug 20, 1:00:00 PMpulsescheduled1m 59s · 13 rec · 0 skip · 0 fail · 99.5k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.46s | 250 | 0 | 80 | 330 |
| pingcodex | ok | 7.88s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 12.3s | 9,946 | 0 | 17 | 9,963 |
| speedclaude/haiku | ok | 8.69s | 272 | 0 | 527 | 799 |
| speedclaude/sonnet | ok | 8.11s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 6.97s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.42s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 11.0s | 4,903 | 5,888 | 253 | 11.0k |
| speedcodex/terra | ok | 12.0s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 14.3s | 13.7k | 0 | 243 | 14.0k |
| speedcodex/gpt-5.5 | ok | 9.77s | 11.4k | 0 | 266 | 11.7k |
| speedgrok/grok-4.6 | ok | 6.05s | 12.1k | 256 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.97s | 12.2k | 128 | 283 | 12.7k |
Aug 20, 12:00:00 PMpulsescheduled2m 2s · 13 rec · 0 skip · 0 fail · 99.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.47s | 250 | 0 | 81 | 331 |
| pingcodex | ok | 9.57s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.44s | 9,436 | 512 | 30 | 9,978 |
| speedclaude/haiku | ok | 9.62s | 272 | 0 | 553 | 825 |
| speedclaude/sonnet | ok | 7.78s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.72s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.61s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 14.1s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 13.8s | 5,439 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 11.1s | 10.6k | 1,792 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 11.0s | 11.4k | 0 | 256 | 11.6k |
| speedgrok/grok-4.6 | ok | 5.86s | 12.4k | 0 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.40s | 12.3k | 128 | 287 | 12.7k |
Aug 20, 11:00:00 AMpulsescheduled1m 57s · 13 rec · 0 skip · 0 fail · 99.4k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 6.42s | 250 | 0 | 48 | 298 |
| pingcodex | ok | 9.20s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.10s | 9,434 | 512 | 17 | 9,963 |
| speedclaude/haiku | ok | 8.89s | 272 | 0 | 530 | 802 |
| speedclaude/sonnet | ok | 7.70s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.23s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 9.05s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 14.5s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 10.4s | 5,433 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 12.4s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.74s | 11.4k | 0 | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 8.61s | 12.1k | 256 | 296 | 12.7k |
| speedgrok/grok-4.5 | ok | 4.99s | 12.0k | 384 | 287 | 12.7k |
Aug 20, 10:00:00 AMpulsescheduled2m 1s · 13 rec · 0 skip · 0 fail · 99.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.11s | 250 | 0 | 38 | 288 |
| pingcodex | ok | 7.21s | 10.8k | 0 | 5 | 10.8k |
| pinggrok | ok | 6.08s | 9,436 | 512 | 28 | 9,976 |
| speedclaude/haiku | ok | 9.25s | 272 | 0 | 546 | 818 |
| speedclaude/sonnet | ok | 7.84s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.43s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.58s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 13.0s | 6,282 | 5,888 | 254 | 12.4k |
| speedcodex/terra | ok | 12.7s | 6,816 | 6,912 | 243 | 14.0k |
| speedcodex/sol | ok | 10.8s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 11.8s | 635 | 10.8k | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 6.47s | 12.4k | 0 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 13.4s | 12.2k | 256 | 292 | 12.7k |
Aug 20, 9:00:00 AMpulsescheduled1m 55s · 13 rec · 0 skip · 0 fail · 99.5k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.10s | 250 | 0 | 42 | 292 |
| pingcodex | ok | 11.1s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.81s | 9,435 | 512 | 17 | 9,964 |
| speedclaude/haiku | ok | 9.42s | 272 | 0 | 561 | 833 |
| speedclaude/sonnet | ok | 7.75s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 9.00s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.02s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 11.9s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 9.64s | 5,435 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 10.9s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 11.0s | 11.4k | 0 | 264 | 11.6k |
| speedgrok/grok-4.6 | ok | 5.30s | 12.1k | 256 | 286 | 12.7k |
| speedgrok/grok-4.5 | ok | 7.19s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 8:00:00 AMpulsescheduled1m 58s · 13 rec · 0 skip · 0 fail · 99.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.84s | 250 | 0 | 37 | 287 |
| pingcodex | ok | 11.6s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.10s | 9,692 | 256 | 29 | 9,977 |
| speedclaude/haiku | ok | 9.01s | 272 | 0 | 530 | 802 |
| speedclaude/sonnet | ok | 6.63s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 7.51s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.51s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 13.8s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 10.4s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 12.4s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 12.7s | 11.4k | 0 | 268 | 11.7k |
| speedgrok/grok-4.6 | ok | 6.49s | 11.9k | 512 | 283 | 12.7k |
| speedgrok/grok-4.5 | ok | 5.79s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 7:00:00 AMpulsescheduled1m 51s · 13 rec · 0 skip · 0 fail · 99.5k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 3.86s | 250 | 0 | 43 | 293 |
| pingcodex | ok | 6.67s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.99s | 9,947 | 0 | 30 | 9,977 |
| speedclaude/haiku | ok | 8.46s | 272 | 0 | 533 | 805 |
| speedclaude/sonnet | ok | 9.22s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.14s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.07s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 12.0s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 10.5s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/sol | ok | 9.20s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.6s | 11.4k | 0 | 264 | 11.7k |
| speedgrok/grok-4.6 | ok | 7.40s | 12.4k | 0 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 8.00s | 12.3k | 128 | 287 | 12.7k |
Aug 20, 6:00:00 AMpulsescheduled5m 38s · 13 rec · 0 skip · 0 fail · 99.6k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.45s | 250 | 0 | 76 | 326 |
| pingcodex | ok | 7.32s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 2m 60s | 9,947 | 0 | 17 | 9,964 |
| speedclaude/haiku | ok | 8.94s | 272 | 0 | 552 | 824 |
| speedclaude/sonnet | ok | 8.98s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 7.20s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 9.78s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 15.7s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 13.0s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/sol | ok | 9.93s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.3s | 11.4k | 0 | 273 | 11.7k |
| speedgrok/grok-4.6 | ok | 52.8s | 12.3k | 128 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 7.13s | 12.1k | 256 | 283 | 12.7k |
Aug 20, 5:00:00 AMpulsescheduled1m 49s · 13 rec · 0 skip · 0 fail · 98.1k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.12s | 250 | 0 | 51 | 301 |
| pingcodex | ok | 8.30s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.71s | 9,947 | 0 | 17 | 9,964 |
| speedclaude/haiku | ok | 8.95s | 272 | 0 | 530 | 802 |
| speedclaude/sonnet | ok | 7.03s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.63s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 6.96s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 9.79s | 10.8k | 0 | 263 | 11.1k |
| speedcodex/terra | ok | 12.9s | 9,531 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 11.4s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.93s | 11.4k | 0 | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 7.26s | 12.3k | 128 | 294 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.47s | 12.3k | 128 | 283 | 12.7k |
Aug 20, 4:49:38 AMpulsecatch-up2.56s · 0 rec · 13 skip · 0 fail · 0 tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | skipped · already recorded this slot | — | — | — | — | — |
| pingcodex | skipped · already recorded this slot | — | — | — | — | — |
| pinggrok | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/haiku | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/sonnet | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/opus | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/fable | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/luna | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/terra | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/sol | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/gpt-5.5 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.6 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.5 | skipped · already recorded this slot | — | — | — | — | — |
Aug 20, 4:49:34 AMpulsecatch-up1.68s · 0 rec · 13 skip · 0 fail · 0 tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | skipped · already recorded this slot | — | — | — | — | — |
| pingcodex | skipped · already recorded this slot | — | — | — | — | — |
| pinggrok | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/haiku | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/sonnet | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/opus | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/fable | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/luna | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/terra | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/sol | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/gpt-5.5 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.6 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.5 | skipped · already recorded this slot | — | — | — | — | — |
Aug 20, 4:45:00 AMpulsescheduled1m 47s · 13 rec · 0 skip · 0 fail · 98.3k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 5.24s | 250 | 0 | 83 | 333 |
| pingcodex | ok | 7.75s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.03s | 9,820 | 128 | 29 | 9,977 |
| speedclaude/haiku | ok | 9.30s | 272 | 0 | 550 | 822 |
| speedclaude/sonnet | ok | 6.80s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 8.00s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.38s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 9.84s | 10.8k | 0 | 260 | 11.1k |
| speedcodex/terra | ok | 9.35s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/sol | ok | 11.3s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.3s | 635 | 10.8k | 273 | 11.7k |
| speedgrok/grok-4.6 | ok | 6.18s | 12.4k | 0 | 295 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.59s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 4:30:00 AMpulsescheduled1m 57s · 13 rec · 0 skip · 0 fail · 98.1k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 5.06s | 250 | 0 | 80 | 330 |
| pingcodex | ok | 11.8s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.40s | 9,818 | 128 | 18 | 9,964 |
| speedclaude/haiku | ok | 10.3s | 272 | 0 | 557 | 829 |
| speedclaude/sonnet | ok | 9.11s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.15s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 10.0s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.6s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.4s | 12.3k | 0 | 254 | 12.6k |
| speedcodex/sol | ok | 10.4s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.72s | 633 | 10.8k | 266 | 11.7k |
| speedgrok/grok-4.6 | ok | 6.32s | 11.9k | 512 | 287 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.29s | 12.4k | 0 | 280 | 12.7k |
Aug 20, 4:15:00 AMpulsescheduled1m 53s · 13 rec · 0 skip · 0 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.19s | 250 | 0 | 79 | 329 |
| pingcodex | ok | 7.79s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.24s | 9,436 | 512 | 18 | 9,966 |
| speedclaude/haiku | ok | 10.0s | 272 | 0 | 549 | 821 |
| speedclaude/sonnet | ok | 7.96s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 6.47s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.39s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 8.96s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 12.2s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/sol | ok | 10.9s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 13.3s | 635 | 10.8k | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 7.09s | 12.4k | 0 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.33s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 4:00:00 AMpulsescheduled1m 47s · 13 rec · 0 skip · 1 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.46s | 250 | 0 | 43 | 293 |
| pingcodex | ok | 7.18s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.09s | 9,436 | 512 | 29 | 9,977 |
| speedclaude/haiku | ok | 9.10s | 272 | 0 | 531 | 803 |
| speedclaude/sonnet | ok | 7.79s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.61s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.10s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.6s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | wrong answerReading additional input from stdin... | 9.48s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/sol | ok | 10.6s | 5,437 | 6,912 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 11.0s | 11.4k | 0 | 272 | 11.7k |
| speedgrok/grok-4.6 | ok | 6.05s | 12.2k | 256 | 296 | 12.7k |
| speedgrok/grok-4.5 | ok | 5.87s | 12.3k | 128 | 283 | 12.7k |
Aug 20, 3:45:00 AMpulsescheduled1m 49s · 13 rec · 0 skip · 0 fail · 98.1k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.02s | 250 | 0 | 97 | 347 |
| pingcodex | ok | 7.71s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 4.89s | 9,690 | 256 | 30 | 9,976 |
| speedclaude/haiku | ok | 9.54s | 272 | 0 | 531 | 803 |
| speedclaude/sonnet | ok | 7.10s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.63s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 6.84s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 10.1s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.5s | 9,531 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 10.1s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.57s | 11.4k | 0 | 262 | 11.6k |
| speedgrok/grok-4.6 | ok | 11.2s | 11.9k | 512 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.04s | 12.2k | 128 | 285 | 12.7k |
Aug 20, 3:30:00 AMpulsescheduled1m 56s · 13 rec · 0 skip · 0 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.63s | 250 | 0 | 114 | 364 |
| pingcodex | ok | 11.5s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.57s | 9,435 | 512 | 29 | 9,976 |
| speedclaude/haiku | ok | 8.81s | 272 | 0 | 531 | 803 |
| speedclaude/sonnet | ok | 7.27s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.86s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 11.8s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 8.94s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.3s | 9,531 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 11.0s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.83s | 9,849 | 1,536 | 266 | 11.7k |
| speedgrok/grok-4.6 | ok | 9.49s | 12.4k | 0 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 5.80s | 12.3k | 128 | 285 | 12.7k |
Aug 20, 3:15:00 AMpulsescheduled1m 54s · 13 rec · 0 skip · 0 fail · 98.3k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.80s | 250 | 0 | 97 | 347 |
| pingcodex | ok | 6.15s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.22s | 9,692 | 256 | 29 | 9,977 |
| speedclaude/haiku | ok | 9.61s | 272 | 0 | 544 | 816 |
| speedclaude/sonnet | ok | 8.19s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 7.31s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 11.8s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 9.37s | 10.8k | 0 | 258 | 11.0k |
| speedcodex/terra | ok | 11.8s | 9,533 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 9.39s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 10.4s | 11.4k | 0 | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 9.23s | 12.4k | 0 | 305 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.38s | 12.4k | 0 | 280 | 12.7k |
Aug 20, 3:00:00 AMpulsescheduled2m 5s · 13 rec · 0 skip · 0 fail · 99.5k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.39s | 250 | 0 | 84 | 334 |
| pingcodex | ok | 8.79s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.02s | 8,795 | 1,152 | 28 | 9,975 |
| speedclaude/haiku | ok | 9.06s | 272 | 0 | 529 | 801 |
| speedclaude/sonnet | ok | 7.68s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.41s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 12.4s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 9.80s | 10.8k | 0 | 255 | 11.0k |
| speedcodex/terra | ok | 11.6s | 10.9k | 2,816 | 243 | 14.0k |
| speedcodex/sol | ok | 9.14s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.67s | 635 | 10.8k | 254 | 11.6k |
| speedgrok/grok-4.6 | ok | 7.19s | 12.3k | 128 | 287 | 12.7k |
| speedgrok/grok-4.5 | ok | 19.9s | 12.3k | 128 | 285 | 12.7k |
Aug 20, 2:45:00 AMpulsescheduled1m 56s · 13 rec · 0 skip · 0 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 7.40s | 250 | 0 | 170 | 420 |
| pingcodex | ok | 8.42s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.51s | 9,691 | 256 | 29 | 9,976 |
| speedclaude/haiku | ok | 9.06s | 272 | 0 | 549 | 821 |
| speedclaude/sonnet | ok | 8.37s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.15s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.83s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 12.0s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.8s | 9,531 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 10.7s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.56s | 11.4k | 0 | 254 | 11.6k |
| speedgrok/grok-4.6 | ok | 6.76s | 12.1k | 256 | 283 | 12.7k |
| speedgrok/grok-4.5 | ok | 7.04s | 12.3k | 128 | 283 | 12.7k |
Aug 20, 2:33:09 AMpulsecatch-up1.64s · 0 rec · 13 skip · 0 fail · 0 tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | skipped · already recorded this slot | — | — | — | — | — |
| pingcodex | skipped · already recorded this slot | — | — | — | — | — |
| pinggrok | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/haiku | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/sonnet | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/opus | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/fable | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/luna | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/terra | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/sol | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/gpt-5.5 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.6 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.5 | skipped · already recorded this slot | — | — | — | — | — |
Aug 20, 2:32:02 AMpulsecatch-up1.59s · 0 rec · 13 skip · 0 fail · 0 tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | skipped · already recorded this slot | — | — | — | — | — |
| pingcodex | skipped · already recorded this slot | — | — | — | — | — |
| pinggrok | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/haiku | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/sonnet | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/opus | skipped · already recorded this slot | — | — | — | — | — |
| speedclaude/fable | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/luna | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/terra | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/sol | skipped · already recorded this slot | — | — | — | — | — |
| speedcodex/gpt-5.5 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.6 | skipped · already recorded this slot | — | — | — | — | — |
| speedgrok/grok-4.5 | skipped · already recorded this slot | — | — | — | — | — |
Aug 20, 2:29:59 AMpulsecatch-up1m 48s · 13 rec · 0 skip · 0 fail · 98.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.47s | 250 | 0 | 42 | 292 |
| pingcodex | ok | 10.9s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 4.87s | 9,436 | 512 | 17 | 9,965 |
| speedclaude/haiku | ok | 8.89s | 272 | 0 | 546 | 818 |
| speedclaude/sonnet | ok | 7.99s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.25s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 6.98s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 9.51s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | ok | 10.9s | 5,437 | 6,912 | 254 | 12.6k |
| speedcodex/sol | ok | 9.78s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 9.87s | 11.4k | 0 | 256 | 11.6k |
| speedgrok/grok-4.6 | ok | 6.34s | 12.2k | 256 | 294 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.52s | 11.9k | 512 | 285 | 12.7k |
Aug 20, 1:30:00 AMpulsescheduled2m 7s · 13 rec · 0 skip · 0 fail · 99.5k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.58s | 250 | 0 | 42 | 292 |
| pingcodex | ok | 9.61s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 9.44s | 9,947 | 0 | 18 | 9,965 |
| speedclaude/haiku | ok | 10.2s | 272 | 0 | 533 | 805 |
| speedclaude/sonnet | ok | 8.41s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 10.8s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.30s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 12.1s | 10.8k | 0 | 255 | 11.0k |
| speedcodex/terra | ok | 10.8s | 672 | 13.1k | 243 | 14.0k |
| speedcodex/sol | ok | 11.2s | 10.6k | 1,792 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 11.0s | 11.4k | 0 | 263 | 11.7k |
| speedgrok/grok-4.6 | ok | 7.56s | 12.1k | 256 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 8.20s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 1:15:00 AMpulsescheduled2m 12s · 13 rec · 0 skip · 0 fail · 102.3k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.36s | 250 | 0 | 83 | 333 |
| pingcodex | ok | 13.6s | 12.1k | 0 | 5 | 12.2k |
| pinggrok | ok | 6.23s | 9,691 | 256 | 17 | 9,964 |
| speedclaude/haiku | ok | 11.1s | 272 | 0 | 546 | 818 |
| speedclaude/sonnet | ok | 7.98s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.89s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 9.88s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 11.5s | 10.8k | 0 | 260 | 11.0k |
| speedcodex/terra | ok | 11.4s | 10.9k | 2,816 | 243 | 14.0k |
| speedcodex/sol | ok | 12.8s | 13.7k | 0 | 243 | 14.0k |
| speedcodex/gpt-5.5 | ok | 14.3s | 12.8k | 0 | 257 | 13.0k |
| speedgrok/grok-4.6 | ok | 6.82s | 12.1k | 256 | 294 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.89s | 12.3k | 128 | 280 | 12.7k |
Aug 20, 1:00:00 AMpulsescheduled2m 2s · 13 rec · 0 skip · 1 fail · 102.3k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.71s | 250 | 0 | 93 | 343 |
| pingcodex | ok | 11.2s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 5.41s | 9,436 | 512 | 18 | 9,966 |
| speedclaude/haiku | ok | 9.82s | 272 | 0 | 543 | 815 |
| speedclaude/sonnet | ok | 7.56s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.46s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 8.14s | 307 | 0 | 241 | 548 |
| speedcodex/luna | ok | 9.44s | 10.8k | 0 | 254 | 11.0k |
| speedcodex/terra | wrong answerReading additional input from stdin... | 9.87s | 6,816 | 6,912 | 151 | 13.9k |
| speedcodex/sol | ok | 12.0s | 13.7k | 0 | 243 | 14.0k |
| speedcodex/gpt-5.5 | ok | 12.6s | 996 | 11.8k | 263 | 13.0k |
| speedgrok/grok-4.6 | ok | 6.98s | 12.3k | 128 | 293 | 12.7k |
| speedgrok/grok-4.5 | ok | 11.7s | 12.3k | 128 | 283 | 12.7k |
Aug 20, 12:45:00 AMpulsescheduled2m 13s · 13 rec · 0 skip · 0 fail · 101.0k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 5.49s | 250 | 0 | 63 | 313 |
| pingcodex | ok | 12.6s | 12.2k | 0 | 5 | 12.2k |
| pinggrok | ok | 4.89s | 9,435 | 512 | 30 | 9,977 |
| speedclaude/haiku | ok | 10.1s | 272 | 0 | 621 | 893 |
| speedclaude/sonnet | ok | 7.10s | 322 | 0 | 265 | 587 |
| speedclaude/opus | ok | 7.18s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 12.7s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 11.2s | 12.2k | 0 | 254 | 12.4k |
| speedcodex/terra | ok | 11.2s | 9,533 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 10.8s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 13.5s | 11.2k | 1,536 | 254 | 13.0k |
| speedgrok/grok-4.6 | ok | 16.0s | 12.4k | 0 | 283 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.42s | 12.3k | 128 | 289 | 12.7k |
Aug 20, 12:30:00 AMpulsescheduled2m 14s · 13 rec · 0 skip · 0 fail · 91.2k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 7.56s | 250 | 0 | 92 | 342 |
| pingcodex | ok | 8.19s | 10.7k | 0 | 5 | 10.7k |
| pinggrok | ok | 4.48s | 9,948 | 0 | 17 | 9,965 |
| speedclaude/haiku | ok | 9.54s | 272 | 0 | 563 | 835 |
| speedclaude/sonnet | ok | 7.98s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 8.02s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 7.75s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 9.73s | 9,380 | 0 | 254 | 9,634 |
| speedcodex/terra | ok | 9.23s | 8,122 | 2,816 | 243 | 11.2k |
| speedcodex/sol | ok | 9.37s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/gpt-5.5 | ok | 9.79s | 9,976 | 0 | 254 | 10.2k |
| speedgrok/grok-4.6 | ok | 32.6s | 11.9k | 512 | 283 | 12.7k |
| speedgrok/grok-4.5 | ok | 6.57s | 12.3k | 128 | 283 | 12.7k |
Aug 20, 12:15:00 AMqualityscheduled2.69s · 0 rec · 0 skip · 0 fail · 0 tok
No per-target results on this run.
Aug 20, 12:03:24 AMpulsemanual1m 58s · 13 rec · 0 skip · 1 fail · 87.0k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.03s | 250 | 0 | 45 | 295 |
| pingcodex | ok | 7.05s | 9,356 | 0 | 5 | 9,361 |
| pinggrok | ok | 4.07s | 7,989 | 128 | 17 | 8,134 |
| speedclaude/haiku | ok | 10.4s | 272 | 0 | 541 | 813 |
| speedclaude/sonnet | ok | 7.16s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.94s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 11.5s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 9.50s | 9,376 | 0 | 254 | 9,630 |
| speedcodex/terra | wrong answerReading additional input from stdin... | 14.0s | 9,497 | 2,816 | 243 | 12.6k |
| speedcodex/sol | ok | 9.62s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/gpt-5.5 | ok | 13.3s | 11.4k | 0 | 254 | 11.6k |
| speedgrok/grok-4.6 | ok | 11.1s | 10.6k | 0 | 286 | 10.9k |
| speedgrok/grok-4.5 | ok | 5.44s | 10.5k | 128 | 280 | 10.9k |
Aug 20, 12:00:00 AMpulsescheduledrun error1m 48s · 11 rec · 0 skip · 0 fail · 63.7k tok
EPERM: operation not permitted, rename 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\speed.json.59572.tmp' -> 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\speed.json'
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.51s | 250 | 0 | 87 | 337 |
| pingcodex | ok | 9.87s | 10.7k | 0 | 5 | 10.7k |
| pinggrok | ok | 3.92s | 7,860 | 256 | 17 | 8,133 |
| speedclaude/haiku | ok | 9.80s | 272 | 0 | 533 | 805 |
| speedclaude/sonnet | ok | 7.01s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 9.06s | 306 | 0 | 241 | 547 |
| speedclaude/fable | ok | 12.8s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 9.75s | 9,376 | 0 | 254 | 9,630 |
| speedcodex/terra | ok | 10.0s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/sol | ok | 9.44s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/gpt-5.5 | ok | 8.80s | 9,791 | 0 | 266 | 10.1k |
Aug 19, 11:45:00 PMpulsescheduled1m 53s · 13 rec · 0 skip · 1 fail · 87.0k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 3.48s | 250 | 0 | 37 | 287 |
| pingcodex | ok | 7.22s | 10.7k | 0 | 5 | 10.7k |
| pinggrok | ok | 6.42s | 7,861 | 256 | 17 | 8,134 |
| speedclaude/haiku | ok | 9.68s | 272 | 0 | 530 | 802 |
| speedclaude/sonnet | ok | 7.36s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.89s | 306 | 0 | 241 | 547 |
| speedclaude/fable | rate limit 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120","ttft_ms":6479,"ttft_stream_ms":4030,"time_to_request_ms":32,"type":"result","duration_ms":8380,"uuid":"fee80852-cc65-4656-aa23-00b5e2e7e290"} | 10.3s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 9.33s | 9,378 | 0 | 254 | 9,632 |
| speedcodex/terra | ok | 10.9s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/sol | ok | 10.2s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/gpt-5.5 | ok | 14.9s | 5,727 | 5,632 | 273 | 11.6k |
| speedgrok/grok-4.6 | ok | 7.18s | 10.3k | 256 | 298 | 10.9k |
| speedgrok/grok-4.5 | ok | 4.69s | 10.5k | 128 | 280 | 10.9k |
Aug 19, 11:30:00 PMpulsescheduledrun error31.5s · 2 rec · 0 skip · 0 fail · 11.1k tok
EPERM: operation not permitted, rename 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\probes.json.74400.tmp' -> 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\probes.json'
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 5.61s | 250 | 0 | 78 | 328 |
| pingcodex | ok | 9.95s | 10.7k | 0 | 5 | 10.7k |
Aug 19, 11:15:00 PMpulsescheduledrun error5.91s · 0 rec · 0 skip · 0 fail · 0 tok
EPERM: operation not permitted, rename 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\probes.json.45496.tmp' -> 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\probes.json'
No per-target results on this run.
Aug 19, 11:00:00 PMpulsescheduledrun error25.5s · 2 rec · 1 skip · 0 fail · 11.0k tok
EPERM: operation not permitted, rename 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\speed.json.26448.tmp' -> 'C:\Users\Boha\Desktop\DURK-REAL-PROJECTS\DurkBench\data\speed.json'
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.28s | 250 | 0 | 43 | 293 |
| pingcodex | ok | 8.83s | 10.7k | 0 | 5 | 10.7k |
| pinggrok | skipped · subscription auth missing | — | — | — | — | — |
Aug 19, 10:45:00 PMpulsescheduled1m 49s · 13 rec · 0 skip · 1 fail · 87.1k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 3.92s | 250 | 0 | 76 | 326 |
| pingcodex | ok | 7.13s | 10.7k | 0 | 5 | 10.7k |
| pinggrok | ok | 5.78s | 7,861 | 256 | 17 | 8,134 |
| speedclaude/haiku | ok | 7.22s | 272 | 0 | 568 | 840 |
| speedclaude/sonnet | ok | 6.12s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.24s | 306 | 0 | 241 | 547 |
| speedclaude/fable | rate limit 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120","ttft_ms":3576,"ttft_stream_ms":1759,"time_to_request_ms":25,"type":"result","duration_ms":5369,"uuid":"16796a07-4cbc-4e40-a026-5f0ecf1f05eb"} | 7.41s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 10.5s | 9,380 | 0 | 254 | 9,634 |
| speedcodex/terra | ok | 9.93s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/sol | ok | 13.9s | 12.3k | 0 | 243 | 12.6k |
| speedcodex/gpt-5.5 | ok | 11.1s | 8,440 | 1,536 | 262 | 10.2k |
| speedgrok/grok-4.6 | ok | 6.02s | 10.3k | 256 | 294 | 10.9k |
| speedgrok/grok-4.5 | ok | 8.33s | 10.1k | 512 | 283 | 10.9k |
Aug 19, 10:30:00 PMpulsescheduled2m 54s · 13 rec · 0 skip · 1 fail · 88.4k tok
| Target | Result | Wall | New in | Cache | Out | Total |
|---|---|---|---|---|---|---|
| pingclaude | ok | 4.60s | 250 | 0 | 42 | 292 |
| pingcodex | ok | 7.69s | 10.7k | 0 | 5 | 10.7k |
| pinggrok | ok | 5.47s | 7,988 | 128 | 30 | 8,146 |
| speedclaude/haiku | ok | 6.17s | 272 | 0 | 553 | 825 |
| speedclaude/sonnet | ok | 8.49s | 322 | 0 | 241 | 563 |
| speedclaude/opus | ok | 7.72s | 306 | 0 | 241 | 547 |
| speedclaude/fable | rate limit9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120","ttft_ms":7758,"ttft_stream_ms":5310,"time_to_request_ms":27,"type":"result","duration_ms":10496,"uuid":"20a29a38-11a6-4520-a2dc-6210851ab577"} | 12.3s | 306 | 0 | 241 | 547 |
| speedcodex/luna | ok | 9.45s | 9,378 | 0 | 254 | 9,632 |
| speedcodex/terra | ok | 13.4s | 5,403 | 6,912 | 243 | 12.6k |
| speedcodex/sol | ok | 11.0s | 10.9k | 0 | 243 | 11.2k |
| speedcodex/gpt-5.5 | ok | 13.5s | 5,727 | 5,632 | 257 | 11.6k |
| speedgrok/grok-4.6 | ok | 13.4s | 10.1k | 512 | 295 | 10.9k |
| speedgrok/grok-4.5 | ok | 57.4s | 10.5k | 128 | 281 | 10.9k |
Showing the newest 50 of 159 runs.
Each row: start time · kind · trigger (cron means the timer, anything else means by hand) · wall time · rec / skip / fail · total tokens. Skipped means it was not that target's turn, or a rate limit stopped the app. Failed is a real error, and we keep it.
Sample log
Every measurement we saved, newest first. Filter by check or by app. Rows from old test kits stay here too — the boards ignore them, but we never delete them. The counts above always cover the full window, not the filter.
This window, counted by outcome
- ok · 1499
- rate limit · 45
- rate limit warning · 15
- wrong answer · 14
- failed · 4
- auth · 3
- — · 1
Every saved sample in the window, sorted into its label. The filters below change the table, never these counts.
The status words
- ok
- The app answered and the answer passed our grader.
- rate limit
- The vendor refused the request. We stop the rest of that app for the round. Busy plan, not a slow model.
- rate limit warning
- The vendor served the request but flagged that the plan's usage window is getting full. The run worked, but we keep it out of the medians to be safe. It never stops the round.
- timeout
- The app never finished in the time we allow.
- auth
- The sign-in was not accepted. We skip that app until it is fixed.
- used tools
- The app reached for a tool even though we said not to. The row does not count.
- wrong answer
- Text came back, but it was not what we asked for. Speed with a wrong answer never counts.
- remapped
- We asked for one model and the app served another. We save both names and mark the row, and the boards treat it with care.
- parse
- The app’s own output was not readable, so we could not trust the timings.
- overloaded / credits / failed
- The vendor said it was busy, out of credit, or gave a plain error.
| Started | Check | Target | Status | Wall | Total | Cost |
|---|---|---|---|---|---|---|
| Aug 21, 1:01:20 AM | speed | codex/gpt-5.5 | ok | 10.3s | 11.6k | — |
| Aug 21, 1:01:10 AM | speed | codex/sol | ok | 9.63s | 12.6k | — |
| Aug 21, 1:01:00 AM | speed | codex/terra | ok | 10.4s | 12.6k | — |
| Aug 21, 1:00:49 AM | speed | codex/luna | ok | 10.7s | 11.0k | — |
| Aug 21, 12:01:22 AM | speed | codex/gpt-5.5 | ok | 9.63s | 11.6k | — |
| Aug 21, 12:01:13 AM | speed | codex/sol | ok | 9.49s | 12.6k | — |
| Aug 21, 12:01:03 AM | speed | codex/terra | ok | 9.05s | 12.6k | — |
| Aug 21, 12:00:53 AM | speed | codex/luna | ok | 10.8s | 11.0k | — |
| Aug 20, 11:01:27 PM | speed | codex/gpt-5.5 | ok | 10.4s | 11.6k | — |
| Aug 20, 11:01:17 PM | speed | codex/sol | ok | 9.71s | 12.6k | — |
| Aug 20, 11:01:07 PM | speed | codex/terra | ok | 9.83s | 12.6k | — |
| Aug 20, 11:00:53 PM | speed | codex/luna | ok | 14.4s | 12.4k | — |
| Aug 20, 10:01:38 PM | speed | codex/gpt-5.5 | ok | 12.9s | 13.0k | — |
| Aug 20, 10:01:22 PM | speed | codex/sol | ok | 15.8s | 12.6k | — |
| Aug 20, 10:01:10 PM | speed | codex/terra | ok | 12.4s | 12.6k | — |
| Aug 20, 10:00:55 PM | speed | codex/luna | ok | 14.9s | 12.4k | — |
| Aug 20, 9:01:31 PM | speed | codex/gpt-5.5 | ok | 8.86s | 11.5k | — |
| Aug 20, 9:01:20 PM | speed | codex/sol | ok | 10.9s | 12.6k | — |
| Aug 20, 9:01:08 PM | speed | codex/terra | ok | 11.6s | 12.6k | — |
| Aug 20, 9:00:55 PM | speed | codex/luna | ok | 13.7s | 12.4k | — |
| Aug 20, 8:01:27 PM | speed | codex/gpt-5.5 | ok | 10.4s | 11.7k | — |
| Aug 20, 8:01:18 PM | speed | codex/sol | ok | 9.26s | 12.6k | — |
| Aug 20, 8:01:07 PM | speed | codex/terra | ok | 10.6s | 12.6k | — |
| Aug 20, 8:00:53 PM | speed | codex/luna | ok | 14.0s | 12.4k | — |
| Aug 20, 7:01:29 PM | speed | codex/gpt-5.5 | ok | 11.8s | 11.6k | — |
| Aug 20, 7:01:18 PM | speed | codex/sol | ok | 10.3s | 12.6k | — |
| Aug 20, 7:01:07 PM | speed | codex/terra | ok | 11.6s | 12.6k | — |
| Aug 20, 7:00:53 PM | speed | codex/luna | ok | 13.9s | 12.4k | — |
| Aug 20, 6:01:25 PM | speed | codex/gpt-5.5 | ok | 9.20s | 11.6k | — |
| Aug 20, 6:01:16 PM | speed | codex/sol | ok | 9.08s | 12.6k | — |
| Aug 20, 6:01:07 PM | speed | codex/terra | ok | 9.38s | 12.6k | — |
| Aug 20, 6:00:56 PM | speed | codex/luna | ok | 10.3s | 11.0k | — |
| Aug 20, 5:01:26 PM | speed | codex/gpt-5.5 | ok | 13.5s | 11.7k | — |
| Aug 20, 5:01:16 PM | speed | codex/sol | ok | 10.5s | 12.6k | — |
| Aug 20, 5:01:06 PM | speed | codex/terra | ok | 9.60s | 12.6k | — |
| Aug 20, 5:00:54 PM | speed | codex/luna | ok | 11.9s | 11.0k | — |
| Aug 20, 4:01:24 PM | speed | codex/gpt-5.5 | ok | 10.0s | 11.6k | — |
| Aug 20, 4:01:10 PM | speed | codex/sol | ok | 14.0s | 12.6k | — |
| Aug 20, 4:01:00 PM | speed | codex/terra | ok | 10.4s | 12.6k | — |
| Aug 20, 4:00:49 PM | speed | codex/luna | ok | 10.7s | 11.0k | — |
| Aug 20, 3:01:26 PM | speed | codex/gpt-5.5 | ok | 10.4s | 11.6k | — |
| Aug 20, 3:01:17 PM | speed | codex/sol | ok | 9.74s | 12.6k | — |
| Aug 20, 3:01:06 PM | speed | codex/terra | ok | 10.8s | 12.6k | — |
| Aug 20, 3:00:55 PM | speed | codex/luna | ok | 10.7s | 11.0k | — |
| Aug 20, 2:01:33 PM | speed | codex/gpt-5.5 | ok | 13.2s | 13.0k | — |
| Aug 20, 2:01:23 PM | speed | codex/sol | ok | 9.73s | 12.6k | — |
| Aug 20, 2:01:13 PM | speed | codex/terra | ok | 10.7s | 12.6k | — |
| Aug 20, 2:01:00 PM | speed | codex/luna | ok | 12.7s | 11.0k | — |
| Aug 20, 1:01:35 PM | speed | codex/gpt-5.5 | ok | 9.77s | 11.7k | — |
| Aug 20, 1:01:21 PM | speed | codex/sol | ok | 14.3s | 14.0k | — |
| Aug 20, 1:01:09 PM | speed | codex/terra | ok | 12.0s | 12.6k | — |
| Aug 20, 1:00:58 PM | speed | codex/luna | ok | 11.0s | 11.0k | — |
| Aug 20, 12:01:38 PM | speed | codex/gpt-5.5 | ok | 11.0s | 11.6k | — |
| Aug 20, 12:01:27 PM | speed | codex/sol | ok | 11.1s | 12.6k | — |
| Aug 20, 12:01:13 PM | speed | codex/terra | ok | 13.8s | 12.6k | — |
| Aug 20, 12:00:59 PM | speed | codex/luna | ok | 14.1s | 12.4k | — |
| Aug 20, 11:01:34 AM | speed | codex/gpt-5.5 | ok | 9.74s | 11.6k | — |
| Aug 20, 11:01:21 AM | speed | codex/sol | ok | 12.4s | 12.6k | — |
| Aug 20, 11:01:11 AM | speed | codex/terra | ok | 10.4s | 12.6k | — |
| Aug 20, 11:00:56 AM | speed | codex/luna | ok | 14.5s | 12.4k | — |
| Aug 20, 10:01:29 AM | speed | codex/gpt-5.5 | ok | 11.8s | 11.6k | — |
| Aug 20, 10:01:18 AM | speed | codex/sol | ok | 10.8s | 12.6k | — |
| Aug 20, 10:01:06 AM | speed | codex/terra | ok | 12.7s | 14.0k | — |
| Aug 20, 10:00:53 AM | speed | codex/luna | ok | 13.0s | 12.4k | — |
| Aug 20, 9:01:31 AM | speed | codex/gpt-5.5 | ok | 11.0s | 11.6k | — |
| Aug 20, 9:01:20 AM | speed | codex/sol | ok | 10.9s | 12.6k | — |
| Aug 20, 9:01:11 AM | speed | codex/terra | ok | 9.64s | 12.6k | — |
| Aug 20, 9:00:59 AM | speed | codex/luna | ok | 11.9s | 12.4k | — |
| Aug 20, 8:01:32 AM | speed | codex/gpt-5.5 | ok | 12.7s | 11.7k | — |
| Aug 20, 8:01:20 AM | speed | codex/sol | ok | 12.4s | 12.6k | — |
| Aug 20, 8:01:09 AM | speed | codex/terra | ok | 10.4s | 12.6k | — |
| Aug 20, 8:00:55 AM | speed | codex/luna | ok | 13.8s | 12.4k | — |
| Aug 20, 7:01:24 AM | speed | codex/gpt-5.5 | ok | 10.6s | 11.7k | — |
| Aug 20, 7:01:15 AM | speed | codex/sol | ok | 9.20s | 12.6k | — |
| Aug 20, 7:01:05 AM | speed | codex/terra | ok | 10.5s | 12.6k | — |
| Aug 20, 7:00:53 AM | speed | codex/luna | ok | 12.0s | 12.4k | — |
| Aug 20, 6:04:27 AM | speed | codex/gpt-5.5 | ok | 10.3s | 11.7k | — |
| Aug 20, 6:04:17 AM | speed | codex/sol | ok | 9.93s | 12.6k | — |
| Aug 20, 6:04:04 AM | speed | codex/terra | ok | 13.0s | 12.6k | — |
| Aug 20, 6:03:49 AM | speed | codex/luna | ok | 15.7s | 12.4k | — |
| Aug 20, 5:01:25 AM | speed | codex/gpt-5.5 | ok | 9.93s | 11.6k | — |
| Aug 20, 5:01:14 AM | speed | codex/sol | ok | 11.4s | 12.6k | — |
| Aug 20, 5:01:01 AM | speed | codex/terra | ok | 12.9s | 12.6k | — |
| Aug 20, 5:00:51 AM | speed | codex/luna | ok | 9.79s | 11.1k | — |
| Aug 20, 4:46:24 AM | speed | codex/gpt-5.5 | ok | 10.3s | 11.7k | — |
| Aug 20, 4:46:12 AM | speed | codex/sol | ok | 11.3s | 12.6k | — |
| Aug 20, 4:46:03 AM | speed | codex/terra | ok | 9.35s | 12.6k | — |
| Aug 20, 4:45:53 AM | speed | codex/luna | ok | 9.84s | 11.1k | — |
| Aug 20, 4:31:34 AM | speed | codex/gpt-5.5 | ok | 9.72s | 11.7k | — |
| Aug 20, 4:31:23 AM | speed | codex/sol | ok | 10.4s | 12.6k | — |
| Aug 20, 4:31:13 AM | speed | codex/terra | ok | 10.4s | 12.6k | — |
| Aug 20, 4:31:02 AM | speed | codex/luna | ok | 10.6s | 11.0k | — |
| Aug 20, 4:16:26 AM | speed | codex/gpt-5.5 | ok | 13.3s | 11.6k | — |
| Aug 20, 4:16:15 AM | speed | codex/sol | ok | 10.9s | 12.6k | — |
| Aug 20, 4:16:03 AM | speed | codex/terra | ok | 12.2s | 12.6k | — |
| Aug 20, 4:15:54 AM | speed | codex/luna | ok | 8.96s | 11.0k | — |
| Aug 20, 4:01:24 AM | speed | codex/gpt-5.5 | ok | 11.0s | 11.7k | — |
| Aug 20, 4:01:13 AM | speed | codex/sol | ok | 10.6s | 12.6k | — |
| Aug 20, 4:01:04 AM | speed | codex/terraReading additional input from stdin... | wrong answer | 9.48s | 12.6k | — |
| Aug 20, 4:00:53 AM | speed | codex/luna | ok | 10.6s | 11.0k | — |
| Aug 20, 3:46:21 AM | speed | codex/gpt-5.5 | ok | 9.57s | 11.6k | — |
| Aug 20, 3:46:11 AM | speed | codex/sol | ok | 10.1s | 12.6k | — |
| Aug 20, 3:46:01 AM | speed | codex/terra | ok | 10.5s | 12.6k | — |
| Aug 20, 3:45:51 AM | speed | codex/luna | ok | 10.1s | 11.0k | — |
| Aug 20, 3:31:30 AM | speed | codex/gpt-5.5 | ok | 9.83s | 11.7k | — |
| Aug 20, 3:31:19 AM | speed | codex/sol | ok | 11.0s | 12.6k | — |
| Aug 20, 3:31:09 AM | speed | codex/terra | ok | 10.3s | 12.6k | — |
| Aug 20, 3:31:00 AM | speed | codex/luna | ok | 8.94s | 11.0k | — |
| Aug 20, 3:16:27 AM | speed | codex/gpt-5.5 | ok | 10.4s | 11.6k | — |
| Aug 20, 3:16:18 AM | speed | codex/sol | ok | 9.39s | 12.6k | — |
| Aug 20, 3:16:06 AM | speed | codex/terra | ok | 11.8s | 12.6k | — |
| Aug 20, 3:15:57 AM | speed | codex/luna | ok | 9.37s | 11.0k | — |
| Aug 20, 3:01:28 AM | speed | codex/gpt-5.5 | ok | 9.67s | 11.6k | — |
| Aug 20, 3:01:19 AM | speed | codex/sol | ok | 9.14s | 12.6k | — |
| Aug 20, 3:01:07 AM | speed | codex/terra | ok | 11.6s | 14.0k | — |
| Aug 20, 3:00:57 AM | speed | codex/luna | ok | 9.80s | 11.0k | — |
| Aug 20, 2:46:32 AM | speed | codex/gpt-5.5 | ok | 9.56s | 11.6k | — |
| Aug 20, 2:46:21 AM | speed | codex/sol | ok | 10.7s | 12.6k | — |
| Aug 20, 2:46:10 AM | speed | codex/terra | ok | 10.8s | 12.6k | — |
| Aug 20, 2:45:58 AM | speed | codex/luna | ok | 12.0s | 11.0k | — |
| Aug 20, 2:31:24 AM | speed | codex/gpt-5.5 | ok | 9.87s | 11.6k | — |
| Aug 20, 2:31:14 AM | speed | codex/sol | ok | 9.78s | 12.6k | — |
| Aug 20, 2:31:03 AM | speed | codex/terra | ok | 10.9s | 12.6k | — |
| Aug 20, 2:30:54 AM | speed | codex/luna | ok | 9.51s | 11.0k | — |
| Aug 20, 1:31:39 AM | speed | codex/gpt-5.5 | ok | 11.0s | 11.7k | — |
| Aug 20, 1:31:28 AM | speed | codex/sol | ok | 11.2s | 12.6k | — |
| Aug 20, 1:31:17 AM | speed | codex/terra | ok | 10.8s | 14.0k | — |
| Aug 20, 1:31:05 AM | speed | codex/luna | ok | 12.1s | 11.0k | — |
| Aug 20, 1:16:44 AM | speed | codex/gpt-5.5 | ok | 14.3s | 13.0k | — |
| Aug 20, 1:16:31 AM | speed | codex/sol | ok | 12.8s | 14.0k | — |
| Aug 20, 1:16:19 AM | speed | codex/terra | ok | 11.4s | 14.0k | — |
| Aug 20, 1:16:08 AM | speed | codex/luna | ok | 11.5s | 11.0k | — |
| Aug 20, 1:01:30 AM | speed | codex/gpt-5.5 | ok | 12.6s | 13.0k | — |
| Aug 20, 1:01:18 AM | speed | codex/sol | ok | 12.0s | 14.0k | — |
| Aug 20, 1:01:08 AM | speed | codex/terraReading additional input from stdin... | wrong answer | 9.87s | 13.9k | — |
| Aug 20, 1:00:58 AM | speed | codex/luna | ok | 9.44s | 11.0k | — |
| Aug 20, 12:46:37 AM | speed | codex/gpt-5.5 | ok | 13.5s | 13.0k | — |
| Aug 20, 12:46:26 AM | speed | codex/sol | ok | 10.8s | 12.6k | — |
| Aug 20, 12:46:15 AM | speed | codex/terra | ok | 11.2s | 12.6k | — |
| Aug 20, 12:46:04 AM | speed | codex/luna | ok | 11.2s | 12.4k | — |
| Aug 20, 12:31:24 AM | speed | codex/gpt-5.5 | ok | 9.79s | 10.2k | — |
| Aug 20, 12:31:15 AM | speed | codex/sol | ok | 9.37s | 11.2k | — |
| Aug 20, 12:31:06 AM | speed | codex/terra | ok | 9.23s | 11.2k | — |
| Aug 20, 12:30:56 AM | speed | codex/luna | ok | 9.73s | 9,634 | — |
| Aug 20, 12:04:52 AM | speed | codex/gpt-5.5 | ok | 13.3s | 11.6k | — |
| Aug 20, 12:04:43 AM | speed | codex/sol | ok | 9.62s | 11.2k | — |
| Aug 20, 12:04:29 AM | speed | codex/terraReading additional input from stdin... | wrong answer | 14.0s | 12.6k | — |
| Aug 20, 12:04:19 AM | speed | codex/luna | ok | 9.50s | 9,630 | — |
| Aug 20, 12:01:28 AM | speed | codex/gpt-5.5 | ok | 8.80s | 10.1k | — |
| Aug 20, 12:01:19 AM | speed | codex/sol | ok | 9.44s | 11.2k | — |
| Aug 20, 12:01:09 AM | speed | codex/terra | ok | 10.0s | 11.2k | — |
| Aug 20, 12:00:59 AM | speed | codex/luna | ok | 9.75s | 9,630 | — |
| Aug 19, 11:46:26 PM | speed | codex/gpt-5.5 | ok | 14.9s | 11.6k | — |
| Aug 19, 11:46:16 PM | speed | codex/sol | ok | 10.2s | 11.2k | — |
| Aug 19, 11:46:05 PM | speed | codex/terra | ok | 10.9s | 11.2k | — |
| Aug 19, 11:45:56 PM | speed | codex/luna | ok | 9.33s | 9,632 | — |
| Aug 19, 10:46:23 PM | speed | codex/gpt-5.5 | ok | 11.1s | 10.2k | — |
| Aug 19, 10:46:09 PM | speed | codex/sol | ok | 13.9s | 12.6k | — |
| Aug 19, 10:45:59 PM | speed | codex/terra | ok | 9.93s | 11.2k | — |
| Aug 19, 10:45:49 PM | speed | codex/luna | ok | 10.5s | 9,634 | — |
| Aug 19, 10:31:29 PM | speed | codex/gpt-5.5 | ok | 13.5s | 11.6k | — |
| Aug 19, 10:31:18 PM | speed | codex/sol | ok | 11.0s | 11.2k | — |
| Aug 19, 10:31:05 PM | speed | codex/terra | ok | 13.4s | 12.6k | — |
| Aug 19, 10:30:55 PM | speed | codex/luna | ok | 9.45s | 9,632 | — |
| Aug 19, 10:16:25 PM | speed | codex/gpt-5.5 | ok | 13.0s | 11.6k | — |
| Aug 19, 10:16:15 PM | speed | codex/sol | ok | 9.84s | 11.2k | — |
| Aug 19, 10:16:03 PM | speed | codex/terra | ok | 12.3s | 12.6k | — |
| Aug 19, 10:15:51 PM | speed | codex/luna | ok | 11.6s | 9,634 | — |
| Aug 19, 10:01:22 PM | speed | codex/gpt-5.5 | ok | 14.7s | 11.6k | — |
| Aug 19, 10:01:12 PM | speed | codex/sol | ok | 10.7s | 11.2k | — |
| Aug 19, 10:01:00 PM | speed | codex/terra | ok | 11.8s | 12.6k | — |
| Aug 19, 10:00:50 PM | speed | codex/luna | ok | 9.63s | 9,630 | — |
| Aug 19, 9:46:35 PM | speed | codex/gpt-5.5 | ok | 13.5s | 10.2k | — |
| Aug 19, 9:46:22 PM | speed | codex/sol | ok | 13.3s | 12.6k | — |
| Aug 19, 9:46:12 PM | speed | codex/terra | ok | 10.0s | 11.2k | — |
| Aug 19, 9:45:59 PM | speed | codex/luna | ok | 12.6s | 11.0k | — |
| Aug 19, 9:31:28 PM | speed | codex/gpt-5.5 | ok | 14.5s | 11.6k | — |
| Aug 19, 9:31:14 PM | speed | codex/sol | ok | 13.7s | 12.6k | — |
| Aug 19, 9:31:04 PM | speed | codex/terra | ok | 9.71s | 11.2k | — |
| Aug 19, 9:30:50 PM | speed | codex/luna | ok | 14.2s | 11.0k | — |
| Aug 19, 9:16:42 PM | speed | codex/gpt-5.5 | ok | 9.83s | 10.2k | — |
| Aug 19, 9:16:33 PM | speed | codex/sol | ok | 9.22s | 11.2k | — |
| Aug 19, 9:16:20 PM | speed | codex/terra | ok | 12.4s | 12.6k | — |
| Aug 19, 9:16:11 PM | speed | codex/luna | ok | 9.39s | 9,630 | — |
| Aug 19, 9:01:32 PM | speed | codex/gpt-5.5 | ok | 10.6s | 10.2k | — |
| Aug 19, 9:01:20 PM | speed | codex/sol | ok | 12.2s | 12.6k | — |
| Aug 19, 9:01:07 PM | speed | codex/terra | ok | 12.6s | 12.6k | — |
| Aug 19, 9:00:54 PM | speed | codex/luna | ok | 13.1s | 11.0k | — |
| Aug 19, 8:46:30 PM | speed | codex/gpt-5.5 | ok | 11.5s | 10.2k | — |
| Aug 19, 8:46:20 PM | speed | codex/sol | ok | 9.63s | 11.2k | — |
| Aug 19, 8:46:10 PM | speed | codex/terra | ok | 10.4s | 12.6k | — |
| Aug 19, 8:45:58 PM | speed | codex/luna | ok | 12.1s | 11.0k | — |
| Aug 19, 8:31:29 PM | speed | codex/gpt-5.5 | ok | 12.3s | 11.6k | — |
| Aug 19, 8:31:18 PM | speed | codex/sol | ok | 10.8s | 11.2k | — |
| Aug 19, 8:31:05 PM | speed | codex/terra | ok | 13.2s | 12.6k | — |
| Aug 19, 8:30:54 PM | speed | codex/luna | ok | 11.1s | 9,630 | — |
| Aug 19, 8:16:26 PM | speed | codex/gpt-5.5 | ok | 9.40s | 10.2k | — |
| Aug 19, 8:16:15 PM | speed | codex/sol | ok | 10.3s | 11.2k | — |
| Aug 19, 8:16:04 PM | speed | codex/terra | ok | 11.8s | 12.6k | — |
| Aug 19, 8:15:52 PM | speed | codex/luna | ok | 11.7s | 11.0k | — |
Showing 200 of 485 filtered samples · 1581 in the full window. Same rows as JSON: /api/probes · /api/speed · /api/runs
Read next
- How we test
What each check asks, and what every unit means.
- Lab health
Is the lab fresh right now, and is it still signed in?
- Developers
The same data as JSON. No key, no login.