Counterexample Lab / Attempt 3
GPT-5.6 Luna
Oct 1, 2026 · low reasoning · Codex CLI · failed
Unscoredfaults exposed
— / 12events used
—valid traces
37.7 secwall-clock subject time
Which faults did it find?
Exposure means at least one fully valid trace made this faulty ledger disagree with the reference.
- 01Lost request historyUnscored
- 02Forgotten rejectionUnscored
- 03Unchecked payloadUnscored
- 04Revalidated retryUnscored
- 05Partial transferUnscored
- 06Missing revisionUnscored
- 07Stale writeUnscored
- 08Overwritten historyUnscored
The original response
Preserved verbatim from the subject. The source artifact also includes the prompt and complete scoring result.
expected_revision must be an integer 0–20
Open raw model response
{"traces":[{"events":[{"op":"transfer","id":"r1","from":"a","to":"b","amount":3,"expected_revision":0},{"op":"transfer","id":"r1","from":"a","to":"b","amount":3,"expected_revision":0},{"op":"transfer","id":"r1","from":"a","to":"b","amount":4,"expected_revision":0},{"op":"inspect"}],"expected":[{"status":"ok"},{"status":"ok"},{"status":"conflict"},{"balances":{"a":7,"b":3,"c":0},"revisions":{"a":1,"b":1,"c":0}}]},{"events":[{"op":"transfer","id":"r2","from":"a","to":"b","amount":20,"expected_revision":0},{"op":"transfer","id":"r3","from":"a","to":"c","amount":10,"expected_revision":0},{"op":"restart"},{"op":"transfer","id":"r2","from":"a","to":"b","amount":20,"expected_revision":0},{"op":"inspect"}],"expected":[{"status":"insufficient_funds"},{"status":"ok"},{"status":"restarted"},{"status":"insufficient_funds"},{"balances":{"a":0,"b":0,"c":10},"revisions":{"a":1,"b":0,"c":1}}]},{"events":[{"op":"transfer","id":"r4","from":"a","to":"a","amount":1,"expected_revision":99},{"op":"transfer","id":"r5","from":"a","to":"c","amount":20,"expected_revision":99},{"op":"inspect"}],"expected":[{"status":"same_account"},{"status":"stale_revision"},{"balances":{"a":10,"b":0,"c":0},"revisions":{"a":0,"b":0,"c":0}}]}]}Suite SHA-256: a56a4aadf5b20a319c7a57309608477d9e523da3d99c37a69bb6353f6b16f0c1