Skip to content
mager-bench2.0
← All runs

GPT-6 Astra

CLI check failed · unscored

2026-10-2441 ms agent timelow effort
Download full evidence
Unscored

Codex call failed or did not complete

Error loading config.toml: model_providers contains reserved built-in provider IDs: `openai`. Built-in providers cannot be overridden. Rename your custom provider (for example, `openai-custom`).
in `model_providers`

File-edit check only. This is not a benchmark score.

Runtime and suite
{
  "suite_sha256": "d62be84ca76c13f41cf63fecd0e12e6d35fe91c9ae2416f92a886f71d48ed4df",
  "runtime": {
    "codex": "codex-cli 0.154.0",
    "node": "v22.13.1",
    "python": "3.13.7",
    "quickjs": "1.19.4",
    "system": "Darwin",
    "machine": "arm64"
  },
  "elapsed_ms": 190
}