GPT-6 Astra
CLI check failed · unscored
2026-10-2441 ms agent timelow effort
Download full evidenceUnscored
Codex call failed or did not complete
Error loading config.toml: model_providers contains reserved built-in provider IDs: `openai`. Built-in providers cannot be overridden. Rename your custom provider (for example, `openai-custom`). in `model_providers`
File-edit check only. This is not a benchmark score.
Runtime and suite
{
"suite_sha256": "d62be84ca76c13f41cf63fecd0e12e6d35fe91c9ae2416f92a886f71d48ed4df",
"runtime": {
"codex": "codex-cli 0.154.0",
"node": "v22.13.1",
"python": "3.13.7",
"quickjs": "1.19.4",
"system": "Darwin",
"machine": "arm64"
},
"elapsed_ms": 190
}