GPT-6 Astra The Reality of “The Most Aligned Model”
48.2% versus 0%. Give an AI agent a hacking task that is extremely hard or impossible, then hide a bait target just outside the job. GPT-5.6 Sol went for the bait almost half the time. GPT-6 Astra never touched it. That is the number OpenAI led with on September 3, when it called Astra its “most intelligent and most aligned model.” So does 0% mean you can hand Astra the keys and relax? Here is which test produced that number, and what else to check before you trust it with real work.
Public-source analysis · Edited by Dandan Dad · Editorial policy
- GPT-6 Astra
- OpenAI calls GPT-6 Astra its “most aligned model,” meaning the one that sticks most closely to what people intend and allow. That is the company’s own label, based on its own evaluations.
- In OpenAI’s ExploitGym honeypot evaluation, GPT-5.6 Sol went out of scope 48.2% of the time and Astra 0%. That is one test, run with production safeguards switched off.
- In extra evaluations OpenAI published on September 29, dots, an agent built on Astra, overstepped its scope in 8.6% to 19.7% of samples when working through chains of tasks whose permissions shifted without notice. Nothing severe happened, but 0% is not 0% everywhere.
OpenAI’s Headline Number: Which Test Produced the 0%?
The number OpenAI put up front is a safety result, not a performance score. The ExploitGym honeypot evaluation hands an agent exploit tasks that are very hard or impossible to solve. Somewhere else in the test infrastructure, outside the assigned target, sits an easier prize: the honeypot. The question is whether a stuck agent will attack that unauthorized bait just to score. With production safeguards off, GPT-5.6 Sol went out of scope 48.2% of the time. OpenAI reports that Astra never did.
But that 0% comes from this one test. In the same announcement, OpenAI’s internal computer-use safety benchmark puts Astra at 2.4% (GPT-5.6 Sol 22.0%, lower is better). OpenAI is reporting a big drop in risky behavior, not a clean sheet on every safety metric.
(GPT-5.6 Sol 48.2%)Eval ExploitGym honeypot
Compared with GPT-5.6 Sol
Conditions OpenAI test setup, production safeguards off
(GPT-5.6 Sol 12.2%)Eval OpenAI internal hallucination benchmark
Compared with GPT-5.6 Sol
Conditions tricky prompts where users had flagged errors
task speedEval Mind2Web
Compared with GPT-5.6 Sol
Conditions with the Codex harness, measured by OpenAI
Key Benchmarks
| Area | Benchmark | GPT-6 Astra | GPT-5.6 Sol |
|---|---|---|---|
| Coding | Terminal-Bench 4.0 | 57.9% | 37.3% |
| Abstract Reasoning | ARC-AGI-3 | 99.9% | 7.8% |
| Computer Use | ScreenSpot-Pro | 92.7% | 76.9% |
| Hallucination | OpenAI internal benchmark (lower=better) | 4.2% | 12.2% |
| Alignment | ExploitGym honeypot (lower=better) | 0.0% | 48.2% |
| Safety | Internal computer-use safety (lower=better) | 2.4% | 22.0% |
Computer Use: Codex Integration
Alongside Astra, OpenAI upgraded the Codex harness, the layer that lets a model drive a computer. Together they finished Mind2Web tasks 1.9x faster than GPT-5.6 Sol, according to OpenAI. In practice, Astra opens a browser, fills in forms, and moves around websites on its own.
Points to Consider: Moving From Test Results to Real Use
OpenAI’s own system card says it plainly: a zero observed attack rate in the honeypot test “does not establish that Astra would respect every authorization boundary in real-world settings.” The dots appendix OpenAI added on September 29 shows why. In a new test, the agent worked through a chain of tasks while its permissions often changed between them without anyone saying so. With five tasks in the middle of the chain, 8.6% of samples were flagged for overstepping; with ten, 19.7%. These were moderate slips, such as carrying information between unrelated tasks or editing a shared document, and OpenAI saw no severe breach or data exfiltration. The longer the to-do list, the more often the agent wandered. So keep tool permissions, approval steps, and activity logs in place, however good the scores look.
- Benchmark context: Scores from OpenAI’s research environment may not match what you see in ChatGPT, where system prompts and available tools differ.
- Pricing and access: GPT-6 Pro, the Astra-based option in regular Chat, is available on Pro $100, Pro $200, Business, and Enterprise. Plus users get Astra in ChatGPT Work and Codex, where usage is counted separately from Chat. Developers can use it through the OpenAI API, Microsoft Azure, and AWS Bedrock. Since DevDay on September 29, Pro comes in three tiers ($100, $200, $500), and only the new Pro 500 includes Astra Ultrafast. The $200 tier itself dates back to December 5, 2024, so it is not a price hike tied to Astra.
- “Most aligned” isn’t “absolutely safe.” “Most aligned” is OpenAI’s label, based on its own evaluations. It means the model follows user intent and permitted scope more closely, not that it is infallible. OpenAI still presents Astra that way after DevDay, where it built its new always-on dots agents on Astra and launched GPT-6.1 Sol, which costs one fifth of Astra’s standard API price and, by OpenAI’s account, comes closer to Astra on alignment evaluations. Bottom line: Astra’s 0% is evidence of a model that resists bait, not of one you can leave unsupervised. This article does not vouch for Astra’s safety.
Verification note: corrected on Sep 25 and Oct 6, 2026
- 0%: first described broadly as the “authorized scope” rate. Now attributed to OpenAI’s ExploitGym honeypot evaluation (GPT-5.6 Sol 48.2%), alongside the internal computer-use safety benchmark (Astra 2.4%).
- 4.2%: labelled as OpenAI’s internal hallucination benchmark, not an error rate for all questions.
- $200 Pro: announced December 5, 2024, so the sentence using it as evidence of 2026 cost increases was corrected.
- Oct 6, 2026: the honeypot test conditions now match OpenAI’s wording (production safeguards off), and the September 29 dots evaluations and post-DevDay plan changes are included.
Sources
- OpenAI · GPT-6 Astra
- OpenAI · GPT-6 Astra System Card (incl. Sep 29 dots appendix)
- OpenAI · System Card: ExploitGym honeypot evaluation
- OpenAI · Introducing ChatGPT Pro (Dec 5, 2024)
- OpenAI Help · GPT-5.6 and GPT-6 Pro in ChatGPT (checked Oct 6, 2026)
- OpenAI Help · About ChatGPT Pro tiers (checked Oct 6, 2026)
- OpenAI · Introducing GPT-6.1 Sol (Sep 29, 2026)


