# cubic Bug Bench: which AI coding model writes the fewest bugs?

> Bug Bench ranks AI coding models by relative bug rate: counted bugs per AI-attributed line in code reviewed by cubic, compared with the rate across all AI-attributed lines. 1.00 is average; lower is better.

Updated Oct 12, 2026 · Ranking window: Jun 22 to Oct 11, 2026 · Bug Bench v0.1

As of Oct 12, 2026, GPT-5.6 Sol had the lowest relative bug rate on Bug Bench (0.65, 35% fewer counted bugs than average), among 7 ranked AI coding models.

## Ranking

| Rank | Model | Relative bug rate | Reading | Statistically tied with |
| ---: | :--- | ---: | :--- | :--- |
| 1 | [GPT-5.6 Sol](https://www.cubic.dev/bugbench/models/gpt-5-6-sol) | 0.65 | 35% fewer counted bugs than average | — |
| 2 | [Claude Fable 5.1](https://www.cubic.dev/bugbench/models/claude-fable-5-1) | 1.09 | 9% more counted bugs than average | GPT-6 Astra, GPT-6.1 Sol, and Claude Sonnet 5.5 |
| 3 | [GPT-6 Astra](https://www.cubic.dev/bugbench/models/gpt-6-astra) | 1.13 | 13% more counted bugs than average | Claude Fable 5.1, GPT-6.1 Sol, and Claude Sonnet 5.5 |
| 4 | [GPT-6.1 Sol](https://www.cubic.dev/bugbench/models/gpt-6-1-sol) | 1.23 | 23% more counted bugs than average | Claude Fable 5.1, GPT-6 Astra, Claude Sonnet 5.5, and Claude Opus 5 |
| 5 | [Claude Sonnet 5.5](https://www.cubic.dev/bugbench/models/claude-sonnet-5-5) | 1.27 | 27% more counted bugs than average | Claude Fable 5.1, GPT-6 Astra, GPT-6.1 Sol, and Claude Opus 5 |
| 6 | [Claude Opus 5](https://www.cubic.dev/bugbench/models/claude-opus-5) | 1.33 | 33% more counted bugs than average | GPT-6.1 Sol and Claude Sonnet 5.5 |
| 7 | [Claude Opus 5.5](https://www.cubic.dev/bugbench/models/claude-opus-5-5) | 1.50 | 50% more counted bugs than average | — |

## Not yet ranked

- [Claude Haiku 5.5](https://www.cubic.dev/bugbench/models/claude-haiku-5-5): not enough reviewed code to rank yet.
- [Claude Fable 5](https://www.cubic.dev/bugbench/models/claude-fable-5): led earlier weeks but is no longer ranked because it now writes under 0.5% of AI-attributed lines.
- [Claude Opus 4.8](https://www.cubic.dev/bugbench/models/claude-opus-4-8): led earlier weeks but is no longer ranked because it now writes under 0.5% of AI-attributed lines.

## Best model by coding agent

Coding-agent rates compare each model inside one harness against the overall average. [All coding agents](https://www.cubic.dev/bugbench/harnesses).

| Coding agent | Best model | Relative bug rate | Statistically tied with | Models ranked |
| :--- | :--- | ---: | :--- | ---: |
| [Claude Code](https://www.cubic.dev/bugbench/harnesses/claude-code) | [Claude Fable 5.1](https://www.cubic.dev/bugbench/models/claude-fable-5-1) | 1.09 | Claude Sonnet 5.5 | 4 |
| [Codex](https://www.cubic.dev/bugbench/harnesses/codex) | [GPT-5.6 Sol](https://www.cubic.dev/bugbench/models/gpt-5-6-sol) | 0.62 | — | 3 |
| [Cursor](https://www.cubic.dev/bugbench/harnesses/cursor) | [Claude Opus 5](https://www.cubic.dev/bugbench/models/claude-opus-5) | 1.28 | GPT-5.6 Sol | 2 |

## Bug rate vs list price

List prices are USD per 1M tokens from each model's own provider. [Bug rate vs price](https://www.cubic.dev/bugbench/price).

| Rank | Model | Relative bug rate | Input price | Output price |
| ---: | :--- | ---: | ---: | ---: |
| 1 | [GPT-5.6 Sol](https://www.cubic.dev/bugbench/models/gpt-5-6-sol) | 0.65 | $4 | $20 |
| 2 | [Claude Fable 5.1](https://www.cubic.dev/bugbench/models/claude-fable-5-1) | 1.09 | $10 | $50 |
| 3 | [GPT-6 Astra](https://www.cubic.dev/bugbench/models/gpt-6-astra) | 1.13 | $10 | $50 |
| 4 | [GPT-6.1 Sol](https://www.cubic.dev/bugbench/models/gpt-6-1-sol) | 1.23 | $2 | $10 |
| 5 | [Claude Sonnet 5.5](https://www.cubic.dev/bugbench/models/claude-sonnet-5-5) | 1.27 | $2 | $10 |
| 6 | [Claude Opus 5](https://www.cubic.dev/bugbench/models/claude-opus-5) | 1.33 | $5 | $25 |
| 7 | [Claude Opus 5.5](https://www.cubic.dev/bugbench/models/claude-opus-5-5) | 1.50 | $4 | $20 |

## Methodology

- A counted bug is a cubic code review finding on AI-written code that a developer upvoted or an AI coding agent addressed.
- Relative bug rate is counted bugs per AI-attributed line divided by the rate across all AI-attributed lines in the window, so 1.00 is average and lower is better. The overall rate includes unranked and unspecified models, so it is not an average of the models shown.
- "Statistically tied" means the two models' 95% confidence intervals overlap, so neither is clearly ahead.
- A model is ranked once enough of its code has been reviewed across many organizations. Launch-week models are listed but not ranked.
- Bug Bench is observational, not causal: teams choose their models, so a rate reflects the code each model was used for as well as the model.
- Full methodology: https://www.cubic.dev/bugbench#methodology

## Pages

- [Leaderboard](https://www.cubic.dev/bugbench)
- [All models](https://www.cubic.dev/bugbench/models)
- [Compare two models](https://www.cubic.dev/bugbench/compare)
- [Best model by language](https://www.cubic.dev/bugbench/languages)
- [Bugs by type](https://www.cubic.dev/bugbench/bugs)
- [Coding agents](https://www.cubic.dev/bugbench/harnesses)
- [Bug rate vs price](https://www.cubic.dev/bugbench/price)
- [Trends](https://www.cubic.dev/bugbench/trends)
- [New model launches](https://www.cubic.dev/bugbench/launches)
- [Monthly editions](https://www.cubic.dev/bugbench/editions)

## Data

- [JSON](https://www.cubic.dev/bugbench/data.json): every published model, coding-agent, language, and bug-type rate.
- [CSV](https://www.cubic.dev/bugbench/data.csv): the same rankings in long format.
- [Atom feed](https://www.cubic.dev/bugbench/feed.xml): ranking changes and monthly editions.
- SVG badge: https://www.cubic.dev/bugbench/badge/<model-slug>

## License

CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/) — cite as: cubic Bug Bench, Oct 12, 2026, https://www.cubic.dev/bugbench