Updated
Claude Sonnet 5.5 vs GPT-6 Astra
Claude Sonnet 5.5 (1.03) and GPT-6 Astra (0.93) are statistically tied on Bug Bench.
| Claude Sonnet 5.5 | GPT-6 Astra | |
|---|---|---|
| Bug rate | ||
| Relative bug rate(statistically tied) | 1.03 | 0.93 |
| Rank | #5 of 7 | #4 of 7 |
| By bug type | ||
| Security and privacy | 1.51 | 0.71 |
| Logic bugs(statistically tied) | 0.85 | 0.85 |
| Error handling(statistically tied) | 0.95 | 0.83 |
| Performance(statistically tied) | 1.05 | 1.26 |
| Business rules and compliance(statistically tied) | 1.19 | 0.75 |
| Configuration and dependencies | 1.49 | 0.76 |
| Accessibility and user experience(statistically tied) | 1.31 | 0.83 |
| Tests and documentation(statistically tied) | 1.24 | 1.17 |
| By language | ||
| TypeScript | 0.94 | 1.07 |
| JavaScript | 2.43 | 1.53 |
| Python(statistically tied) | 1.28 | 1.18 |
| Go | 0.23 | 0.80 |
| Swift(statistically tied) | 1.33 | 0.90 |
| SQL | 0.12 | 0.91 |
| Shell | 2.05 | 0.63 |
| Details | ||
| Provider | Anthropic | OpenAI |
| Released | Sep 28, 2026 | Sep 4, 2026 |
| List price | $2 input / $10 output per 1M tokens | $10 input / $50 output per 1M tokens |
| Share of AI-written code, week of Nov 2 | 3.7% | 4.6% |
1.00 = average · lower is better · = statistically tied
More comparisons
Questions and answers
- Which has fewer bugs, Claude Sonnet 5.5 or GPT-6 Astra?
- Claude Sonnet 5.5 (1.03) and GPT-6 Astra (0.93) are statistically tied on Bug Bench. GPT-6 Astra ranks #4 of 7 and Claude Sonnet 5.5 #5.
- Which is cheaper, Claude Sonnet 5.5 or GPT-6 Astra?
- Claude Sonnet 5.5 lists at $2 input / $10 output per 1M tokens; GPT-6 Astra lists at $10 input / $50 output per 1M tokens. Claude Sonnet 5.5 has the lower list price.
- Does it depend on the programming language?
- In TypeScript, Claude Sonnet 5.5 had the lower rate (0.94 vs 1.07); in JavaScript, GPT-6 Astra had the lower rate (1.53 vs 2.43); in Python, they were statistically tied (1.28 and 1.18); in Go, Claude Sonnet 5.5 had the lower rate (0.23 vs 0.80); in Swift, they were statistically tied (1.33 and 0.90); in SQL, Claude Sonnet 5.5 had the lower rate (0.12 vs 0.91); in shell scripts, GPT-6 Astra had the lower rate (0.63 vs 2.05).
- Does it depend on the kind of bug?
- For security and privacy bugs, GPT-6 Astra had the lower rate (0.71 vs 1.51); for logic bugs, they were statistically tied (0.85 and 0.85); for error-handling bugs, they were statistically tied (0.95 and 0.83); for performance bugs, they were statistically tied (1.05 and 1.26); for business-logic bugs, they were statistically tied (1.19 and 0.75); for config and dependency issues, GPT-6 Astra had the lower rate (0.76 vs 1.49); for accessibility and UX issues, they were statistically tied (1.31 and 0.83); for testing and documentation issues, they were statistically tied (1.24 and 1.17).