Updated

Claude Sonnet 5.5 vs GPT-6 Astra

Claude Sonnet 5.5 (1.03) and GPT-6 Astra (0.93) are statistically tied on Bug Bench.

Claude Sonnet 5.5 and GPT-6 Astra compared on relative bug rate, by bug type and language, and on price and usage.
Claude Sonnet 5.5GPT-6 Astra
Bug rate
Relative bug rate(statistically tied)1.030.93
Rank#5 of 7#4 of 7
By bug type
Security and privacy1.510.71
Logic bugs(statistically tied)0.850.85
Error handling(statistically tied)0.950.83
Performance(statistically tied)1.051.26
Business rules and compliance(statistically tied)1.190.75
Configuration and dependencies1.490.76
Accessibility and user experience(statistically tied)1.310.83
Tests and documentation(statistically tied)1.241.17
By language
TypeScript0.941.07
JavaScript2.431.53
Python(statistically tied)1.281.18
Go0.230.80
Swift(statistically tied)1.330.90
SQL0.120.91
Shell2.050.63
Details
ProviderAnthropicOpenAI
ReleasedSep 28, 2026Sep 4, 2026
List price$2 input / $10 output per 1M tokens$10 input / $50 output per 1M tokens
Share of AI-written code, week of Nov 23.7%4.6%

1.00 = average · lower is better · = statistically tied

More comparisons

Questions and answers

Which has fewer bugs, Claude Sonnet 5.5 or GPT-6 Astra?
Claude Sonnet 5.5 (1.03) and GPT-6 Astra (0.93) are statistically tied on Bug Bench. GPT-6 Astra ranks #4 of 7 and Claude Sonnet 5.5 #5.
Which is cheaper, Claude Sonnet 5.5 or GPT-6 Astra?
Claude Sonnet 5.5 lists at $2 input / $10 output per 1M tokens; GPT-6 Astra lists at $10 input / $50 output per 1M tokens. Claude Sonnet 5.5 has the lower list price.
Does it depend on the programming language?
In TypeScript, Claude Sonnet 5.5 had the lower rate (0.94 vs 1.07); in JavaScript, GPT-6 Astra had the lower rate (1.53 vs 2.43); in Python, they were statistically tied (1.28 and 1.18); in Go, Claude Sonnet 5.5 had the lower rate (0.23 vs 0.80); in Swift, they were statistically tied (1.33 and 0.90); in SQL, Claude Sonnet 5.5 had the lower rate (0.12 vs 0.91); in shell scripts, GPT-6 Astra had the lower rate (0.63 vs 2.05).
Does it depend on the kind of bug?
For security and privacy bugs, GPT-6 Astra had the lower rate (0.71 vs 1.51); for logic bugs, they were statistically tied (0.85 and 0.85); for error-handling bugs, they were statistically tied (0.95 and 0.83); for performance bugs, they were statistically tied (1.05 and 1.26); for business-logic bugs, they were statistically tied (1.19 and 0.75); for config and dependency issues, GPT-6 Astra had the lower rate (0.76 vs 1.49); for accessibility and UX issues, they were statistically tied (1.31 and 0.83); for testing and documentation issues, they were statistically tied (1.24 and 1.17).