CategoryWeight: 1.0x

Bug Introduction Rate

Measures how often the model introduces new bugs while writing or modifying code. Lower is better (inverted for scoring).

Best Score

0.0

Avg Score

0.0

Tests

Performance Over Time — All Models

Model Rankings

Claude Opus 4.8

Category score

View

100.0BEST

Tokens4.5k

Total4.5k

Claude Sonnet 4.6

Category score

View

97.3-2.7 pts

Tokens18.5k

Total18.5k

Grok

Category score

View

97.0-3.0 pts

Tokens99.9k

Total99.9k

GPT-5.5

Category score

View

96.3-3.7 pts

Tokens42.9k

Total42.9k

Rank	Model	Score	Tokens	vs. Best	Details
1	Claude Opus 4.8	100.0	4.5k	BEST	View
2	Claude Sonnet 4.6	97.3	18.5k	-2.7 pts	View
3	Grok	97.0	99.9k	-3.0 pts	View
4	GPT-5.5	96.3	42.9k	-3.7 pts	View

Test Breakdown

Refactor Without Regression

Refactor a function without introducing new failures in existing tests

Claude Opus 4.8

100.0

Claude Sonnet 4.6

97.3

Grok

97.0

GPT-5.5

96.3

Merge Conflict Resolution

Resolve merge conflicts without introducing semantic errors

Claude Opus 4.8

100.0

Claude Sonnet 4.6

97.3

Grok

97.0

GPT-5.5

96.3

Dependency Upgrade Safety

Upgrade a dependency and adapt code without breaking changes

Claude Opus 4.8

100.0

Claude Sonnet 4.6

97.3

Grok

97.0

GPT-5.5

96.3