Leaderboard
| Rank | Pass@1 | Pass@3 | ||||||
|---|---|---|---|---|---|---|---|---|
| #1 | claude-code | opus 4.6 | 51.5 | 24.5 | 9.6 | 58.3 | 31.9 | 13.1 |
| #2 | opencode | Kimi-K2.5 | 45.1 | 7.4 | 2.3 | 62.3 | 20.4 | 7.6 |
| #3 | gemini-cli | gemini-2.5-pro | 23.5 | 5.9 | 2.1 | 36.8 | 16.7 | 7.3 |
| #4 | codex | gpt-5.2 | 27.9 | 6.4 | 2.2 | 41.2 | 15.2 | 7.2 |
| #5 | opencode | GLM5 | 61.7 | 1.9 | 1.2 | 64.2 | 3.1 | 1.4 |