BasedAGIBasedAGI

developer_tools

Best LLM for Code Review

Compare models for automated PR review covering correctness, security, and maintainability.

This page is high-intent, but the current benchmark evidence for this use case is still limited. Treat the leader below as provisional.

Provisional leader

anthropic/claude-sonnet-4

Best current option from the available benchmark evidence, but not yet a strong winner claim.

external/anthropic/claude-sonnet-4

27.1%

Score

38.8%

Confidence

27

Evidence

$6.00

per 1M tokens

Ranked Models

30

Evidence Quality

80%

Evidence Points

27

Top Signal

Sonar Java Quality Leaderboard: functional_skill_pct

All Ranked Models

30 of 30 models
RankModelScore
🥇claude-sonnet-4

Strong on Sonar Java Quality Leaderboard functional_skill_pct and SWE-bench Verified Leaderboard swe_verified_resolved_pct

27.1%
🥈gpt-5-2025-08-07

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Aider Polyglot Leaderboard percent_correct_pct

24.8%
🥉deepseek-r1

Strong on Sonar Java Quality Leaderboard functional_skill_pct and Sonar Java Quality Leaderboard issue_density_error_per_kloc

22.8%
#4gpt-4o-2024-05-13

Strong on RepoQA Official Results overall_average_pass_at_1_pct and BigCodeBench Official bigcodebench_complete_pct

22.6%
#7Kimi K2 Thinking

Strong on Sonar Java Quality Leaderboard functional_skill_pct and SWE-bench Verified Leaderboard swe_verified_resolved_pct

21.2%
#8gemini-2.5-pro

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and LEXam Leaderboard average_score_pct

19.3%
#9gemini-3-pro-preview

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Vals SWE-bench overall_accuracy_pct

18.6%
#11gpt-4o

Strong on Sonar Java Quality Leaderboard functional_skill_pct and Aider Refactoring Leaderboard percent_correct_pct

16.7%
#12glm-4.7

Strong on Sonar Java Quality Leaderboard functional_skill_pct and Sonar Java Quality Leaderboard issue_density_error_per_kloc

16.4%
#13o3-20250416

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Aider Polyglot Leaderboard percent_correct_pct

16.2%
#14gpt-5-mini-2025-08-07

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Vals LiveCodeBench overall_accuracy_pct

16.2%
#16gpt-4o-20241120

Strong on BigCodeBench Official bigcodebench_complete_pct and BigCodeBench Official bigcodebench_hard_complete_pct

15.8%
#17gpt-5.2-2025-12-11

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Vals SWE-bench overall_accuracy_pct

15.6%
#18minimax-m2.1

Strong on Sonar Java Quality Leaderboard functional_skill_pct and Vals SWE-bench overall_accuracy_pct

15.3%
#19gpt-4.1-20250414

Strong on Galileo Agent Leaderboard v2 Avg AC and SWE-bench Verified Leaderboard swe_verified_resolved_pct

15.2%
#20gpt-4.1

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Aider Polyglot Leaderboard percent_correct_pct

15.1%
#23GLM-5

Strong on Sonar Java Quality Leaderboard functional_skill_pct and Sonar Java Quality Leaderboard issue_density_error_per_kloc

14.0%
#27claude-opus-4-5-20251101

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Vals Terminal-Bench 2 overall_accuracy_pct

13.1%
#28qwen-2.5-72b-instruct

Strong on BigCodeBench Official bigcodebench_complete_pct and Galileo Agent Leaderboard v2 Avg AC

13.1%
#32gemini-3.1-pro-preview

Strong on Vals SWE-bench overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct

12.0%
#34claude-opus-4

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Aider Polyglot Leaderboard percent_correct_pct

11.7%
#36o4-mini

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Aider Polyglot Leaderboard percent_correct_pct

11.6%
#37Phi-3-medium-128k-instruct

Strong on RepoQA Official Results overall_average_pass_at_1_pct and BigCodeBench Official bigcodebench_complete_pct

11.5%
#43Grok-4-0709

Strong on Vals LiveCodeBench overall_accuracy_pct and Galileo Agent Leaderboard v2 Avg AC

11.2%
#47deepseek-v3

Strong on BigCodeBench Official bigcodebench_complete_pct and BigCodeBench Official bigcodebench_hard_complete_pct

10.9%
#62gemini-3-flash-preview

Strong on Vals SWE-bench overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct

10.1%
#64gpt-4o-2024-08-06

Strong on BigCodeBench Official bigcodebench_hard_complete_pct and Aider Code Editing Leaderboard percent_correct_pct

10.1%
#65gpt-5.4-2026-03-05

Strong on Vals SWE-bench overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct

10.1%
#68claude-sonnet-4.6

Strong on Vals SWE-bench overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct

9.8%
#70claude-opus-4-6-thinking

Strong on Vals SWE-bench overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct

9.6%

Head-to-Head: #1 vs #2

#1

Top Pick

anthropic/claude-sonnet-4

Strong on Sonar Java Quality Leaderboard functional_skill_pct and SWE-bench Verified Leaderboard swe_verified_resolved_pct

27.1%

Conf 38.8%

#2

gpt-5-2025-08-07

Strong on SWE-bench Verified Leaderboard swe_verified_resolved_pct and Aider Polyglot Leaderboard percent_correct_pct

24.8%

Conf 29.7%

Related Lookups