BasedAGIBasedAGI
Legal

Contract Drafting & Redlining

Drafting, reviewing, and suggesting edits to legal contracts and agreements.

task.summarize_legal_contracttask.compare_docs_diff
Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

gpt-5-2025-08-07

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

35.9%

Best benchmark score

43.9%

Confidence

Ranked Models

30

Evidence Quality

84%

Evidence Points

30

Top Signal

LEXam Leaderboard: average_score_pct

All Ranked Models

30 of 30 models
RankModelScore
๐Ÿฅ‡gpt-5-2025-08-07

Strong on LEXam Leaderboard average_score_pct and Vals Legal Bench overall_accuracy_pct

35.9%
๐Ÿฅˆgpt-5-mini-2025-08-07

Strong on LEXam Leaderboard average_score_pct and Vals Case Law v2 overall_accuracy_pct

35.0%
๐Ÿฅ‰gemini-2.5-pro

Strong on LEXam Leaderboard average_score_pct and FACTS Benchmark Suite facts_grounding_score_pct

33.7%
#4gemini-3.1-pro-preview

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

32.4%
#5gemini-3-pro-preview

Strong on Vals Legal Bench overall_accuracy_pct and LEXam Leaderboard average_score_pct

29.4%
#6claude-sonnet-4

Strong on Vals Legal Bench overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

26.4%
#7gpt-4.1-20250414

Strong on Vals Case Law v2 overall_accuracy_pct and Vals Legal Bench overall_accuracy_pct

25.8%
#8Grok-4-0709

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

25.5%
#9gpt-5.2-2025-12-11

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Legal Bench overall_accuracy_pct

24.5%
#10gemini-3-flash-preview

Strong on Vals Legal Bench overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

24.5%
#11claude-sonnet-4.6

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

23.7%
#12gemini-3.1-flash-lite-preview

Strong on Vals Legal Bench overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

23.4%
#13gpt-5.4-2026-03-05

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

23.1%
#14gpt-5.1-2025-11-13

Strong on Vals Case Law v2 overall_accuracy_pct and Vals Legal Bench overall_accuracy_pct

22.6%
#15gemini-2.5-flash

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Galileo Agent Leaderboard v2 Avg TSQ

22.0%
#16grok-4-fast-reasoning

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

21.9%
#17claude-opus-4-5-20251101

Strong on Vals Legal Bench overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

20.8%
#18deepseek-r1

Strong on LEXam Leaderboard average_score_pct and SYCON Bench (Table 2) sycon_unethical_tof_pct

19.1%
#19grok-4-1-fast-reasoning

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

18.9%
#20claude-opus-4-6-thinking

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

16.7%
#21o3-20250416

Strong on Vals Legal Bench overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct

16.4%
#22claude-opus-4-5-20251101-thinking

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

16.1%
#23mistral-large-2512

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

16.0%
#25gpt-4.1

Strong on LEXam Leaderboard average_score_pct and LEXam Leaderboard open_question_judge_score_pct

15.7%
#26grok-3

Strong on Vals Legal Bench overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

15.5%
#27claude-sonnet-4-5-20250929-thinking

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

15.4%
#28claude-opus-4-1-20250805

Strong on Vals Legal Bench overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

15.2%
#30Command A (03-2025)

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

14.6%
#31Kimi K2 Thinking

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

14.6%
#32MiniMax-M2.7

Strong on Vals Legal Bench overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

14.3%

Compare Models

Select two different models above to compare their evidence side by side.
โ–ถRanking diagnostics & missing models

Source lift

Ranked

60

Sources

8

Quality

Low

Vals Legal Bench

44 rows ยท 3.4% avg lift

Vals CorpFin v2

43 rows ยท 0.9% avg lift

Vals Case Law v2

31 rows ยท 2.3% avg lift

Vals Finance Agent

31 rows ยท 0.9% avg lift

Missing frontier models

No obvious gaps right now.

โ–ถTaxonomy & task details

Core tasks

task.summarize_legal_contracttask.compare_docs_diff

Required modes

mode.long_contextmode.citations

Domains

domain.legal_contracts

Related in Legal