Route alternatives planning
Propose alternative routes and tradeoffs under disruptions.
Provisional leader
claude-sonnet-4
Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.
24.2%
Best benchmark score
32.0%
Confidence
All ranked models — top 3
Ranked Models
30
Evidence Quality
80%
Evidence Points
22
Top Signal
Galileo Agent Leaderboard v2: Avg TSQ
All Ranked Models
| Rank | Model | Score |
|---|---|---|
| 🥇 | claude-sonnet-4 Strong on Galileo Agent Leaderboard v2 Avg TSQ and LanguageBench overall:mean | 24.2% |
| 🥈 | gpt-5-2025-08-07 Strong on SciArena Leaderboard rating_elo and Aider Polyglot Leaderboard percent_correct_pct | 22.0% |
| 🥉 | gemini-2.5-pro Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC | 21.8% |
| #4 | gemini-2.5-flash Strong on Galileo Agent Leaderboard v2 Avg TSQ and LanguageBench overall:mean | 19.2% |
| #5 | Grok-4-0709 Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC | 18.9% |
| #6 | gpt-5-mini-2025-08-07 Strong on SciArena Leaderboard rating_elo and Vals MedQA overall_accuracy_pct | 18.1% |
| #7 | gemini-3.1-pro-preview Strong on Vals Mortgage Tax overall_accuracy_pct and Vals GPQA overall_accuracy_pct | 17.3% |
| #8 | gpt-4.1-20250414 Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC | 17.3% |
| #9 | o3-20250416 Strong on SciArena Leaderboard rating_elo and Aider Polyglot Leaderboard percent_correct_pct | 17.2% |
| #10 | gemini-3-pro-preview Strong on SciArena Leaderboard rating_elo and Vals Mortgage Tax overall_accuracy_pct | 15.7% |
| #11 | claude-sonnet-4.6 Strong on HalluHard Leaderboard overall_hallucination_error_pct and Vals Tax Eval v2 overall_accuracy_pct | 14.1% |
| #12 | gemini-3-flash-preview Strong on Vals Legal Bench overall_accuracy_pct and Vals MedQA overall_accuracy_pct | 14.0% |
| #13 | gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Tax Eval v2 overall_accuracy_pct | 13.8% |
| #14 | Claude-3.5-Sonnet Strong on LanguageBench overall:mean and LLM-AggreFact Leaderboard average_score_pct | 13.2% |
| #15 | gpt-5.4-2026-03-05 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals MedQA overall_accuracy_pct | 13.2% |
| #16 | gpt-5.1-2025-11-13 Strong on Vals Case Law v2 overall_accuracy_pct and Vals MedScribe overall_accuracy_pct | 12.9% |
| #17 | qwen-2.5-72b-instruct Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC | 12.7% |
| #18 | o4-mini Strong on SciArena Leaderboard rating_elo and Aider Polyglot Leaderboard percent_correct_pct | 12.3% |
| #19 | deepseek-r1 Strong on ContractEval Leaderboard contract_adherence_csr_pct and SciArena Leaderboard rating_elo | 12.2% |
| #20 | claude-opus-4-6-thinking Strong on Vals SWE-bench overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct | 12.1% |
| #21 | gpt-4.1-mini-20250414 Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC | 11.9% |
| #22 | claude-opus-4-5-20251101-thinking Strong on Vals MedQA overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct | 11.7% |
| #23 | claude-opus-4-5-20251101 Strong on Vals Mortgage Tax overall_accuracy_pct and Vals MedQA overall_accuracy_pct | 11.7% |
| #24 | gemini-3.1-flash-lite-preview Strong on Vals Mortgage Tax overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 11.7% |
| #25 | kimi-k2.5-thinking Strong on Vals CorpFin v2 overall_accuracy_pct and Vals MedQA overall_accuracy_pct | 11.6% |
| #26 | gpt-4o Strong on MEGA-Bench app:Planning and MEGA-Bench overall_score | 11.1% |
| #27 | gpt-4.1 Strong on LanguageBench overall:mean and SciArena Leaderboard rating_elo | 11.1% |
| #28 | grok-4-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Tax Eval v2 overall_accuracy_pct | 10.7% |
| #29 | claude-sonnet-4-5-20250929-thinking Strong on Vals MedQA overall_accuracy_pct and Vals Legal Bench overall_accuracy_pct | 10.6% |
| #32 | grok-4-1-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals MedQA overall_accuracy_pct | 9.6% |
Compare Models
▶Ranking diagnostics & missing models
Source lift
Ranked
58
Sources
8
Quality
Low
Vals Legal Bench
Vals Tax Eval v2
Vals GPQA
Vals LiveCodeBench
Missing frontier models
No obvious gaps right now.
▶Taxonomy & task details
Core tasks
Required modes
Domains
Related in Supply Chain
Disruption monitoring brief
Summarize disruptions into risk, options, and recommendations.
Supplier risk monitoring
Track supplier risk signals from multi-source text and summarize actions.
Vendor contract summary (procurement)
Summarize vendor contracts into key terms, risks, and deviations.
Tail spend categorization
Categorize tail spend purchases into taxonomy buckets for sourcing.