Knowledge base Q&A (with citations)
Answer questions grounded in an internal KB, with evidence.
Provisional leader
gemini-2.5-pro
Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.
35.2%
Best benchmark score
53.8%
Confidence
All ranked models — top 3
Ranked Models
30
Evidence Quality
84%
Evidence Points
34
Top Signal
FACTS Benchmark Suite: facts_grounding_score_pct
All Ranked Models
| Rank | Model | Score |
|---|---|---|
| 🥇 | gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct and BasedAGI KB Q&A Eval overall_score_pct | 35.2% |
| 🥈 | gpt-5-2025-08-07 Strong on BasedAGI KB Q&A Eval overall_score_pct and FACTS Benchmark Suite facts_grounding_score_pct | 34.0% |
| 🥉 | gemini-3.1-pro-preview Strong on SimpleQA Verified simpleqa_verified_score_pct and Vals Finance Agent overall_accuracy_pct | 33.6% |
| #4 | gemini-3-pro-preview Strong on BasedAGI KB Q&A Eval overall_score_pct and SimpleQA Verified simpleqa_verified_score_pct | 32.6% |
| #5 | claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 29.1% |
| #6 | gpt-5-mini-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 28.6% |
| #7 | Grok-4-0709 Strong on Vals Finance Agent overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct | 28.1% |
| #8 | gemini-3.1-flash-lite-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 23.5% |
| #9 | gemini-3-flash-preview Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_search_score_pct | 23.3% |
| #10 | gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Finance Agent overall_accuracy_pct | 22.7% |
| #11 | gpt-5.4-2026-03-05 Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 21.8% |
| #12 | claude-sonnet-4 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Galileo Agent Leaderboard v2 Avg TSQ | 21.4% |
| #13 | gpt-4.1-20250414 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct | 20.4% |
| #14 | gemini-2.5-flash Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 20.1% |
| #15 | claude-opus-4-5-20251101 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 19.8% |
| #16 | gpt-5.1-2025-11-13 Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 19.3% |
| #17 | grok-4-fast-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 18.5% |
| #18 | o3-20250416 Strong on SciArena Leaderboard rating_elo and SimpleQA Verified simpleqa_verified_score_pct | 17.1% |
| #19 | claude-opus-4-6-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 15.1% |
| #20 | kimi-k2.5-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 15.0% |
| #21 | grok-4-1-fast-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 14.8% |
| #22 | claude-opus-4-5-20251101-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 13.9% |
| #23 | grok-3 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and SimpleQA Verified simpleqa_verified_score_pct | 13.9% |
| #24 | claude-sonnet-4-5-20250929-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 13.2% |
| #26 | claude-opus-4-1-20250805 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and FACTS Benchmark Suite facts_grounding_score_pct | 12.7% |
| #27 | grok-4.20-0309-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 12.5% |
| #28 | mistral-large-2512 Strong on Vals CorpFin v2 overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 12.1% |
| #29 | deepseek-v3 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and SYCON Bench (Table 2) sycon_unethical_tof_pct | 12.0% |
| #30 | glm-5-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 11.9% |
| #31 | claude-haiku-4-5-20251001-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 11.6% |
Compare Models
▶Ranking diagnostics & missing models
Source lift
Ranked
58
Sources
8
Quality
Low
Vals CorpFin v2
Vals Mortgage Tax
Vals Finance Agent
Vectara HHEM Leaderboard
Missing frontier models
No obvious gaps right now.
▶Taxonomy & task details
Core tasks
Required modes
Domains
Related in Productivity
Knowledge base Q&A (fast, no citations)
Answer KB questions grounded in retrieved text without citations.
Document summarization
Summarize long business documents into scannable outputs.
Decision memo
Recommend a decision with options, constraints, and risks.
Executive briefing
Turn raw notes into a short executive brief with risks and actions.