BasedAGIBasedAGI
Data & Analytics

Dashboard narratives

Generate weekly KPI narratives and investigation suggestions.

task.dashboard_narrativetask.risk_assessment
Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

gpt-5-2025-08-07

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

25.2%

Best benchmark score

33.9%

Confidence

Ranked Models

30

Evidence Quality

82%

Evidence Points

29

Top Signal

SciArena Leaderboard: rating_elo

All Ranked Models

30 of 30 models
RankModelScore
๐Ÿฅ‡gpt-5-2025-08-07

Strong on SciArena Leaderboard rating_elo and FACTS Benchmark Suite facts_grounding_score_pct

25.2%
๐Ÿฅˆgemini-3.1-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_search_score_pct

24.1%
๐Ÿฅ‰gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

20.9%
#4o3-20250416

Strong on SciArena Leaderboard rating_elo and LiveSQLBench success_rate_pct

20.0%
#5gpt-5-mini-2025-08-07

Strong on SciArena Leaderboard rating_elo and Vals Finance Agent overall_accuracy_pct

19.9%
#6gemini-3-pro-preview

Strong on SciArena Leaderboard rating_elo and Vals Finance Agent overall_accuracy_pct

19.3%
#7claude-sonnet-4

Strong on LiveSQLBench success_rate_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

19.0%
#8gemini-3-flash-preview

Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

18.4%
#9Grok-4-0709

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

18.1%
#10gpt-5.2-2025-12-11

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct

17.8%
#11gemini-3.1-flash-lite-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

17.0%
#12claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

16.8%
#13gpt-4.1-20250414

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct

16.3%
#14gpt-5.4-2026-03-05

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct

15.8%
#15claude-opus-4-5-20251101

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct

15.4%
#16deepseek-r1

Strong on DuckDB NSQL Leaderboard all_execution_accuracy and LiveSQLBench success_rate_pct

15.3%
#17gpt-5.1-2025-11-13

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

14.3%
#18grok-4-fast-reasoning

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

14.2%
#19qwen-2.5-72b-instruct

Strong on DuckDB NSQL Leaderboard all_execution_accuracy and JSONSchemaBench Leaderboard medium_schema_compliance_pct

13.8%
#20Claude-3.5-Sonnet

Strong on DuckDB NSQL Leaderboard all_execution_accuracy and LLM-AggreFact Leaderboard average_score_pct

13.6%
#21gemini-2.5-flash

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

13.6%
#22gpt-4o

Strong on DuckDB NSQL Leaderboard all_execution_accuracy and JSONSchemaBench Leaderboard medium_schema_compliance_pct

12.8%
#23grok-4-1-fast-reasoning

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

12.7%
#25gpt-4o-20241120

Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy

12.4%
#26o4-mini

Strong on LiveSQLBench success_rate_pct and Vals CorpFin v2 overall_accuracy_pct

12.1%
#28claude-opus-4-6-thinking

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

11.7%
#29grok-3

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct

11.5%
#30gpt-4o-2024-08-06

Strong on DuckDB NSQL Leaderboard all_execution_accuracy and Vectara HHEM Leaderboard overall_hallucination_error_pct

11.2%
#31kimi-k2.5-thinking

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

11.2%
#32claude-opus-4-6

Strong on LiveSQLBench success_rate_pct and AgentSet LLM Leaderboard elo_score

10.9%

Compare Models

Select two different models above to compare their evidence side by side.
โ–ถRanking diagnostics & missing models

Source lift

Ranked

56

Sources

8

Quality

Low

Vals CorpFin v2

42 rows ยท 1.2% avg lift

Vals MedQA

32 rows ยท 0.3% avg lift

Vals Finance Agent

31 rows ยท 1.1% avg lift

Vals Tax Eval v2

31 rows ยท 0.3% avg lift

Missing frontier models

No obvious gaps right now.

โ–ถTaxonomy & task details

Core tasks

task.dashboard_narrativetask.risk_assessment

Required modes

none

Domains

domain.data_analytics_bi

Related in Data & Analytics