Marketing

Social listening brief

Summarize social chatter into themes, risks, and recommendations.

task.multi_doc_synthesistask.dashboard_narrative

Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

gemini-3.1-pro-preview

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

29.6%

Best benchmark score

33.5%

Confidence

All ranked models — top 3

🥇

gemini-3.1-pro-preview

29.6%

🥈

gemini-2.5-pro

28.9%

🥉

gpt-5-2025-08-07

27.7%

Ranked Models

Evidence Quality

83%

Evidence Points

Top Signal

Vals Finance Agent: overall_accuracy_pct

All Ranked Models

30 of 30 models

Rank	Model	Score	Confidence	Price / 1M	Evidence sources
🥇	gemini-3.1-pro-preview Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_search_score_pct	29.6%	33%	$4.50	Vals Finance AgentFACTS Benchmark Suite
🥈	gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct	28.9%	41%	$3.44	FACTS Benchmark SuiteVectara HHEM Leaderboard
🥉	gpt-5-2025-08-07 Strong on SciArena Leaderboard rating_elo and FACTS Benchmark Suite facts_grounding_score_pct	27.7%	36%	—	SciArena LeaderboardFACTS Benchmark Suite
#4	Grok-4-0709 Strong on Vals CorpFin v2 overall_accuracy_pct and Galileo Agent Leaderboard v2 Avg TSQ	25.7%	36%	—	Vals CorpFin v2Galileo Agent Leaderboard v2
#5	gemini-3-pro-preview Strong on SciArena Leaderboard rating_elo and Vals Finance Agent overall_accuracy_pct	23.8%	32%	$4.50	SciArena LeaderboardVals Finance Agent
#6	gpt-5-mini-2025-08-07 Strong on SciArena Leaderboard rating_elo and Vals Finance Agent overall_accuracy_pct	23.4%	37%	—	SciArena LeaderboardVals Finance Agent
#7	gemini-3-flash-preview Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct	22.9%	31%	$1.13	Vals CorpFin v2FACTS Benchmark Suite
#8	claude-sonnet-4 Strong on Galileo Agent Leaderboard v2 Avg TSQ and EQ-Bench Leaderboard eq_bench_score	22.0%	34%	$6.00	Galileo Agent Leaderboard v2EQ-Bench Leaderboard
#9	gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct	21.8%	27%	—	FACTS Benchmark SuiteVals CorpFin v2
#10	gpt-4.1-20250414 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct	21.5%	33%	—	Vectara HHEM LeaderboardVals CorpFin v2
#11	o3-20250416 Strong on SciArena Leaderboard rating_elo and EQ-Bench Leaderboard eq_bench_score	20.9%	31%	$3.50	SciArena LeaderboardEQ-Bench Leaderboard
#12	claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	20.9%	26%	$6.00	Vals Finance AgentVals CorpFin v2
#13	gemini-3.1-flash-lite-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct	19.9%	29%	$0.56	FACTS Benchmark SuiteVectara HHEM Leaderboard
#14	gpt-5.4-2026-03-05 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct	19.8%	24%	—	Vectara HHEM LeaderboardVals CorpFin v2
#15	claude-opus-4-5-20251101 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct	19.4%	29%	—	FACTS Benchmark SuiteVals CorpFin v2
#16	gpt-5.1-2025-11-13 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	17.7%	27%	—	Vals Finance AgentVals CorpFin v2
#17	grok-4-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	17.6%	33%	$0.28	Vals CorpFin v2Vals Finance Agent
#18	gemini-2.5-flash Strong on FACTS Benchmark Suite facts_grounding_score_pct and Galileo Agent Leaderboard v2 Avg TSQ	17.0%	29%	$0.17	FACTS Benchmark SuiteGalileo Agent Leaderboard v2
#19	grok-3 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and EQ-Bench Leaderboard eq_bench_score	16.2%	23%	$6.00	Vectara HHEM LeaderboardEQ-Bench Leaderboard
#20	grok-4-1-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	15.9%	24%	$0.28	Vals CorpFin v2Vals Finance Agent
#21	Claude-3.5-Sonnet Strong on LLM-AggreFact Leaderboard average_score_pct and LLM-AggreFact Leaderboard rag_truth_score_pct	14.6%	18%	$6.00	LLM-AggreFact LeaderboardLLM-AggreFact Leaderboard
#22	kimi-k2.5-thinking Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	14.3%	20%	—	Vals CorpFin v2Vals Finance Agent
#23	qwen-2.5-72b-instruct Strong on EQ-Bench Leaderboard eq_bench_score and Galileo Agent Leaderboard v2 Avg TSQ	14.1%	24%	—	EQ-Bench LeaderboardGalileo Agent Leaderboard v2
#24	o4-mini Strong on EQ-Bench Leaderboard eq_bench_score and Vals CorpFin v2 overall_accuracy_pct	14.0%	30%	$1.93	EQ-Bench LeaderboardVals CorpFin v2
#25	claude-opus-4-6-thinking Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	13.8%	15%	—	Vals CorpFin v2Vals Finance Agent
#26	claude-opus-4-5-20251101-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	12.8%	15%	—	Vals Finance AgentVals CorpFin v2
#27	gpt-4o Strong on CRMArena Function Calling overall_score_pct and EQ-Bench Leaderboard eq_bench_score	12.3%	17%	$0.26	CRMArena Function CallingEQ-Bench Leaderboard
#28	grok-4-1-fast-non-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_answer_rate_pct	12.0%	23%	$0.28	Vals Finance AgentVectara HHEM Leaderboard
#29	claude-sonnet-4-5-20250929-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	11.9%	15%	—	Vals Finance AgentVals CorpFin v2
#30	claude-opus-4-1-20250805 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and FACTS Benchmark Suite facts_grounding_score_pct	11.8%	22%	—	Vectara HHEM LeaderboardFACTS Benchmark Suite

Compare Models

Select two different models above to compare their evidence side by side.

▶Ranking diagnostics & missing models

Source lift

Ranked

Sources

Quality

Low

Vals CorpFin v2

44 rows · 1.3% avg lift

Vals Tax Eval v2

34 rows · 0.3% avg lift

Vals MedQA

33 rows · 0.3% avg lift

Vals Finance Agent

31 rows · 1.2% avg lift

Missing frontier models

No obvious gaps right now.

▶Taxonomy & task details

Core tasks

task.multi_doc_synthesistask.dashboard_narrative

Required modes

mode.long_context

Domains

domain.marketing_sales

Related in Marketing

Campaign brief

Draft a campaign brief with positioning, audience, and channels.

Product positioning and messaging

Develop positioning, value props, and message pillars with tradeoffs.

Social post generation

Generate short channel-specific social posts and variations.

Landing page copy

Draft landing pages with clear positioning and structure.