Marketing

PR crisis response draft

Draft a conservative public statement and internal talking points.

task.write_reporttask.rewrite_tone_style

Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

gemini-2.5-pro

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

29.2%

Best benchmark score

44.2%

Confidence

All ranked models — top 3

🥇

gemini-2.5-pro

29.2%

🥈

gemini-3.1-pro-preview

28.2%

🥉

gpt-5-2025-08-07

27.1%

Ranked Models

Evidence Quality

82%

Evidence Points

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

30 of 30 models

Rank	Model	Score	Confidence	Price / 1M	Evidence sources
🥇	gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct	29.2%	44%	$3.44	FACTS Benchmark SuiteVectara HHEM Leaderboard
🥈	gemini-3.1-pro-preview Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_search_score_pct	28.2%	32%	$4.50	Vals Finance AgentFACTS Benchmark Suite
🥉	gpt-5-2025-08-07 Strong on FACTS Benchmark Suite facts_grounding_score_pct and EQ-Bench Leaderboard eq_bench_score	27.1%	35%	—	FACTS Benchmark SuiteEQ-Bench Leaderboard
#4	gpt-4.1-20250414 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct	24.9%	38%	—	Vectara HHEM LeaderboardVals CorpFin v2
#5	claude-sonnet-4 Strong on Galileo Agent Leaderboard v2 Avg TSQ and EQ-Bench Leaderboard eq_bench_score	24.2%	36%	$6.00	Galileo Agent Leaderboard v2EQ-Bench Leaderboard
#6	Grok-4-0709 Strong on Vals CorpFin v2 overall_accuracy_pct and Galileo Agent Leaderboard v2 Avg TSQ	23.8%	33%	—	Vals CorpFin v2Galileo Agent Leaderboard v2
#7	gpt-5-mini-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	23.3%	36%	—	Vals Finance AgentVals CorpFin v2
#8	gemini-3-flash-preview Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct	21.8%	29%	$1.13	Vals CorpFin v2FACTS Benchmark Suite
#9	gemini-3-pro-preview Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	20.4%	28%	$4.50	Vals Finance AgentVals CorpFin v2
#10	claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	19.9%	25%	$6.00	Vals Finance AgentVals CorpFin v2
#11	gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct	19.8%	24%	—	FACTS Benchmark SuiteVals CorpFin v2
#12	gemini-2.5-flash Strong on FACTS Benchmark Suite facts_grounding_score_pct and Galileo Agent Leaderboard v2 Avg TSQ	19.0%	29%	$0.17	FACTS Benchmark SuiteGalileo Agent Leaderboard v2
#13	gemini-3.1-flash-lite-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct	18.9%	27%	$0.56	FACTS Benchmark SuiteVectara HHEM Leaderboard
#14	gpt-5.4-2026-03-05 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct	18.9%	23%	—	Vectara HHEM LeaderboardVals CorpFin v2
#15	o3-20250416 Strong on EQ-Bench Leaderboard eq_bench_score and Vals CorpFin v2 overall_accuracy_pct	18.4%	27%	$3.50	EQ-Bench LeaderboardVals CorpFin v2
#16	claude-opus-4-5-20251101 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct	18.1%	26%	—	FACTS Benchmark SuiteVals CorpFin v2
#17	gpt-5.1-2025-11-13 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	16.9%	26%	—	Vals Finance AgentVals CorpFin v2
#18	grok-4-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	16.8%	31%	$0.28	Vals CorpFin v2Vals Finance Agent
#19	grok-3 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and EQ-Bench Leaderboard eq_bench_score	14.9%	20%	$6.00	Vectara HHEM LeaderboardEQ-Bench Leaderboard
#20	gpt-4.1-mini-20250414 Strong on OpenVLM OCRBench Official ocrbench_score_pct and Vals CorpFin v2 overall_accuracy_pct	14.6%	22%	—	OpenVLM OCRBench OfficialVals CorpFin v2
#21	Claude-3.5-Sonnet Strong on LLM-AggreFact Leaderboard average_score_pct and EQ-Bench Leaderboard eq_bench_score	14.6%	19%	$6.00	LLM-AggreFact LeaderboardEQ-Bench Leaderboard
#22	grok-4-1-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	13.9%	21%	$0.28	Vals CorpFin v2Vals Finance Agent
#23	kimi-k2.5-thinking Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	13.6%	19%	—	Vals CorpFin v2Vals Finance Agent
#24	claude-opus-4-6-thinking Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	13.1%	14%	—	Vals CorpFin v2Vals Finance Agent
#25	gpt-4o Strong on CRMArena Function Calling overall_score_pct and EQ-Bench Leaderboard eq_bench_score	13.1%	18%	$0.26	CRMArena Function CallingEQ-Bench Leaderboard
#26	o4-mini Strong on EQ-Bench Leaderboard eq_bench_score and Vals CorpFin v2 overall_accuracy_pct	12.3%	26%	$1.93	EQ-Bench LeaderboardVals CorpFin v2
#27	claude-opus-4-5-20251101-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	12.1%	14%	—	Vals Finance AgentVals CorpFin v2
#28	claude-sonnet-4-5-20250929-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	11.4%	14%	—	Vals Finance AgentVals CorpFin v2
#29	claude-opus-4-1-20250805 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and FACTS Benchmark Suite facts_grounding_score_pct	11.2%	21%	—	Vectara HHEM LeaderboardFACTS Benchmark Suite
#32	grok-4.20-0309-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	11.1%	14%	—	Vals CorpFin v2Vals Finance Agent

Compare Models

Select two different models above to compare their evidence side by side.

▶Ranking diagnostics & missing models

Source lift

Ranked

Sources

Quality

Low

Vals CorpFin v2

43 rows · 1.3% avg lift

Vals MedQA

32 rows · 0.3% avg lift

Vals Tax Eval v2

32 rows · 0.3% avg lift

Vals Finance Agent

31 rows · 1.2% avg lift

Missing frontier models

No obvious gaps right now.

▶Taxonomy & task details

Core tasks

task.write_reporttask.rewrite_tone_style

Required modes

none

Domains

domain.marketing_sales

Related in Marketing

Social listening brief

Summarize social chatter into themes, risks, and recommendations.

Campaign brief

Draft a campaign brief with positioning, audience, and channels.

Product positioning and messaging

Develop positioning, value props, and message pillars with tradeoffs.

Social post generation

Generate short channel-specific social posts and variations.