Finance

Filings summarization (10-K/10-Q)

Summarize filings with conservative factuality and risk highlights.

task.summarize_doctask.entity_extraction

Best for this use case

gemini-3.1-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

38.5%

Best benchmark score

44.2%

Confidence

All ranked models — top 3

🥇

gemini-3.1-pro-preview

38.5%

🥈

Grok-4-0709

32.6%

🥉

gpt-5-2025-08-07

32.4%

Ranked Models

Evidence Quality

87%

Evidence Points

Top Signal

Vals Finance Agent: overall_accuracy_pct

All Ranked Models

30 of 30 models

Rank	Model	Score	Confidence	Price / 1M	Evidence sources
🥇	gemini-3.1-pro-preview Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	38.5%	44%	$4.50	Vals Finance AgentVals CorpFin v2
🥈	Grok-4-0709 Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	32.6%	46%	—	Vals CorpFin v2Vals Finance Agent
🥉	gpt-5-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	32.4%	44%	—	Vals Finance AgentVals CorpFin v2
#4	gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct	31.9%	47%	$3.44	FACTS Benchmark SuiteVals CorpFin v2
#5	gpt-5-mini-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	31.3%	45%	—	Vals Finance AgentVals CorpFin v2
#6	gpt-5.2-2025-12-11 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	31.2%	36%	—	Vals Finance AgentVals CorpFin v2
#7	claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	30.5%	36%	$6.00	Vals Finance AgentVals CorpFin v2
#8	gemini-3-pro-preview Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	30.5%	41%	$4.50	Vals Finance AgentVals CorpFin v2
#9	gemini-3-flash-preview Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	29.5%	40%	$1.13	Vals CorpFin v2Vals Finance Agent
#10	gpt-4.1-20250414 Strong on Vals CorpFin v2 overall_accuracy_pct and MMLongBench-Doc Leaderboard acc_score_pct	29.2%	41%	—	Vals CorpFin v2MMLongBench-Doc Leaderboard
#11	gpt-5.4-2026-03-05 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	29.0%	35%	—	Vals Finance AgentVals CorpFin v2
#12	gemini-3.1-flash-lite-preview Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	28.4%	41%	$0.56	Vals Finance AgentVals CorpFin v2
#13	grok-4-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	26.2%	44%	$0.28	Vals CorpFin v2Vals Finance Agent
#14	gpt-5.1-2025-11-13 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	26.1%	38%	—	Vals Finance AgentVals CorpFin v2
#15	grok-4-1-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	24.2%	34%	$0.28	Vals CorpFin v2Vals Finance Agent
#16	claude-sonnet-4 Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct	24.1%	38%	$6.00	Vals CorpFin v2FACTS Benchmark Suite
#17	claude-opus-4-6-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	24.0%	27%	—	Vals Finance AgentVals CorpFin v2
#18	claude-opus-4-5-20251101-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	22.9%	27%	—	Vals Finance AgentVals CorpFin v2
#19	claude-opus-4-5-20251101 Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct	22.8%	33%	—	Vals CorpFin v2FACTS Benchmark Suite
#20	kimi-k2.5-thinking Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	22.5%	29%	—	Vals CorpFin v2Vals Finance Agent
#21	claude-sonnet-4-5-20250929-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	21.3%	27%	—	Vals Finance AgentVals CorpFin v2
#22	grok-4.20-0309-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	21.0%	27%	—	Vals Finance AgentVals CorpFin v2
#24	o3-20250416 Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Tax Eval v2 overall_accuracy_pct	19.9%	30%	$3.50	Vals CorpFin v2Vals Tax Eval v2
#25	glm-5-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	19.6%	26%	—	Vals Finance AgentVals CorpFin v2
#26	qwen3.5-flash Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	19.5%	26%	—	Vals CorpFin v2Vals Finance Agent
#28	claude-haiku-4-5-20251001-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	18.9%	27%	—	Vals Finance AgentVals CorpFin v2
#29	gpt-5.4-nano-2026-03-17 Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct	18.8%	26%	—	Vals CorpFin v2Vals Finance Agent
#30	MiniMax-M2.7 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	18.2%	25%	$0.53	Vals Finance AgentVals CorpFin v2
#31	grok-4-1-fast-non-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct	17.2%	33%	$0.28	Vals Finance AgentVals CorpFin v2
#32	mistral-large-2512 Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Tax Eval v2 overall_accuracy_pct	16.7%	32%	—	Vals CorpFin v2Vals Tax Eval v2