BasedAGIBasedAGI
Finance

Thesis red teaming

Stress-test an investment thesis with counterarguments and risk.

task.tradeoff_analysistask.risk_assessment

Best for this use case

gemini-3.1-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

48.9%

Best benchmark score

56.1%

Confidence

Ranked Models

30

Evidence Quality

90%

Evidence Points

28

Top Signal

Vals Finance Agent: overall_accuracy_pct

All Ranked Models

30 of 30 models
RankModelScore
๐Ÿฅ‡gemini-3.1-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

48.9%
๐ŸฅˆGrok-4-0709

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

40.8%
๐Ÿฅ‰gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct

40.6%
#4gpt-5-mini-2025-08-07

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

39.7%
#5gpt-5-2025-08-07

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

39.3%
#6gpt-5.2-2025-12-11

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

38.8%
#7claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

38.7%
#8gemini-3-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

37.6%
#9gemini-3-flash-preview

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

37.5%
#10gpt-5.4-2026-03-05

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

36.9%
#11gemini-3.1-flash-lite-preview

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

36.0%
#12grok-4-fast-reasoning

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

33.2%
#13gpt-5.1-2025-11-13

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

33.1%
#14gpt-4.1-20250414

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Tax Eval v2 overall_accuracy_pct

32.9%
#15claude-sonnet-4

Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

30.6%
#16claude-opus-4-6-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

30.5%
#17grok-4-1-fast-reasoning

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

29.7%
#18claude-opus-4-5-20251101-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

29.0%
#19claude-opus-4-5-20251101

Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

28.7%
#20kimi-k2.5-thinking

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

28.6%
#21claude-sonnet-4-5-20250929-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

27.0%
#22grok-4.20-0309-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

26.6%
#24o3-20250416

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Tax Eval v2 overall_accuracy_pct

25.0%
#25glm-5-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

24.8%
#26qwen3.5-flash

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

24.8%
#28claude-haiku-4-5-20251001-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

23.9%
#29gpt-5.4-nano-2026-03-17

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct

23.9%
#30MiniMax-M2.7

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

23.1%
#31mistral-large-2512

Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Tax Eval v2 overall_accuracy_pct

21.2%
#32grok-4-1-fast-non-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

21.0%

Compare Models

Select two different models above to compare their evidence side by side.
โ–ถRanking diagnostics & missing models

Source lift

Ranked

57

Sources

8

Quality

Good

Vals Tax Eval v2

45 rows ยท 1.8% avg lift

Vals CorpFin v2

44 rows ยท 1.8% avg lift

Vals GPQA

37 rows ยท 0.8% avg lift

Vals Mortgage Tax

33 rows ยท 1.3% avg lift

Missing frontier models

No obvious gaps right now.

โ–ถTaxonomy & task details

Core tasks

task.tradeoff_analysistask.risk_assessment

Required modes

none

Domains

domain.finance_equity_research

Related in Finance