BasedAGIBasedAGI
CX

Customer feedback theme mining

Extract themes and trends from reviews, tickets, and surveys.

task.multi_doc_synthesistask.dedupe_normalize_records
Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

gemini-3.1-pro-preview

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

29.1%

Best benchmark score

33.3%

Confidence

Ranked Models

30

Evidence Quality

82%

Evidence Points

22

Top Signal

SimpleQA Verified: simpleqa_verified_score_pct

All Ranked Models

30 of 30 models
RankModelScore
๐Ÿฅ‡gemini-3.1-pro-preview

Strong on SimpleQA Verified simpleqa_verified_score_pct and Vals Finance Agent overall_accuracy_pct

29.1%
๐Ÿฅˆgemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

25.7%
๐Ÿฅ‰gpt-5-2025-08-07

Strong on SciArena Leaderboard rating_elo and FACTS Benchmark Suite facts_grounding_score_pct

24.0%
#4gpt-5-mini-2025-08-07

Strong on SciArena Leaderboard rating_elo and Vals Finance Agent overall_accuracy_pct

23.6%
#5gemini-3-pro-preview

Strong on SimpleQA Verified simpleqa_verified_score_pct and SciArena Leaderboard rating_elo

22.4%
#6Grok-4-0709

Strong on Vals Finance Agent overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct

21.8%
#7gemini-3-flash-preview

Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_answer_rate_pct

20.9%
#8gpt-4.1-20250414

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Galileo Agent Leaderboard v2 Avg AC

20.3%
#9gpt-5.2-2025-12-11

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Finance Agent overall_accuracy_pct

20.0%
#10claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

19.8%
#11gemini-3.1-flash-lite-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

19.8%
#12gpt-5.4-2026-03-05

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals Finance Agent overall_accuracy_pct

18.3%
#13claude-sonnet-4

Strong on Galileo Agent Leaderboard v2 Avg AC and Vectara HHEM Leaderboard overall_hallucination_error_pct

18.1%
#14gemini-2.5-flash

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

17.1%
#15claude-opus-4-5-20251101

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

17.1%
#16gpt-5.1-2025-11-13

Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct

16.4%
#17grok-4-fast-reasoning

Strong on Vectara HHEM Leaderboard overall_answer_rate_pct and Vals Finance Agent overall_accuracy_pct

16.3%
#18o3-20250416

Strong on SciArena Leaderboard rating_elo and SimpleQA Verified simpleqa_verified_score_pct

16.3%
#19grok-4-1-fast-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_answer_rate_pct

13.8%
#20grok-3

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vectara HHEM Leaderboard overall_answer_rate_pct

12.9%
#21claude-opus-4-6-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct

12.4%
#22Claude-3.5-Sonnet

Strong on LLM-AggreFact Leaderboard average_score_pct and LLM-AggreFact Leaderboard rag_truth_score_pct

11.9%
#25kimi-k2.5-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

11.6%
#26Qwen3-Embedding-4B

Strong on MTEB Retrieval and Rerank (Official) retrieval_score_pct and BEIR-Style Retrieval (Official MTEB Slice) beir_average_score_pct

11.6%
#30claude-opus-4-5-20251101-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

11.4%
#32qwen-2.5-72b-instruct

Strong on Galileo Agent Leaderboard v2 Avg AC and LLM-AggreFact Leaderboard average_score_pct

10.8%
#33claude-sonnet-4-5-20250929-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct

10.8%
#34grok-4-1-fast-non-reasoning

Strong on Vectara HHEM Leaderboard overall_answer_rate_pct and Vals Finance Agent overall_accuracy_pct

10.8%
#37claude-opus-4-1-20250805

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and FACTS Benchmark Suite facts_grounding_score_pct

10.7%
#40glm-5-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct

10.5%

Compare Models

Select two different models above to compare their evidence side by side.
โ–ถRanking diagnostics & missing models

Source lift

Ranked

56

Sources

8

Quality

Low

Vals CorpFin v2

43 rows ยท 1.0% avg lift

Vals Legal Bench

33 rows ยท 0.2% avg lift

Vals MedQA

32 rows ยท 0.2% avg lift

Vals Tax Eval v2

32 rows ยท 0.2% avg lift

Missing frontier models

No obvious gaps right now.

โ–ถTaxonomy & task details

Core tasks

task.multi_doc_synthesistask.dedupe_normalize_records

Required modes

mode.long_context

Domains

domain.customer_support

Related in CX