Multilingual Customer Support
Handling customer queries in multiple languages with cultural awareness.
Provisional leader
claude-sonnet-4
Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.
25.5%
Best benchmark score
35.9%
Confidence
All ranked models — top 3
Ranked Models
30
Evidence Quality
81%
Evidence Points
28
Top Signal
LanguageBench: overall:mean
All Ranked Models
| Rank | Model | Score |
|---|---|---|
| 🥇 | claude-sonnet-4 Strong on LanguageBench overall:mean and LanguageBench Translation Official (Split) translation_to:bleu | 25.5% |
| 🥈 | gemini-2.5-flash Strong on LanguageBench overall:mean and FACTS Benchmark Suite facts_grounding_score_pct | 25.0% |
| 🥉 | gemini-3.1-pro-preview Strong on SimpleQA Verified simpleqa_verified_score_pct and Vals Finance Agent overall_accuracy_pct | 24.2% |
| #4 | gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 22.7% |
| #5 | gpt-4.1-20250414 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Galileo Agent Leaderboard v2 Avg AC | 21.0% |
| #6 | gpt-5-2025-08-07 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Finance Agent overall_accuracy_pct | 20.4% |
| #7 | gpt-5-mini-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 20.3% |
| #8 | Claude-3.5-Sonnet Strong on LanguageBench overall:mean and LanguageBench Translation Official (Split) translation_to:bleu | 19.8% |
| #9 | Grok-4-0709 Strong on Vals Finance Agent overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct | 17.7% |
| #10 | gemini-3-flash-preview Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_answer_rate_pct | 17.4% |
| #11 | gemini-3-pro-preview Strong on SimpleQA Verified simpleqa_verified_score_pct and Vals Finance Agent overall_accuracy_pct | 17.3% |
| #13 | claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 16.5% |
| #14 | gemini-3.1-flash-lite-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 16.5% |
| #15 | gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Finance Agent overall_accuracy_pct | 16.1% |
| #16 | gpt-5.4-2026-03-05 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals Finance Agent overall_accuracy_pct | 15.3% |
| #17 | gpt-4.1 Strong on LanguageBench overall:mean and LanguageBench Translation Official (Split) translation_to:bleu | 14.2% |
| #18 | claude-opus-4-5-20251101 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 14.1% |
| #20 | gpt-5.1-2025-11-13 Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 13.7% |
| #22 | grok-4-fast-reasoning Strong on Vectara HHEM Leaderboard overall_answer_rate_pct and Vals Finance Agent overall_accuracy_pct | 13.6% |
| #23 | gemini-2.0-flash-001 Strong on LanguageBench overall:mean and LanguageBench Translation Official (Split) translation_to:bleu | 13.4% |
| #27 | Qwen3-Embedding-4B Strong on MTEB STS & Summarization Proxy Official sts_score_pct and MTEB Retrieval and Rerank (Official) retrieval_score_pct | 13.0% |
| #30 | o3-20250416 Strong on SciArena Leaderboard rating_elo and SimpleQA Verified simpleqa_verified_score_pct | 12.6% |
| #35 | gpt-4.1-mini-20250414 Strong on OpenVLM MTVQA Official mtvqa_score_pct and Galileo Agent Leaderboard v2 Avg AC | 12.0% |
| #57 | grok-4-1-fast-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard overall_answer_rate_pct | 10.8% |
| #64 | phi-4 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and LanguageBench overall:mean | 10.4% |
| #65 | grok-3 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vectara HHEM Leaderboard overall_answer_rate_pct | 10.4% |
| #67 | claude-opus-4-6-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct | 10.3% |
| #88 | kimi-k2.5-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 9.7% |
| #93 | claude-opus-4-5-20251101-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 9.5% |
| #97 | Llama-3.3-70B-Instruct Strong on LanguageBench overall:mean and LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct | 9.3% |
Compare Models
▶Ranking diagnostics & missing models
Source lift
Ranked
58
Sources
8
Quality
Low
Vals CorpFin v2
Vals Tax Eval v2
Vals Finance Agent
Vals Legal Bench
Missing frontier models
No obvious gaps right now.
▶Taxonomy & task details
Core tasks
Required modes
Domains
Related in CX
Agent-assist reply suggestions
Draft replies for human agents with tone and policy constraints.
Support dialogue agent
Multi-turn support conversations with escalation and policy awareness.
Support bot (RAG grounded)
Support chatbot grounded in docs with optional citations and escalation.
Customer feedback theme mining
Extract themes and trends from reviews, tickets, and surveys.