Productivity

Translation and localization

Translate and localize business content with formatting and glossary.

task.translate_generaltask.localize_brand_voice

Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

claude-sonnet-4

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

27.0%

Best benchmark score

36.4%

Confidence

All ranked models — top 3

🥇

claude-sonnet-4

27.0%

🥈

gemini-2.5-flash

26.3%

🥉

gemini-2.5-pro

23.2%

Ranked Models

Evidence Quality

81%

Evidence Points

Top Signal

LanguageBench Grammar/Clarity Official (Split): grammar_clarity_score_pct

All Ranked Models

30 of 30 models

Rank	Model	Score	Confidence	Price / 1M	Evidence sources
🥇	claude-sonnet-4 Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LanguageBench Translation Official (Split) translation_to:bleu	27.0%	36%	$6.00	LanguageBench Grammar/Clarity Official (Split)LanguageBench Translation Official (Split)
🥈	gemini-2.5-flash Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LanguageBench Translation Official (Split) translation_to:bleu	26.3%	35%	$0.17	LanguageBench Grammar/Clarity Official (Split)LanguageBench Translation Official (Split)
🥉	gemini-2.5-pro Strong on Galileo Agent Leaderboard v2 Avg TSQ and OpenVLM OCRBench Official ocrbench_score_pct	23.2%	46%	$3.44	Galileo Agent Leaderboard v2OpenVLM OCRBench Official
#4	gemini-3.1-pro-preview Strong on Vals Finance Agent overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct	22.2%	26%	$4.50	Vals Finance AgentSimpleQA Verified
#5	gpt-4.1-20250414 Strong on OpenVLM OCRBench Official ocrbench_score_pct and Galileo Agent Leaderboard v2 Avg TSQ	21.5%	32%	—	OpenVLM OCRBench OfficialGalileo Agent Leaderboard v2
#6	gpt-5-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and OpenVLM OCRBench Official ocrbench_score_pct	20.3%	27%	—	Vals Finance AgentOpenVLM OCRBench Official
#7	Claude-3.5-Sonnet Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LanguageBench Translation Official (Split) translation_to:bleu	20.1%	27%	$6.00	LanguageBench Grammar/Clarity Official (Split)LanguageBench Translation Official (Split)
#8	gpt-5-mini-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and OpenVLM OCRBench Official ocrbench_score_pct	19.9%	30%	—	Vals Finance AgentOpenVLM OCRBench Official
#10	Grok-4-0709 Strong on Galileo Agent Leaderboard v2 Avg TSQ and Vals Finance Agent overall_accuracy_pct	17.0%	25%	—	Galileo Agent Leaderboard v2Vals Finance Agent
#12	gemini-2.0-flash-001 Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LanguageBench Translation Official (Split) translation_to:bleu	16.3%	19%	—	LanguageBench Grammar/Clarity Official (Split)LanguageBench Translation Official (Split)
#13	gemini-3-pro-preview Strong on Vals Finance Agent overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct	16.2%	24%	$4.50	Vals Finance AgentSimpleQA Verified
#14	gpt-4.1 Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LanguageBench Translation Official (Split) translation_to:bleu	16.0%	19%	$3.50	LanguageBench Grammar/Clarity Official (Split)LanguageBench Translation Official (Split)
#15	claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct	15.8%	20%	$6.00	Vals Finance AgentVals Finance Agent
#16	gpt-5.2-2025-12-11 Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct	15.2%	18%	—	Vals Finance AgentFACTS Benchmark Suite
#17	gemini-3.1-flash-lite-preview Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	15.2%	22%	$0.56	Vals Finance AgentVals Mortgage Tax
#18	gpt-5.4-2026-03-05 Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	15.2%	20%	—	Vals Finance AgentVals Mortgage Tax
#20	gemini-3-flash-preview Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite average_score_pct	14.4%	21%	$1.13	Vals Finance AgentFACTS Benchmark Suite
#21	gpt-5.1-2025-11-13 Strong on Vals Finance Agent overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct	13.7%	20%	—	Vals Finance AgentVals Case Law v2
#22	gpt-4.1-mini-20250414 Strong on OpenVLM OCRBench Official ocrbench_score_pct and Galileo Agent Leaderboard v2 Avg TSQ	13.3%	20%	—	OpenVLM OCRBench OfficialGalileo Agent Leaderboard v2
#24	claude-opus-4-5-20251101 Strong on Vals Mortgage Tax overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct	12.8%	19%	—	Vals Mortgage TaxFACTS Benchmark Suite
#25	o3-20250416 Strong on Vals Mortgage Tax overall_accuracy_pct and SciArena Leaderboard rating_elo	12.3%	18%	$3.50	Vals Mortgage TaxSciArena Leaderboard
#26	grok-4-fast-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct	11.8%	25%	$0.28	Vals Finance AgentVals Finance Agent
#32	claude-opus-4-6-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	11.0%	13%	—	Vals Finance AgentVals Mortgage Tax
#34	phi-4 Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct	10.4%	19%	—	LanguageBench Grammar/Clarity Official (Split)Vectara HHEM Leaderboard
#35	claude-opus-4-5-20251101-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	10.3%	13%	—	Vals Finance AgentVals Mortgage Tax
#37	Llama-3.3-70B-Instruct Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LanguageBench Translation Official (Split) translation_to:bleu	10.1%	14%	—	LanguageBench Grammar/Clarity Official (Split)LanguageBench Translation Official (Split)
#38	Llama-3.1-70B-Instruct Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LanguageBench Translation Official (Split) translation_to:bleu	9.9%	17%	—	LanguageBench Grammar/Clarity Official (Split)LanguageBench Translation Official (Split)
#39	kimi-k2.5-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	9.9%	15%	—	Vals Finance AgentVals Mortgage Tax
#42	claude-sonnet-4-5-20250929-thinking Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	9.7%	13%	—	Vals Finance AgentVals Mortgage Tax
#43	grok-4-1-fast-reasoning Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard business_answer_rate_pct	9.5%	17%	$0.28	Vals Finance AgentVectara HHEM Leaderboard

Compare Models

Select two different models above to compare their evidence side by side.

▶Ranking diagnostics & missing models

Source lift

Ranked

Sources

Quality

Low

Vals Mortgage Tax

36 rows · 1.2% avg lift

Vals Legal Bench

35 rows · 0.4% avg lift

Vals MedQA

35 rows · 0.4% avg lift

Vals Tax Eval v2

33 rows · 0.3% avg lift

Missing frontier models

No obvious gaps right now.

▶Taxonomy & task details

Core tasks

task.translate_generaltask.localize_brand_voice

Required modes

mode.multilingual

Domains

domain.general_business

Related in Productivity

Knowledge base Q&A (fast, no citations)

Answer KB questions grounded in retrieved text without citations.

Knowledge base Q&A (with citations)

Answer questions grounded in an internal KB, with evidence.

Document summarization

Summarize long business documents into scannable outputs.

Decision memo

Recommend a decision with options, constraints, and risks.