Patient education bot (RAG grounded)
Answer patient FAQ using trusted sources with cautious wording.
Provisional leader
gemini-2.5-flash
Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.
26.9%
Best benchmark score
37.5%
Confidence
All ranked models — top 3
Ranked Models
30
Evidence Quality
83%
Evidence Points
24
Top Signal
LanguageBench Translation Official (Split): translation_to:bleu
All Ranked Models
| Rank | Model | Score |
|---|---|---|
| 🥇 | gemini-2.5-flash Strong on LanguageBench Translation Official (Split) translation_to:bleu and FACTS Benchmark Suite facts_grounding_score_pct | 26.9% |
| 🥈 | claude-sonnet-4 Strong on LanguageBench Translation Official (Split) translation_to:bleu and Galileo Agent Leaderboard v2 Healthcare AC | 26.8% |
| 🥉 | gemini-3.1-pro-preview Strong on SimpleQA Verified simpleqa_verified_score_pct and FACTS Benchmark Suite facts_grounding_score_pct | 26.8% |
| #4 | gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 26.5% |
| #5 | gpt-5-mini-2025-08-07 Strong on Vals MedQA overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct | 25.2% |
| #6 | gpt-5-2025-08-07 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals MedQA overall_accuracy_pct | 24.2% |
| #7 | gpt-4.1-20250414 Strong on Galileo Agent Leaderboard v2 Healthcare AC and Vals MedQA overall_accuracy_pct | 23.4% |
| #8 | Grok-4-0709 Strong on Vals MedQA overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 20.5% |
| #9 | gemini-3-flash-preview Strong on Vals MedQA overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct | 20.5% |
| #10 | gemini-3-pro-preview Strong on SimpleQA Verified simpleqa_verified_score_pct and Vals MedQA overall_accuracy_pct | 20.0% |
| #11 | claude-opus-4-5-20251101 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals MedQA overall_accuracy_pct | 18.7% |
| #12 | gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals MedQA overall_accuracy_pct | 18.4% |
| #13 | gpt-5.4-2026-03-05 Strong on Vals MedQA overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 18.3% |
| #14 | Claude-3.5-Sonnet Strong on LanguageBench Translation Official (Split) translation_to:bleu and LLM-AggreFact Leaderboard average_score_pct | 17.6% |
| #15 | gemini-3.1-flash-lite-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 17.1% |
| #16 | claude-sonnet-4.6 Strong on Vals MedQA overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct | 17.0% |
| #17 | gpt-5.1-2025-11-13 Strong on Vals MedQA overall_accuracy_pct and Vals MedScribe overall_accuracy_pct | 16.5% |
| #18 | grok-4-fast-reasoning Strong on Vals MedQA overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 16.4% |
| #20 | o3-20250416 Strong on Vals MedQA overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct | 15.4% |
| #21 | gpt-4.1-mini-20250414 Strong on Galileo Agent Leaderboard v2 Healthcare AC and Vals MedQA overall_accuracy_pct | 14.5% |
| #23 | grok-4-1-fast-reasoning Strong on Vals MedQA overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 13.5% |
| #24 | claude-opus-4-6-thinking Strong on Vals MedQA overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 13.4% |
| #25 | gemini-2.0-flash-001 Strong on LanguageBench Translation Official (Split) translation_to:bleu and BRIDGE Medical Leaderboard average_performance_pct | 13.3% |
| #26 | claude-opus-4-5-20251101-thinking Strong on Vals MedQA overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct | 12.7% |
| #27 | claude-opus-4-1-20250805 Strong on Vals MedQA overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct | 12.7% |
| #28 | grok-3 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals MedQA overall_accuracy_pct | 12.6% |
| #29 | kimi-k2.5-thinking Strong on Vals MedQA overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 12.2% |
| #30 | gpt-4o Strong on MedHELM average_score_pct and MedHELM clinical_note_generation_win_rate_pct | 11.9% |
| #31 | claude-sonnet-4-5-20250929-thinking Strong on Vals MedQA overall_accuracy_pct and Vals MedScribe overall_accuracy_pct | 11.9% |
| #32 | gemini-2.5-flash-lite Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Galileo Agent Leaderboard v2 Healthcare AC | 11.5% |
Compare Models
▶Ranking diagnostics & missing models
Source lift
Ranked
57
Sources
8
Quality
Low
Vals CorpFin v2
Vals MedQA
Vals MedScribe
Vals Finance Agent
Missing frontier models
No obvious gaps right now.
▶Taxonomy & task details
Core tasks
Required modes
Domains
Related in Healthcare
Medical coding support (suggestions)
Extract coding-relevant facts and suggest codes for human review.
Patient-friendly explanations
Rewrite technical notes into clear, accessible patient language.
Clinical note drafting
Summarize encounters into structured notes for clinician review.
Medical chart summary
Summarize a patient's chart into timeline, problems, and meds for review.