Data quality assistant
Propose validation checks and likely data issues from schema and symptoms.
Provisional leader
gpt-4o
Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.
24.2%
Best benchmark score
43.5%
Confidence
All ranked models — top 3
Ranked Models
30
Evidence Quality
81%
Evidence Points
17
Top Signal
DuckDB NSQL Leaderboard: all_execution_accuracy
All Ranked Models
| Rank | Model | Score |
|---|---|---|
| 🥇 | gpt-4o Strong on DuckDB NSQL Leaderboard all_execution_accuracy and JSONSchemaBench Leaderboard medium_schema_compliance_pct | 24.2% |
| 🥈 | deepseek-r1 Strong on DuckDB NSQL Leaderboard all_execution_accuracy and LiveSQLBench success_rate_pct | 23.8% |
| 🥉 | gpt-5-2025-08-07 Strong on LiveSQLBench success_rate_pct and Spider2.0 Snow Text-to-SQL snow_text_to_sql_score_pct | 23.2% |
| #4 | claude-sonnet-4 Strong on LiveSQLBench success_rate_pct and Galileo Agent Leaderboard v2 Avg AC | 22.6% |
| #7 | o3-20250416 Strong on LiveSQLBench success_rate_pct and Spider2.0 Snow Text-to-SQL snow_text_to_sql_score_pct | 21.1% |
| #8 | qwen-2.5-72b-instruct Strong on DuckDB NSQL Leaderboard all_execution_accuracy and JSONSchemaBench Leaderboard medium_schema_compliance_pct | 20.7% |
| #9 | gpt-4o-20241120 Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy | 20.1% |
| #11 | gpt-4.1 Strong on DuckDB NSQL Leaderboard all_execution_accuracy and Aider Polyglot Leaderboard percent_correct_pct | 16.3% |
| #12 | gpt-4o-mini-2024-07-18 Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy | 15.7% |
| #14 | Claude-3.5-Sonnet Strong on DuckDB NSQL Leaderboard all_execution_accuracy and LanguageBench mmlu:accuracy | 14.9% |
| #15 | gpt-4o-2024-08-06 Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy | 14.7% |
| #16 | gemini-2.5-pro Strong on Galileo Agent Leaderboard v2 Avg AC and Galileo Agent Leaderboard v2 Avg TSQ | 14.1% |
| #19 | gemini-3.1-pro-preview Strong on Vals Mortgage Tax overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct | 13.9% |
| #21 | o4-mini Strong on LiveSQLBench success_rate_pct and Aider Polyglot Leaderboard percent_correct_pct | 13.1% |
| #22 | Grok-4-0709 Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC | 12.8% |
| #23 | gemini-2.0-flash-001 Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy | 12.6% |
| #24 | gpt-5-mini-2025-08-07 Strong on Vals MedQA overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct | 12.5% |
| #28 | gpt-4.1-20250414 Strong on Galileo Agent Leaderboard v2 Avg AC and Galileo Agent Leaderboard v2 Avg TSQ | 12.1% |
| #32 | Llama-3.3-70B-Instruct Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy | 11.4% |
| #33 | gemini-3-flash-preview Strong on Vals Legal Bench overall_accuracy_pct and Vals MedQA overall_accuracy_pct | 11.2% |
| #35 | gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Tax Eval v2 overall_accuracy_pct | 11.1% |
| #36 | claude-opus-4-6 Strong on LiveSQLBench success_rate_pct and AgentSet LLM Leaderboard elo_score | 10.9% |
| #37 | deepseek-v3 Strong on LiveSQLBench success_rate_pct and Galileo Agent Leaderboard v2 Avg AC | 10.9% |
| #38 | gemini-3-pro-preview Strong on Vals Mortgage Tax overall_accuracy_pct and Vals Legal Bench overall_accuracy_pct | 10.8% |
| #39 | minimax-m2.1 Strong on LiveSQLBench success_rate_pct and Vals SWE-bench overall_accuracy_pct | 10.8% |
| #41 | gemini-2.5-flash Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC | 10.6% |
| #42 | gpt-5.4-2026-03-05 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals MedQA overall_accuracy_pct | 10.6% |
| #44 | gemma-2-27b-it Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy | 10.4% |
| #45 | Qwen3-30B-A3B Strong on DuckDB NSQL Leaderboard all_execution_accuracy and DuckDB NSQL Leaderboard hard_execution_accuracy | 10.4% |
| #46 | gpt-5.1-2025-11-13 Strong on Vals Case Law v2 overall_accuracy_pct and Vals MedScribe overall_accuracy_pct | 10.3% |
Compare Models
▶Ranking diagnostics & missing models
Source lift
Ranked
61
Sources
8
Quality
Low
Vals Legal Bench
Vals MedQA
Vals Tax Eval v2
Vals LiveCodeBench
Missing frontier models
No obvious gaps right now.
▶Taxonomy & task details
Core tasks
Required modes
Domains
Related in Data & Analytics
SQL debugging
Diagnose and fix SQL queries for correctness and performance.
Metric definition workshop
Turn ambiguous KPI definitions into precise, measurable specs.
Dashboard narratives
Generate weekly KPI narratives and investigation suggestions.
Chart & Data Visualization Interpretation
Reading charts, graphs, and dashboards to extract insights and answer questions.