Model Profile
gpt-4o-2024-08-06
Use this page to decide where this model is a strong fit. Rankings below are benchmark-backed by use case, with explicit confidence and contributor metrics.
Identity
ID: external/openai/gpt-4o-2024-08-06
Author: openai
Origin: external_benchmark_shadow
Arch: unknown
Benchmark Coverage
Scored use cases: 12
Avg confidence: 31.6%
Evidence points: 211
Raw rows: 360
Weighted rows: 35
Catalog Metadata
Parameters: unknown
Context window: 4096
Downloads: 0
Intelligence Profile
Dimension Breakdown
No eq benchmarks found
No creativity benchmarks found
No based benchmarks found
* Low confidence — limited benchmark evidence for this dimension
2/5 dimensions scored · Last updated Apr 21, 2026
Benchmark Signals
Click through to the benchmark source behind this model profile.
DuckDB NSQL Leaderboard
all_execution_accuracy
Normalized value 80.8% · confidence 100.0%
Strongest impact in Metric definition workshop
duckdb_nsql_leaderboard.all_execution_accuracy · Apr 1, 2026
Vals Tax Eval v2
overall_accuracy_pct
Normalized value 83.1% · confidence 100.0%
Strongest impact in Accounts payable invoice extraction (text)
vals_tax_eval_v2.overall_accuracy_pct · Mar 31, 2026
Aider Code Editing Leaderboard
percent_correct_pct
Normalized value 80.0% · confidence 100.0%
Strongest impact in Simulation setup assistant
aider_code_editing.percent_correct_pct · Apr 1, 2026
Vals Mortgage Tax
overall_accuracy_pct
Normalized value 81.7% · confidence 100.0%
Strongest impact in Accounts payable invoice extraction (text)
vals_mortgage_tax.overall_accuracy_pct · Mar 31, 2026
Vectara HHEM Leaderboard
overall_hallucination_error_pct
Normalized value 64.1% · confidence 100.0%
Strongest impact in Thesis red teaming
vectara_hhem_leaderboard.overall_hallucination_error_pct · Apr 1, 2026
BigCodeBench Official
bigcodebench_hard_complete_pct
Normalized value 89.8% · confidence 100.0%
Strongest impact in Simulation setup assistant
bigcodebench_official.bigcodebench_hard_complete_pct · Apr 1, 2026
Some fit rows have limited benchmark evidence.
2 of 12 scored use cases have low confidence or thin contributor coverage.
Coverage Diagnostics
actively scoredUse-Case Scores
133
Total Measurements
360
Weighted Measurements
35
Weighted Sources
14
Raw Source Coverage
Weighted Source Coverage
Best Use Cases for This Model
| Use Case | Score |
|---|---|
| Metric definition workshop use_case.data.metric_definition_workshop | 15.8% |
| Thesis red teaming use_case.fin.thesis_red_team | 15.2% |
| Accounts payable invoice extraction (text) use_case.fin.ap_invoice_extraction | 15.0% |
| Data quality assistant use_case.data.data_quality_assistant | 14.7% |
| Earnings call synthesis use_case.fin.earnings_call_synthesis | 14.5% |
| AML alert triage use_case.fin.aml_alert_triage | 13.7% |
| KYC profile synthesis use_case.fin.kyc_profile_synthesis | 13.7% |
| Simulation setup assistant use_case.eng.simulation_setup_assistant | 13.7% |
| Text-to-SQL analyst assistant use_case.data.text_to_sql | 13.5% |
| Transaction anomaly narrative use_case.fin.transaction_anomaly_narrative | 13.5% |
| Quant research code generation use_case.fin.alpha_research_codegen | 13.3% |
| Executive brief from metrics use_case.data.exec_brief_from_metrics | 13.3% |