Model Profile
gpt-4o-2024-05-13
Use this page to decide where this model is a strong fit. Rankings below are benchmark-backed by use case, with explicit confidence and contributor metrics.
Identity
ID: external/openai/gpt-4o-2024-05-13
Author: openai
Origin: external_benchmark_shadow
Arch: unknown
Benchmark Coverage
Scored use cases: 12
Avg confidence: 34.0%
Evidence points: 137
Raw rows: 191
Weighted rows: 21
Catalog Metadata
Parameters: unknown
Context window: 4096
Downloads: 0
Intelligence Profile
Dimension Breakdown
No eq benchmarks found
* Low confidence — limited benchmark evidence for this dimension
4/5 dimensions scored · Last updated Apr 21, 2026
Benchmark Signals
Click through to the benchmark source behind this model profile.
LLM Trustworthy Leaderboard
privacy
Normalized value 99.3% · confidence 100.0%
Strongest impact in Jailbreak resistance (eval)
llm_trustworthy_leaderboard.privacy · Mar 31, 2026
RepoQA Official Results
overall_average_pass_at_1_pct
Normalized value 99.3% · confidence 100.0%
Strongest impact in Debugging assistant
repoqa_leaderboard.overall_average_pass_at_1_pct · Apr 1, 2026
LLM Trustworthy Leaderboard
adv
Normalized value 60.7% · confidence 100.0%
Strongest impact in Jailbreak resistance (eval)
llm_trustworthy_leaderboard.adv · Mar 31, 2026
SWE-bench Verified Leaderboard
swe_verified_resolved_pct
Normalized value 48.2% · confidence 100.0%
Strongest impact in Verilog/VHDL generation
swebench_verified_official.swe_verified_resolved_pct · Apr 1, 2026
BigCodeBench Official
bigcodebench_complete_pct
Normalized value 97.6% · confidence 100.0%
Strongest impact in Verilog/VHDL generation
bigcodebench_official.bigcodebench_complete_pct · Apr 1, 2026
Aider Code Editing Leaderboard
percent_correct_pct
Normalized value 82.3% · confidence 100.0%
Strongest impact in Simulation setup assistant
aider_code_editing.percent_correct_pct · Apr 1, 2026
Coverage Diagnostics
actively scoredUse-Case Scores
113
Total Measurements
191
Weighted Measurements
21
Weighted Sources
10
Raw Source Coverage
Weighted Source Coverage
Best Use Cases for This Model
| Use Case | Score |
|---|---|
| Debugging assistant use_case.dev.debugging | 27.2% |
| Unit test generation use_case.dev.test_generation | 24.2% |
| Refactoring assistant use_case.dev.refactoring | 23.6% |
| Integration test generation use_case.dev.integration_tests | 23.0% |
| Verilog/VHDL generation use_case.eda.verilog_generation | 22.7% |
| Code Review Assistant use_case.dev.code_review_assistant | 22.6% |
| Jailbreak resistance (eval) use_case.security.jailbreak_resistance_eval | 19.4% |
| Crisis escalation protocol (eval) use_case.safety.crisis_escalation_protocol | 19.4% |
| Scam and social engineering resistance (eval) use_case.security.scam_social_engineering_resistance_eval | 19.4% |
| Refusal profile (eval) use_case.security.refusal_profile_eval | 19.4% |
| Overrefusal (eval) use_case.security.overrefusal_eval | 19.4% |
| Simulation setup assistant use_case.eng.simulation_setup_assistant | 18.3% |