Marketing

Ad copy variants

Generate diverse headline/CTA variants under strict constraints.

task.write_ad_variantstask.rewrite_tone_style

Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

claude-sonnet-4

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

32.4%

Best benchmark score

42.2%

Confidence

All ranked models — top 3

🥇

claude-sonnet-4

32.4%

🥈

gemini-2.5-pro

31.4%

🥉

Grok-4-0709

29.6%

Ranked Models

Evidence Quality

82%

Evidence Points

Top Signal

Galileo Agent Leaderboard v2: Avg TSQ

All Ranked Models

30 of 30 models

Rank	Model	Score	Confidence	Price / 1M	Evidence sources
🥇	claude-sonnet-4 Strong on Galileo Agent Leaderboard v2 Avg TSQ and EQ-Bench Leaderboard eq_bench_score	32.4%	42%	$6.00	Galileo Agent Leaderboard v2EQ-Bench Leaderboard
🥈	gemini-2.5-pro Strong on EQ-Bench Leaderboard eq_bench_score and Galileo Agent Leaderboard v2 Avg TSQ	31.4%	43%	$3.44	EQ-Bench LeaderboardGalileo Agent Leaderboard v2
🥉	Grok-4-0709 Strong on Galileo Agent Leaderboard v2 Avg TSQ and EQ-Bench Leaderboard eq_bench_score	29.6%	39%	—	Galileo Agent Leaderboard v2EQ-Bench Leaderboard
#4	gpt-5-2025-08-07 Strong on EQ-Bench Leaderboard eq_bench_score and UGI Leaderboard Writing ✍️	29.3%	36%	—	EQ-Bench LeaderboardUGI Leaderboard
#5	o3-20250416 Strong on EQ-Bench Leaderboard eq_bench_score and UGI Leaderboard Writing ✍️	24.6%	30%	$3.50	EQ-Bench LeaderboardUGI Leaderboard
#6	gpt-4o Strong on CRMArena Function Calling overall_score_pct and EQ-Bench Leaderboard eq_bench_score	23.8%	32%	$0.26	CRMArena Function CallingEQ-Bench Leaderboard
#7	gemini-3.1-pro-preview Strong on UGI Leaderboard Writing ✍️ and Vals Mortgage Tax overall_accuracy_pct	23.3%	26%	$4.50	UGI LeaderboardVals Mortgage Tax
#8	gpt-4.1-20250414 Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC	23.3%	31%	—	Galileo Agent Leaderboard v2Galileo Agent Leaderboard v2
#9	qwen-2.5-72b-instruct Strong on EQ-Bench Leaderboard eq_bench_score and Galileo Agent Leaderboard v2 Avg TSQ	19.9%	32%	—	EQ-Bench LeaderboardGalileo Agent Leaderboard v2
#10	gemini-3-flash-preview Strong on UGI Leaderboard Writing ✍️ and Vals Legal Bench overall_accuracy_pct	19.5%	24%	$1.13	UGI LeaderboardVals Legal Bench
#11	gemini-3-pro-preview Strong on UGI Leaderboard Writing ✍️ and Vals Mortgage Tax overall_accuracy_pct	18.8%	24%	$4.50	UGI LeaderboardVals Mortgage Tax
#12	o4-mini Strong on EQ-Bench Leaderboard eq_bench_score and UGI Leaderboard Writing ✍️	18.6%	28%	$1.93	EQ-Bench LeaderboardUGI Leaderboard
#13	gpt-5.4-2026-03-05 Strong on UGI Leaderboard Writing ✍️ and Vectara HHEM Leaderboard overall_hallucination_error_pct	18.6%	21%	—	UGI LeaderboardVectara HHEM Leaderboard
#14	gpt-5.2-2025-12-11 Strong on UGI Leaderboard Writing ✍️ and FACTS Benchmark Suite facts_grounding_score_pct	18.3%	22%	—	UGI LeaderboardFACTS Benchmark Suite
#15	gpt-5-mini-2025-08-07 Strong on Vals MedQA overall_accuracy_pct and Vals LiveCodeBench overall_accuracy_pct	18.2%	27%	—	Vals MedQAVals LiveCodeBench
#16	gemini-2.5-flash Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC	18.0%	24%	$0.17	Galileo Agent Leaderboard v2Galileo Agent Leaderboard v2
#17	claude-sonnet-4.6 Strong on UGI Leaderboard Writing ✍️ and Vals Tax Eval v2 overall_accuracy_pct	17.8%	21%	$6.00	UGI LeaderboardVals Tax Eval v2
#18	Kimi-K2-Instruct Strong on Galileo Agent Leaderboard v2 Avg TSQ and EQ-Bench Leaderboard eq_bench_score	17.6%	20%	—	Galileo Agent Leaderboard v2EQ-Bench Leaderboard
#19	gpt-5.1-2025-11-13 Strong on UGI Leaderboard Writing ✍️ and Vals Case Law v2 overall_accuracy_pct	17.5%	22%	—	UGI LeaderboardVals Case Law v2
#21	claude-opus-4 Strong on EQ-Bench Leaderboard eq_bench_score and UGI Leaderboard Writing ✍️	17.0%	20%	$10.00	EQ-Bench LeaderboardUGI Leaderboard
#22	claude-opus-4-5-20251101 Strong on UGI Leaderboard Writing ✍️ and Vals Mortgage Tax overall_accuracy_pct	16.9%	21%	—	UGI LeaderboardVals Mortgage Tax
#24	grok-3 Strong on EQ-Bench Leaderboard eq_bench_score and UGI Leaderboard Writing ✍️	16.0%	20%	$6.00	EQ-Bench LeaderboardUGI Leaderboard
#25	kimi-k2.5-thinking Strong on UGI Leaderboard Writing ✍️ and Vals CorpFin v2 overall_accuracy_pct	15.7%	21%	—	UGI LeaderboardVals CorpFin v2
#26	Claude-3.5-Sonnet Strong on EQ-Bench Leaderboard eq_bench_score and CRMArena Function Calling overall_score_pct	15.5%	23%	$6.00	EQ-Bench LeaderboardCRMArena Function Calling
#29	grok-4-fast-reasoning Strong on UGI Leaderboard Writing ✍️ and Vals CorpFin v2 overall_accuracy_pct	14.9%	24%	$0.28	UGI LeaderboardVals CorpFin v2
#30	deepseek-r1 Strong on EQ-Bench Leaderboard eq_bench_score and DuckDB NSQL Leaderboard all_execution_accuracy	14.1%	31%	$0.27	EQ-Bench LeaderboardDuckDB NSQL Leaderboard
#31	claude-opus-4-6-thinking Strong on Vals SWE-bench overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	14.1%	16%	—	Vals SWE-benchVals Mortgage Tax
#33	gpt-4.1-mini-20250414 Strong on Galileo Agent Leaderboard v2 Avg TSQ and Galileo Agent Leaderboard v2 Avg AC	14.0%	19%	—	Galileo Agent Leaderboard v2Galileo Agent Leaderboard v2
#34	claude-opus-4-5-20251101-thinking Strong on Vals MedQA overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct	13.7%	16%	—	Vals MedQAVals Mortgage Tax
#35	gemini-3.1-flash-lite-preview Strong on Vals Mortgage Tax overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct	13.7%	20%	$0.56	Vals Mortgage TaxVectara HHEM Leaderboard

Compare Models

Select two different models above to compare their evidence side by side.

▶Ranking diagnostics & missing models

Source lift

Ranked

Sources

Quality

Low

Vals Legal Bench

45 rows · 0.7% avg lift

Vals Tax Eval v2

43 rows · 0.7% avg lift

Vals LiveCodeBench

43 rows · 0.6% avg lift

Vals GPQA

43 rows · 0.6% avg lift

Missing frontier models

No obvious gaps right now.

▶Taxonomy & task details

Core tasks

task.write_ad_variantstask.rewrite_tone_style

Required modes

none

Domains

domain.marketing_sales

Related in Marketing

Social listening brief

Summarize social chatter into themes, risks, and recommendations.

Campaign brief

Draft a campaign brief with positioning, audience, and channels.

Product positioning and messaging

Develop positioning, value props, and message pillars with tradeoffs.

Social post generation

Generate short channel-specific social posts and variations.