ai21.net
语言

TASTE BENCH:Sunburst 广告质量 7.38,首稿可投放仅 54.2%

Omneky 用同一套 59 条 brief×四品牌×五语言盲测八模型:GPT Image 2.5 Sunburst 均分最高 7.38/10,但首稿可直接投放只有 54.2%。选型别只看分——广告可跑通才是终审。

演示视频

原帖未提供效果图

提示词

Today we're launching TASTE BENCH, Omneky's eval suite for the creative quality of AI-generated ads. For image ads, the top model, GPT Image 2.5 Sunburst, averaged 7.38 out of 10 on quality, yet only 54.2% of its ads were ready to run as-is. Across eight models, ready-to-run rates ranged from 22.0% to 54.2%. Every model got the same 59 briefs across four brands and five languages, and a blind panel of AI judges from OpenAI, Anthropic, and Google checked each ad for exact copy, faithful logos and products, safe zones, and fabricated claims. These are first-attempt numbers with our own review step turned off.

We built TASTE BENCH because once you can measure taste, you can hill climb it. It covers image and video models, and you can explore every image ad, brief, judge explanation, and score at http://www.omneky.com/tastebench.

中文译文

今天我们正式发布 TASTE BENCH,这是 Omneky 针对 AI 生成广告创意质量的评估套件。在图片广告方面,表现最好的模型 GPT Image 2.5 Sunburst 质量平均分为 7.38(满分 10 分),但其广告中仅 54.2% 可以直接投放。在八个模型中,可直接投放率介于 22.0% 至 54.2% 之间。所有模型都拿到相同的 59 份 brief,覆盖四个品牌与五种语言,并由来自 OpenAI、Anthropic 和 Google 的 AI 评审组成盲测小组,逐条检查每则广告的文案是否精确、logo 与产品是否忠实、安全区以及是否存在捏造宣称。这些均为首次尝试的数据,未启用我们自己的复核环节。

我们构建 TASTE BENCH,是因为一旦你能度量品味(taste),你就能对它做爬山优化。它涵盖图片与视频模型,你可以在 http://www.omneky.com/tastebench 查看每一条图片广告、brief、评审解释与得分。

溯源

原作者
omneky
发布日期
2026-09-25
原始出处
查看原帖 ↗
收录来源
xianyu110/awesome-gpt-image2.5 · 2103352139838071038 · MIT