Boring Marketing

Marketing eval · v1

Which AI makes the best marketing for real brands?

Nov 19, 20264,774 judge votes110 real pieces35 brands3 models

Social posts

GPT-6.2 Sol

Won 67% of its Instagram votes and 65% on X.

Meta ads

Claude Opus 5.5

Won 64% of its ad votes.

YouTube packaging

Gemini 4 Neon

Won 61% of its title-and-thumbnail votes.

Deep work

Sol&Opus

Tied at the top on pages, emails, positioning, plans and ads. Gemini trails.

Video ads

Gemini 4 Neon

Won 75% of its votes, with the same video model for all three.

Copywriting

Sol&Opus

The council leans Sol (57%); judges from outside the race lean Opus (66%).

Search

Sol&Gemini

Keyword plans and pages to rank, from real search data. Opus trails.

Video editing

Claude Opus 5.5

Won 77% of its edit votes.

GPT-6.2 Sol won the most votes across 15 marketing jobs (58% on average, against Opus 52% and Gemini 40%), and it cost the least ($0.04 a piece). No model won everything: Opus leads video editing and rewrites; Gemini leads video ads and search ads. And the brands’ own best work still beat all three most of the time.

Social posts, ads and YouTube · 35 brands

Statistically tied

All three are statistically tied overall: their 95% ranges overlap, so each could rank anywhere from 1 to 3.

Rank · modelRating with 95% rangeRating
1–3GPT-6.2 Sol1022992–1052
1–3Claude Opus 5.5999969–1029
1–3Gemini 4 Neon979944–1007

660 blind votes between the models. Each pair was judged in both orders by the two judges from the labs not in it. Bradley-Terry rating, 1000 is average; the bars are 95% ranges from resampling the jobs.

Quality against cost

Sol is the best value: the cheapest model and among the best

Each small dot is one model on one job: how often its work won the blind votes, against what it cost to make one piece at high reasoning effort. The big dots are each model’s average across all 15 jobs. Up and to the left is better. Video ads also pay the same $0.96 a clip to the video model for every model, which isn’t counted here.

Better and cheaper$0.01$0.03$0.1$0.3$10%25%50%75%100%Cost to make one piece (high effort, log scale)Share of votes wonOpus 52% · $0.10Sol 58% · $0.04Gemini 40% · $0.21
  • Claude Opus 5.5
  • GPT-6.2 Sol
  • Gemini 4 Neon
The numbers every job, share of votes won and cost a piece
JobOpusSolGemini
Landing pages62% · $0.17056% · $0.07131% · $0.269
Welcome emails62% · $0.06369% · $0.02019% · $0.100
Positioning briefs66% · $0.07075% · $0.0189% · $0.152
Campaign plans50% · $0.10591% · $0.0339% · $0.160
Video ads47% · $0.05428% · $0.02475% · $0.134
Carousel ads38% · $0.14656% · $0.08556% · $0.314
Long sales pages36% · $0.08278% · $0.02135% · $0.149
10 headlines59% · $0.05151% · $0.01840% · $0.094
Google search ads42% · $0.05338% · $0.02370% · $0.219
Cold emails52% · $0.03592% · $0.0126% · $0.077
Product descriptions54% · $0.03640% · $0.01056% · $0.096
Rewriting a real flop66% · $0.02853% · $0.01231% · $0.055
Keyword plans23% · $0.10662% · $0.03464% · $0.212
Pages to rank50% · $0.15052% · $0.03248% · $0.212
Video edits77% · $0.29223% · $0.15450% · $0.921

By channel

Each model won a different channel

Share of the votes each model won against the other two. The whiskers are 95% ranges; past the 50% line means it beat the field.

Instagram posts

38 pieces · 228 votes

Opus41%
Sol67%
Gemini42%

50%: even

Meta ads

16 pieces · 96 votes

Opus64%
Sol34%
Gemini52%

50%: even

X posts

22 pieces · 132 votes

Opus62%
Sol65%
Gemini23%

50%: even

YouTube titles and thumbnails

34 pieces · 204 votes

Opus45%
Sol44%
Gemini61%

50%: even

  • Claude Opus 5.5
  • GPT-6.2 Sol
  • Gemini 4 Neon

Deep work · pages, emails, positioning, plans, video and carousel ads

Sol and Opus lead the deep work; Gemini trails overall but wins video ads

For 8 of the brands (Notion, Figma, Zapier, ElevenLabs, Ridge, Solo Stove, Kosas, WHOOP), each model also built a landing page, a 3-email welcome sequence, a positioning brief, a 30-day campaign plan on a $50,000 budget, an 8-second Reels ad and an Instagram carousel ad. All three ran at high reasoning effort. Pages and slides were rendered and judged from screenshots plus their text. Every video ad was made by the same video model (Google Veo 3.1 Fast) from the model’s own prompt and judged from 9 frames, the words on screen and what’s said.

Rank · modelRating with 95% rangeRating
1–2GPT-6.2 Sol1060988–1127
1–2Claude Opus 5.51020987–1064
3Gemini 4 Neon920834–983

288 blind votes, judged the same way as the creative. The shorter piece won 55% of decided votes, so we checked whether length explains the ranking. It doesn’t: holding length equal (the way LMArena’s style control does) widens the lead, to Sol 1144, Opus 1014, Gemini 842.

Landing pages

8 brands · 48 votes

Opus62%
Sol56%
Gemini31%

50%: even

Welcome emails

8 brands · 48 votes

Opus62%
Sol69%
Gemini19%

50%: even

Positioning briefs

8 brands · 48 votes

Opus66%
Sol75%
Gemini9%

50%: even

Campaign plans

8 brands · 48 votes

Opus50%
Sol91%
Gemini9%

50%: even

Video ads

8 brands · 48 votes

Opus47%
Sol28%
Gemini75%

50%: even

Carousel ads

8 brands · 48 votes

Opus38%
Sol56%
Gemini56%

50%: even

  • Claude Opus 5.5
  • GPT-6.2 Sol
  • Gemini 4 Neon

Landing page · Figma

Figma’s landing page, with one goal: sign up for the free Starter plan

A typical job: of the 8 brands, the one whose result is closest to the result across all of them (Opus 62%, Sol 56%, Gemini 31%).

Claude Opus 5.5's landing page for Figma, first screen on a laptop
Made by Claude Opus 5.5Won 75% of its votes on this page. AI-made test material, not made by or for Figma.
GPT-6.2 Sol's landing page for Figma, first screen on a laptop
Made by GPT-6.2 SolWon 75% of its votes on this page. AI-made test material, not made by or for Figma.
Gemini 4 Neon's landing page for Figma, first screen on a laptop
Made by Gemini 4 NeonWon 0% of its votes on this page. AI-made test material, not made by or for Figma.

“A puts its Fortune 500 proof in the first laptop screen and keeps a free-signup button within thumb’s reach on mobile, without B’s distractions from community resources and paid plans.”

GPT-6.2 Astra, the judge for this pair · A was Opus’s page, B was Gemini’s
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

Build the landing page for Figma (Figma Design, Figma Make, Figma Draw and FigJam). Visitors arrive cold from a paid social ad. The page has one goal: get them to sign up for the free Starter plan.
Deliver one complete, self-contained HTML file: inline CSS, Google Fonts allowed, no other external files, scripts or icon libraries. It must work on a phone and on a laptop. Buttons link to "#"; the real link is added later.
Images: you may use only these photos of the real product, by exact file name, or none:
- ref-1.jpg: Brushes panel with cursor selecting the Paint brush
- ref-2.jpg: Pen tool editing vector path anchor points
- ref-3.jpg: Bitmap mosaic panel with spacing and size controls
Don't draw, mock up or describe product screens or photos that aren't in these files.

Everything known about Figma (public facts, as of November 19, 2026):

--- brief.md ---
# Figma (real brand; public facts as of 2026-11-19)

Website: figma.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- Figma Design is for designing and prototyping in one place. ("Design and prototype in one place")
- Figma Make turns prompts into code. ("Prompt to code anything you can imagine")
- Figma Weave covers AI workflows for imagery, video, audio, and more. ("AI workflows for imagery, video, audio, and more")
- FigJam is a collaborative digital whiteboard. ("Collaborate with a digital whiteboard")
- Figma Draw is for illustration with advanced vector tools. ("Illustrate with advanced vector tools")
- The Starter plan is free with limited access to Figma products. ("Free limited access to Figma products")
- Professional includes advanced Dev Mode inspection and an MCP Server. ("Advanced Dev Mode inspection and MCP Server")

## Who it's for (their words)

- Figma is made so a whole team can go from work in progress to ship together. ("Made so your whole team can go from WIP to ship, together.")
- Teammates and AI agents are meant to work in the same space. ("Teammates and AI agents work in the same space with shared context.")
- Professional is for a professional working solo or with others. ("Are a professional working solo or with others")
- Organization is for a business that designs products across the organization. ("Are a business that designs products across your organization")
- Enterprise is for a business designing for multiple products or brands. ("Are a business designing for multiple products or brands")
- Organization buyers may want to centralize assets, libraries, and workflows across departments. ("Want to centralize assets, libraries, and workflows across departments")

## Proof they publish

- 95% of the Fortune 500 uses Figma. ("95% of the Fortune 500 uses Figma")
- The Fortune 500 figure is based on data from March 2025. ("Based on data from March 2025.")
- Figma says the products you love are designed in Figma. ("The products you love are designed in Figma")
- Francisco Seiz is quoted as Senior Design Director at Code and Theory. ("Senior Design Director, Code and Theory")
- A Code and Theory design director says people can give input without leaving the design file. ("Everyone is able to influence, inspire, and give input without ever leaving the design file.")
- Figma points visitors to customer stories about leading product teams. ("Read about leading product teams")

## Offers

- Starter is a free tier with limited access to Figma products. ("Free limited access to Figma products")
- Starter includes 150 AI credits a day, up to 500 AI credits a month. ("150 AI credits/day, up to 500 AI credits/mo")
- On a paid plan, others can view and comment without extra seats. ("If you're on a paid plan, you can let others view and comment on your files without purchasing extra seats.")

## Sources

- https://figma.com/
- https://www.figma.com/pricing/

--- site.md ---
[474 words of Figma’s homepage text, copied from figma.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[8 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Anything said about Figma or its products uses only the facts below: no invented numbers, prices, offers, features, customers, quotes, reviews, awards or dates, and facts kept exact.
- Return only the fields asked for.

The brand’s photos it was given

Brushes panel with cursor selecting the Paint brush
ref-1.jpg: Brushes panel with cursor selecting the Paint brush
Pen tool editing vector path anchor points
ref-2.jpg: Pen tool editing vector path anchor points
Bitmap mosaic panel with spacing and size controls
ref-3.jpg: Bitmap mosaic panel with spacing and size controls

Settings

Output
One self-contained HTML file, rendered by us in Chrome on a laptop (1440 wide) and a phone (390 wide)
Models
Claude Opus 5.5, GPT-6.2 Sol, Gemini 4 Neon, all at high reasoning effort
System prompt
You are a senior marketer doing client work. Follow the job’s instructions exactly.
Attempts
One. Only an empty or broken answer was retried, never a weak one
What the judges saw the question, word for word, and every vote

The question

Two landing pages for Figma (Figma Design, Figma Make, Figma Draw and FigJam). Visitors arrive cold from a paid social ad, and the page's one goal is to get them to sign up for the free Starter plan. You see each page on a laptop (its first screens) and on a phone, plus its full text. Which page would get more visitors to sign up for the free Starter plan? Answer A or B; say tie only if you truly can't separate them. One sentence on why.

[Then each page: its full text, 3 laptop screens and 2 phone screens.]
All 6 votes on this job: each pair of models, judged in both orders by the judge from the third lab.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Claude Fable 5.2GeminiSolSolB is a short, focused page with a single clear action, a plain-language benefit headline, and proof visible in the first screen, while A is long, repeats itself, adds nav links and paid-plan details that distract a cold visitor from the free signup.
Claude Fable 5.2SolGeminiSolA is a tight, single-purpose page with one repeated CTA, visible proof right under the hero and no nav or paid-plan detours, whereas B's nav links, secondary CTA, long scroll and paid-plan section dilute a cold visitor's path to the free signup.
GPT-6.2 AstraGeminiOpusOpusB gives cold visitors one clear next step, reinforces it with prominent Fortune 500 social proof, and keeps free signup within thumb’s reach as they scroll on mobile.
GPT-6.2 AstraOpusGeminiOpusA puts its Fortune 500 proof in the first laptop screen and keeps a free-signup button within thumb’s reach on mobile, without B’s distractions from community resources and paid plans.
Gemini 4 CarbonSolOpusSolPage A looks authentically like Figma, communicates the four-product Starter offer and Fortune 500 social proof concisely right at the top, and avoids Page B's generic logo, repetitive triple mobile CTAs, and illustration-only visuals.
Gemini 4 CarbonOpusSolOpusPage A shows real product UI instead of abstract geometric shapes, states a more concrete value proposition upfront, and keeps sign-up CTAs persistently visible as visitors scroll on both desktop and mobile.

Video ad · Ridge

An 8-second Reels ad for Ridge, made with the same video model

A typical job: of the 8 brands, the one whose result is closest to the result across all of them (Gemini 75%, Opus 47%, Sol 28%).

Side by side and muted, the way most people see them. Each ad with sound is in the panel below.

Slim, RFID-blocking, guaranteed for life. Black Friday: up to 50% off Ridge Wallets, with a 99-day risk-free trial.
Ridge Wallets: Up to 50% Off · [Shop now]

Made by Claude Opus 5.5Won 75% of its votes on this ad. AI-made test material, not made by or for Ridge. Said in the clip: (no speech)

Black Friday: Up to 50% off Ridge Wallets. Slim, RFID-blocking, guaranteed for life. 99-day risk-free trial & free shipping.
Ridge Wallets: Up to 50% Off · [Shop now]

Made by Gemini 4 NeonWon 75% of its votes on this ad. AI-made test material, not made by or for Ridge. Said in the clip: Meet the Ridge Wallet—slim, RFID-blocking, and guaranteed for life. Shop Black Friday now, up to 50% off.

Swap the bulk for a slim, RFID-blocking Ridge Wallet. Try it risk-free for 99 days.
Up to 50% off Ridge Wallets · [Shop now]

Made by GPT-6.2 SolWon 0% of its votes on this ad. AI-made test material, not made by or for Ridge. Said in the clip: (no speech)

“Ad B shows hands holding the wallet and sliding cards out so unfamiliar viewers immediately see its size and how it works, while also highlighting the 99-day risk-free trial and free shipping on screen, whereas Ad A never demonstrates the wallet in use and morphs into a distorted product labeled "3DDGEE" for the second half of the clip.”

Gemini 4 Carbon, the judge for this pair · A was Sol’s ad, B was Opus’s
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

Make an 8-second vertical video ad for the Ridge Wallet, for Instagram Reels and Facebook, shown to people who don't know Ridge. Its one goal: get them to buy a Ridge Wallet.

How it gets made (the same for every marketer in this test):
- The footage comes from a video model, Google Veo 3.1 Fast, from your prompt: one continuous 8-second clip, 1080x1920 (9:16), with sound. You write the prompt.
- You may start the clip from one of the brand's real photos below: the clip then opens on that exact image (fitted into the 9:16 frame) and moves from there. Or start from nothing.
- The video model draws words, logos and screens badly, so don't ask it for any text on screen. Words on screen are added afterwards, in code, from your overlays: up to 4 lines of up to 8 words each, with when each one shows (in seconds, 0 to 8) and where (the top, middle or bottom of the frame, all inside the Reels safe area), set in white bold type on a dark band.
- Any line spoken in the clip goes in double quotes in your prompt, with who says it and how; it is spoken as written. Leave speech out if you want none. Say what sounds you want.
- Reels and Feed autoplay muted, so the ad has to work with the sound off too.
- Around the video the ad shows your primary text, a headline and a button.
The brand's real photos, by exact file name:
- ref-1.jpg: Two gunmetal Ridge wallets on a white background
- ref-2.jpg: Orange, olive, and black Ridge magnetic wallets
- ref-3.jpg: Carbon-fiber Ridge wallets with elastic cash straps
Don't ask the video model for product details, colors or screens that aren't in these photos or the facts.

Everything known about Ridge (public facts, as of November 19, 2026):

--- brief.md ---
# Ridge (real brand; public facts as of 2026-11-19)

Website: ridge.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- Ridge wallets are slim, RFID-blocking, and guaranteed for life. ("Slim, RFID-blocking, Guaranteed for Life")
- Power banks offer 5-in-1 power, MagSafe readiness, and built-in cables. ("5-in-1 Power, MagSafe-ready, cables built in.")
- Hardshell luggage is weatherproof, rugged, and travel-ready. ("Weatherproof, rugged build and travel-ready.")
- Men's rings have a premium build with a lifetime guarantee. ("Premium build, lifetime guarantee included")
- Ridge sells a 24 oz water bottle engineered to outlast. ("Ridge 24 oz Water Bottle Engineered To Outlast")
- MagSafe wallets are described as next-level compatible. ("MagSafe® Wallet Next Level Compatible")
- Vacuum packing sets are sold to fit more in the same bag. ("Vacuum Packing Sets Same Bag, More Room")

## Who it's for (their words)

- The brand speaks to guys as gift recipients. ("For every guy on the list")
- Products are positioned as gear used every day. ("The gear you rely on every day")
- Women's wallets are framed as premium everyday gear. ("Women's Wallets Premium Everyday Gear")
- Men's rings are built for life. ("Men's Rings Built For Life")
- Ridge offers bulk and corporate orders. ("Bulk & Corporate Orders Personal Touch. Premium Gear.")
- Backpacks and bags are purpose-built for adventure. ("Backpack & Bags Purpose-Built For Adventure")

## Offers

- Shoppers can return an item for a full refund if it is not as promised. ("Live with it. If it's not everything we promised, return it for a full refund.")
- Products are backed by a lifetime warranty. ("Made to last, backed by a promise that never fades.")
- Shipping is fast and free, with no added fees. ("Delivered swiftly, carefully, and without added fees.")
- Gear is guaranteed for life. ("Overbuilt. Guaranteed for life. Used every day.")

## Sources

- https://ridge.com/
- https://ridge.com/products/magnetic-power-bank-matte-black

--- site.md ---
[440 words of Ridge’s homepage text, copied from ridge.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[2 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Anything said about Ridge or its products uses only the facts below: no invented numbers, prices, offers, features, customers, quotes, reviews, awards or dates, and facts kept exact.
- No one in the ad poses as a customer, gives a review or testimonial, or shows results they got; reviews may be quoted only word for word from the facts.
- Return only the fields asked for.

The brand’s photos it was given

Two gunmetal Ridge wallets on a white background
ref-1.jpg: Two gunmetal Ridge wallets on a white background
Orange, olive, and black Ridge magnetic wallets
ref-2.jpg: Orange, olive, and black Ridge magnetic wallets
Carbon-fiber Ridge wallets with elastic cash straps
ref-3.jpg: Carbon-fiber Ridge wallets with elastic cash straps

Settings

Video model
Google Veo 3.1 Fast through OpenRouter: 8 seconds, 1080x1920, with sound, the same seed for everyone. Words on screen were drawn by our code from each model’s overlays
Models
Claude Opus 5.5, GPT-6.2 Sol, Gemini 4 Neon, all at high reasoning effort
System prompt
You are a senior marketer doing client work. Follow the job’s instructions exactly.
Attempts
One. Only an empty or broken answer was retried, never a weak one
What each model wrote for the video model the same video model made every version; only the prompt differs

Claude Opus 5.5: starts from ref-1.jpg

Vertical 9:16 product commercial, one continuous 8-second shot. Open on the exact starting image: two gunmetal aluminum card-holder wallets on a clean white background, one showing its flat front plate, the other its back with a black elastic strap and a metal clip. Keep both wallets exactly as in the photo: same gunmetal finish, same screws, same thumb cutout, same black elastic. Do not add any new colors, parts, text or logos. 0-3s: the camera pushes in slowly and smoothly while a soft studio light sweeps across the brushed metal, making a crisp highlight glide over the edges. 3-6s: a man's hand enters from the right, picks up the front-facing wallet and pushes his thumb through the cutout, fanning out a short stack of plain blank cards with no printing, showing how thin the whole wallet is. 6-8s: he slides the cards back in with a satisfying snap and holds the slim wallet up toward the camera against the white background, the second wallet resting in soft focus behind. Bright, premium, minimal lighting, shallow depth of field, sharp detail, no text anywhere in the frame. Sound: a low, modern bass pulse building under the shot, a soft whoosh as the light sweeps, a crisp metallic click as the cards fan out, and a clean snap when they slide back in. No speech, no voiceover.

Words on screen (added in code):
0–2.8s, top: Ditch the bulky wallet.
2.8–5.5s, bottom: Slim. RFID-blocking. Guaranteed for life.
5.5–8s, top: Black Friday: up to 50% off
5.5–8s, bottom: 99-day risk-free trial. Fast, free shipping.

Gemini 4 Neon: starts from ref-1.jpg

Continuous 8-second vertical 9:16 commercial product video in crisp natural daylight, opening directly on the exact overhead frame of the two gunmetal Ridge wallets resting on a seamless bright white matte tabletop. Within the first second, a man's hand enters smoothly from the right and lifts the left gunmetal wallet while the camera glides continuously down from overhead into an intimate eye-level macro close-up, revealing a softly blurred sunlit modern room behind it. From 1.5 to 4 seconds, the hand turns the gunmetal wallet sideways to highlight its slim profile and beveled metallic edges catching clean highlights, then presses a thumb against the side semicircular notch so a neat stack of plain unbranded matte black and dark gray cards smoothly fans upward out of the plates before snapping back flush. From 4 to 6 seconds, the hand flips the wallet effortlessly to show the black elastic cash strap and gunmetal center plate on the back securing neatly folded plain paper bills. From 6 to 8 seconds, the camera tracks gently downward as the hand slides the slim gunmetal wallet smoothly into the front pocket of dark charcoal trousers, resting completely flat with no bulge. Smooth, stabilized cinematic handheld motion, shallow depth of field, sharp focus on the metallic texture and screws. Do not add any on-screen text, captions, watermarks, or graphics. Sound design: subtle crisp metallic brush as the wallet lifts, clean tactile card-sliding whisper and soft click as the cards snap flush, gentle fabric rustle as the wallet glides into the pocket, underscored by a minimal modern rhythmic pulse. A calm, confident male commercial narrator speaks in a warm, steady voiceover: "Meet the Ridge Wallet. Slim, RFID-blocking, and guaranteed for life. Shop Black Friday now—up to 50% off."

Words on screen (added in code):
0–2s, top: Meet the Ridge Wallet
2–4.2s, bottom: Slim. RFID-blocking. Guaranteed for life.
4.2–6.2s, bottom: 99-day risk-free trial. Fast, free shipping.
6.2–8s, top: Black Friday: Up to 50% off

GPT-6.2 Sol: starts from ref-1.jpg

Create one continuous 8-second product shot at 1080x1920 (9:16) with sound. Open on the exact supplied photo, fitting both gunmetal Ridge Wallets into the vertical frame against seamless white. Immediately push in and glide through a shallow side arc. From 1.5 to 3.3 seconds, let a narrow highlight travel along the front wallet’s thin edge so its slim profile is easy to see. Ease back to a wider three-quarter view with both wallets centered by 5.2 seconds, then hold that composition through the end. Keep the wallets fixed relative to each other and faithful to the photo: no changes to their shape, finish, hardware, or existing markings. Leave clean white space above them for post-production overlays. No cuts, hands, props, generated text, or added logos. Sound: a crisp tick on the opening move, a soft swish on the arc, and a minimal percussive beat. No speech.

Words on screen (added in code):
0–1.5s, top: Still carrying a bulky wallet?
1.5–3.3s, top: Meet the slim Ridge Wallet
3.3–5.2s, top: Guaranteed for life
5.2–8s, top: Black Friday: Up to 50% off
What the judges saw the question, word for word, and every vote

The question

Two 8-second vertical video ads for the Ridge Wallet, for Instagram Reels and Facebook, shown to people who don't know Ridge. Each one's goal is to get them to buy a Ridge Wallet. For each you see 9 frames of the finished ad (0 to 8 seconds, with its words on screen), what's said in it, and the text shown around it. Most people watch with the sound off. Which ad would get more people to buy a Ridge Wallet? Answer A or B; say tie only if you truly can't separate them. One sentence on why.

[Then each ad: its words on screen with their timings, what’s said (transcribed by Thinking Machines’ Inkling and checked by Qwen, labs that aren’t competing), the text around it, and 9 frames.]
All 6 votes on this job: each pair of models, judged in both orders by the judge from the third lab.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Claude Fable 5.2GeminiSolGeminiA shows the wallet in a hand, holding cash and sliding into a pocket, with clear benefits, risk-free trial and offer on screen, while B's question hook is undercut by static, glitchy product renders including a garbled "EDDGEE" logo that looks fake and gives no sense of real use.
Claude Fable 5.2SolGeminiGeminiB shows the wallet in a real hand, holding cash and sliding into a pocket, with clear benefit and risk-reversal captions, while A is a static product shot on white that morphs into a garbled, misbranded "EDDGEE" wallet that undermines trust.
GPT-6.2 AstraGeminiOpusOpus“Ditch the bulky wallet” gives viewers who don’t know Ridge a reason to switch, and showing the discount alongside the risk-free trial gives them a reason to buy now, even with the sound off.
GPT-6.2 AstraOpusGeminiGeminiB shows the wallet holding cards and cash and slipping into a front pocket, so even first-time viewers watching on mute can see why its slim design matters.
Gemini 4 CarbonSolOpusOpusAd B shows hands holding the wallet and sliding cards out so unfamiliar viewers immediately see its size and how it works, while also highlighting the 99-day risk-free trial and free shipping on screen, whereas Ad A never demonstrates the wallet in use and morphs into a distorted product labeled "3DDGEE" for the second half of the clip.
Gemini 4 CarbonOpusSolOpusAd A demonstrates how the wallet fits in the hand and holds cards while highlighting key purchase incentives like free shipping and a 99-day trial on screen, whereas Ad B spends its entire second half on a static, AI-warped image prominently misspelled as "3DDGEE" that undermines trust with new customers.
Every video ad, with sound 8 brands, 3 ads each, best first. AI-made test material, not made by or for the brands.

For the software brands the models only had still screenshots of the product to start from, and the video model can’t draw software screens, so most of those clips are abstract motion with words on top. The motion-ads rules in the skills call for a real screen recording for software; this test didn’t have one.

ElevenLabs · software

Opus won 75%
Sol won 50%
Gemini won 25%

Figma · software

Gemini won 100%
Opus won 25%
Sol won 25%

Kosas · physical product

Gemini won 100%
Sol won 50%
Opus won 0%

Notion · software

Gemini won 100%
Opus won 50%
Sol won 0%

Ridge · physical product

Opus won 75%
Gemini won 75%
Sol won 0%

Solo Stove · physical product

Gemini won 100%
Opus won 50%
Sol won 0%

WHOOP · physical product

Sol won 100%
Opus won 25%
Gemini won 25%

Zapier · software

Opus won 75%
Gemini won 75%
Sol won 0%

Video ads, judged from 4 more angles

An ad is copy and creative. So each video ad was judged again on its words alone, on its footage alone, as a viewer sees it in the feed, and by a judge that watches the video. Every angle: every pair, both orders, the judge from the third lab.

Share of votes won, by angle
AngleOpusSolGemini
First run: 9 frames, all the text47%28%75%
As seen in the feed: 17 frames, text cut at “more”41%22%88%
Copy only: every word, no pictures31%50%69%
Creative only: the raw footage, no words69%12%69%
Watching the video with sound (Opus vs Sol only)69%31%–

The copy angle and the creative angle picked the same winner on only 48% of matchups: an ad’s words and its pictures are separate skills.

Judging from still frames and judging the actual video with sound agreed on 94% of the Opus-vs-Sol matchups, so the stills miss little.

The judges favoured the ad with more words: the longer one won 67% of first run votes, 75% of feed votes, 69% of copy votes. With length held equal (LMArena-style), copy only reads Sol 1211, Opus 1092, Gemini 697: Gemini’s copy wins on volume, not on craft. It was the longest in almost every matchup, so treat this as a strong pointer, not a verdict.

Carousel ads, judged from 2 more angles

An ad is copy and creative. So each carousel ad was judged again on its words alone and as a viewer sees it in the feed. Every angle: every pair, both orders, the judge from the third lab.

Share of votes won, by angle
AngleOpusSolGemini
First run: 9 frames, all the text38%56%56%
As seen in the feed: 17 frames, text cut at “more”38%53%59%
Copy only: every word, no pictures38%53%59%

Where each model falls short

Yes-or-no checks taken from the Boring Marketing skills (the copy scorecard, the email checklist, the positioning method, the motion-ads rules and the carousel template). Each check is answered by the two judges from other labs; the score is the average of their answers. (An earlier version needed both to say yes, which let one strict judge zero out the two models it checks.) These explain the ranking; they don’t make it. Overall pass rate: Opus 62%, Sol 64%, Gemini 56%.

Landing pages
CheckOpusSolGemini
Clear from the first screen81%88%69%
One goal, nothing competing94%100%19%
Sells the outcome69%50%44%
Specific claims38%62%69%
Proof near the ask94%94%94%
Answers the main doubt44%19%31%
Real urgency, or none100%94%100%
Sounds human0%56%0%
Flows to the button25%62%12%
Works on a phone94%100%88%
Welcome emails
CheckOpusSolGemini
One purpose per email31%75%19%
Value before the ask44%50%44%
Preview adds to the subject81%100%81%
Clean subject lines56%81%31%
Handles the main doubt44%38%38%
Sensible timing69%100%88%
Specific to the product88%100%94%

Every judge said no for every model on: a reason to open the next, sounds human. Those checks don’t separate the models.

Positioning briefs
CheckOpusSolGemini
Sells the outcome69%75%69%
Names the alternative100%69%94%
Unique mechanism25%25%25%
Commits to one thing88%88%69%
Reads the market's fatigue12%12%0%
Backed by proof75%75%75%
Usable tomorrow100%94%100%
Says what not to say100%62%100%
Campaign plans
CheckOpusSolGemini
One audience first100%100%75%
A real lever from the facts100%100%100%
Budget adds up100%93%100%
3 distinct concepts100%100%100%
Ads match the page100%100%100%
Stop, fix and scale numbers100%93%100%
A test plan44%14%6%
Plausible costs56%71%44%
Video ads
CheckOpusSolGemini
Hook on the first frame56%62%69%
Product in the first 2 seconds75%69%56%
Works muted100%100%100%
One message50%62%25%
Product looks real19%6%6%
No AI glitches31%0%6%
Ends on the next step56%88%81%
Feels native to Reels12%6%19%
No fake customers100%100%100%
Ad text lands50%44%44%
Carousel ads
CheckOpusSolGemini
Slide 1 hooks25%6%69%
One point per slide6%69%0%
Readable on a phone12%88%0%
Real product, nothing mocked up100%75%94%
Carries proof100%62%100%
One ask at the end69%100%19%
Looks like one set100%100%100%
Ad text lands62%12%50%

Every judge said no for every model on: pulls to the next slide, sounds human. Those checks don’t separate the models.

Client-ready

Share that pass
CheckOpusSolGemini
Every claim about the brand backed by its facts79%100%90%
Page fits a phone screen88%100%88%
Button on the first phone screen100%100%100%
Email subject lines under 50 characters96%96%83%
Briefs and plans within the length asked56%100%94%
Ad headlines within 40 characters, so they aren’t cut off100%100%100%
Carousels with nothing cut off88%100%100%
Carousel slides with no text under about 11px on a phone96%0%0%
Video ads where the product looks like the real one19%6%6%

The honesty gate counts any claim the brand’s facts don’t back, even a true one. Most of Opus’s failures were things that are true but weren’t in the brief (that Solo Stove’s fire pit burns wood, that ElevenLabs’ free plan includes the API); a few were real errors, like calling agent building free when it comes with a grant. Gemini added “verified” to a review count and promised not to email daily. No video or carousel ad failed it. Client work shouldn’t rest on the writer’s memory, so the gate stays strict.

Copywriting · words only, judged from three angles

Sol and Opus lead the copywriting; outside judges put Opus first

For the same 8 brands, each model wrote a long sales page (words only, no design), 10 landing-page headlines, a Google search ad, a cold email or a product description, and a rewrite of one of the brand’s own real posts that flopped. Every pair was judged three times: by a judge reading as the customer, as a senior copywriter, and as the brand’s head of marketing with its homepage copy in view.

Share of copy votes won, by angle
AngleOpusSolGemini
As the customer57%48%44%
As a senior copywriter51%57%42%
As the brand’s head of marketing45%67%38%
All three angles51%57%42%

720 votes. Read the angles separately: the brand angle also sees the brand’s facts and homepage copy, so it asks a different question, and the “all three” row is a plain average, not a verdict. How often two angles picked the same winner: customer and copywriter 80%, customer and brand 50%, copywriter and brand 53%. Across all copy, with a 95% range from resampling brands: Sol 57% (47% to 69%), Opus 51% (48% to 54%), Gemini 41% (29% to 53%). The shorter piece won 50% of decided votes.

Long sales pages, words only

8 brands · 144 votes

Opus36%
Sol78%
Gemini35%

50%: even

10 headlines

8 brands · 144 votes

Opus59%
Sol51%
Gemini40%

50%: even

Google search ads

8 brands · 144 votes

Opus42%
Sol39%
Gemini70%

50%: even

Cold emails (software)

4 brands · 72 votes

Opus52%
Sol92%
Gemini6%

50%: even

Product descriptions (products)

4 brands · 72 votes

Opus54%
Sol40%
Gemini56%

50%: even

Rewriting a real flop

8 brands · 144 votes

Opus66%
Sol53%
Gemini31%

50%: even

  • Claude Opus 5.5
  • GPT-6.2 Sol
  • Gemini 4 Neon

Rewriting a real flop · Zapier · X

Zapier’s post on X that flopped, rewritten by each model

AI only helps with work it can see When rules live in a stale doc and customer history lives in someone's head, it has to guess (and might guess wrong) Three builds that turn scattered knowledge into shared context for the whole team👇

Zapier’s real post on XIt got under a third of a similar post's engagement. See the original

Your AI isn't guessing because it's dumb. It's guessing because the real rules are in a doc nobody's touched in months, and the customer history is in your best rep's head. It can only help with work it can see. 3 builds that turn scattered know-how into shared context your whole team (and your AI) can use 👇

Rewritten by Claude Opus 5.5Won 67% of its votes against the other rewrites; beat the real one in 4 of 4 votes. AI-made test material, not made by or for Zapier.

AI can’t read your teammate’s mind. If the playbook is stale and customer history lives in their head, AI has to guess. Sometimes it guesses wrong. Give AI and the whole team the same context: capture updates with Forms, store them in Tables, and use them in Zaps.

Rewritten by GPT-6.2 SolWon 67% of its votes against the other rewrites; beat the real one in 0 of 4 votes. AI-made test material, not made by or for Zapier.

Stop blaming AI for an access problem. AI can only help with work it can reach. Keep rules in a stale doc and customer history in someone's head, and it's forced to guess—and can get things wrong. 3 builds that turn scattered know-how into context your whole team can use:

Rewritten by Gemini 4 NeonWon 17% of its votes against the other rewrites; beat the real one in 0 of 4 votes. AI-made test material, not made by or for Zapier.
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

This is a real post on X that Zapier published on X. It underperformed: it got under a third of a similar post's engagement.

What it's about:
- Automated tools can only assist with work they can access
- Outdated written rules plus client history held only in memory force the system to infer, and it can be wrong
- Three products convert dispersed know-how into information the full team can use together

The post on X as published:
"AI only helps with work it can see

When rules live in a stale doc and customer history lives in someone's head, it has to guess (and might guess wrong)

Three builds that turn scattered knowledge into shared context for the whole team👇"

Rewrite it so it does better with the same audience, about the same subject, on the same channel. Then say in one sentence what you changed and why.

Everything known about Zapier (public facts, as of November 19, 2026):

--- brief.md ---
# Zapier (real brand; public facts as of 2026-11-19)

Website: zapier.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- Zapier sells no-code automation across 9,000+ apps. ("No-code automation across 9,000+ apps")
- The Free plan is $0 per month and includes Zaps, Tables, and Forms with 100 tasks per month. ("Start automating with AI. Zaps, Tables, and Forms included (100 tasks per month).")
- Professional starts at $19.99 per month and unlocks unlimited access to Zaps, Tables, and Forms. ("Unlock the full power of the Zapier platform with unlimited access to Zaps, Tables, and Forms.")
- The Team plan starts at $69 per month for collaborating on AI-powered systems. ("Collaborate with your team to build and manage complete AI-powered systems.")
- Enterprise pricing is contact-only and is positioned to scale systems across the organization. ("Scale AI-powered systems across your entire organization.")
- Every plan includes the full platform, including Zap workflows, Forms, and Tables. ("All plans include access to the full Zapier platform, including Zap workflows, Forms, and Tables.")

## Who it's for (their words)

- Zapier says it is built for everyone from the Fortune 500 to first-time founders. ("Built for everyone, from the Fortune 500 to first-time founders")
- Teams use it in boardrooms, spare rooms, and anywhere AI has ROI. ("Teams use Zapier in boardrooms, spare rooms, and anywhere that AI has ROI.")
- It is offered for startups, small and medium businesses, and enterprise. ("How Zapier can help you automate your work across teams")
- Marketing teams are a stated audience for campaign effectiveness and ROI. ("Multiply campaign effectiveness and ROI")
- IT teams are a stated audience for managing systems with automation. ("Better manage systems with automation")
- HR teams are a stated audience for AI automation. ("Empower your HR team with AI automation")

## Proof they publish

- Zapier says it is trusted by the world's best companies. ("Trusted by the world's best companies")
- Mercari US is a named customer, cited via Eric McNulty. ("Eric McNulty, Systems Manager for Customer Experience at Mercari US")
- A Mercari story reports 47,000 tickets resolved entirely by Zapier each month. ("47,000 tickets resolved entirely by Zapier each month")
- Okta is a named customer, cited via Korey Marciniak. ("Korey Marciniak, Customer Support Strategy and Operations at Okta")
- The Okta story says 13% of Workforce Identity escalations are handled automatically. ("13% of Okta Workforce Identity escalations handled automatically")
- Palo Alto Networks is a named customer, cited via Stas Bilder. ("Stas Bilder, Solutions Architect, Prisma Browser at Palo Alto Networks")

## Offers

- There is a free tier that includes 100 tasks per month. ("Start automating with AI. Zaps, Tables, and Forms included (100 tasks per month).")
- Zapier describes its pricing as flexible and risk-free. ("Our commitment to flexible, risk-free pricing")

## Sources

- https://zapier.com/
- https://zapier.com/pricing

--- site.md ---
[255 words of Zapier’s homepage text, copied from zapier.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[8 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Anything said about Zapier or its products uses only the facts below and the subject above: no invented numbers, prices, offers, features, customers, quotes, reviews, awards or dates, and facts kept exact.
- Return only the fields asked for.

Photos

None. The brand had no product photos to give, so the model was told not to show the product in detail.

Settings

Output
The rewritten words only; the image or thumbnail stays as it was
Models
Claude Opus 5.5, GPT-6.2 Sol, Gemini 4 Neon, all at high reasoning effort
Judged
Against each other from 3 angles (customer, copywriter, brand lead), and against the real flop by the two judges from other labs
What each model said it changed in its own words

Claude Opus 5.5: what it changed and why

I swapped the abstract opener for a pushback on a common belief and made the stale doc and memory-only history concrete, so readers recognize their own team before the payoff, without adding any new claims about Zapier.

GPT-6.2 Sol: what it changed and why

I led with a relatable hook and gave Forms, Tables, and Zaps a clear role so readers can see both why AI guesses and what their team can do about it.

Gemini 4 Neon: what it changed and why

I replaced the flat opening and generic thread-bait emoji with a provocative hook that reframes AI failures as an access problem, cut the weak parenthetical to sharpen the stakes, and tightened the copy under 280 characters to earn more stops and clicks on X.
What the judges saw the question, word for word, and every vote

The question

[customer] Picture yourself as someone who follows Zapier on X. Below are two versions of the same post. Go with your gut as that person: which one makes you more likely to stop and engage with it?

[copywriter] You're a senior direct-response copywriter reviewing two drafts of a post on X rewritten from one that underperformed. Which is the stronger copywriting for the job? Weigh clarity, specificity, proof, desire, flow and voice; don't reward length for its own sake.

[brand] You're Zapier's head of marketing. Your facts and your homepage copy are below. Which of these two drafts of a post on X rewritten from one that underperformed would you rather publish under Zapier's name? Weigh whether it sounds like Zapier, stays true to the facts, and carries no risk to the brand.
All 18 votes between the rewrites: 3 angles, each pair in both orders, judged by the lab not in the pair.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Claude Fable 5.2GeminiSolSol[brand] B opens with a friendly, human hook and ties the problem to Forms, Tables, and Zaps exactly as the site describes them, while A's scolding "Stop blaming AI" opener sounds less like Zapier and promises three builds it never shows.
Claude Fable 5.2SolGeminiSol[brand] A is a complete, friendly, practical post that ties the problem to real Zapier products (Forms, Tables, Zaps) exactly as the site describes them, while B opens with a scolding tone and ends on a dangling "3 builds" teaser that promises content it doesn't deliver.
GPT-6.2 AstraGeminiOpusGemini[brand] A makes the access problem concrete and points readers toward a practical fix without calling AI “dumb” or implying that missing context is the only reason it guesses.
GPT-6.2 AstraOpusGeminiGemini[brand] B fits a standard X post, makes the missing-context problem concrete, and avoids the word “dumb” without promising that better access will make AI error-free.
Gemini 4 CarbonSolOpusSol[brand] Draft A stands on its own as a complete, helpful post that accurately connects the problem directly to Zapier's core platform pillars (Forms, Tables, and Zaps) in a clear, brand-safe voice, whereas Draft B uses rougher phrasing ('dumb') and dangles an unfulfilled thread hook ('3 builds... 👇') with no actual Zapier product tie-in.
Gemini 4 CarbonOpusSolSol[brand] Draft B works as a standalone post without promising an unwritten thread and directly connects the problem to Zapier's core platform capabilities—Forms, Tables, and Zaps—accurately reflecting how our products work together.
Claude Fable 5.2GeminiSolSol[copywriter] B opens with a sharper, more concrete hook, flows in short punchy lines, and pays off with a specific mechanism (Forms, Tables, Zaps), while A is denser, more scolding, and ends on a vague teaser.
Claude Fable 5.2SolGeminiSol[copywriter] A opens with a sharper, more concrete hook, flows cleanly in short lines, and pays off with a specific solution (Forms, Tables, Zaps), while B is a dense block with a scolding opener that ends on an unfulfilled teaser.
GPT-6.2 AstraGeminiOpusOpus[copywriter] The opening makes you want to know why the AI is guessing, the best rep’s head is a more vivid detail than “someone’s head,” and the payoff makes clear who benefits: both the team and its AI.
GPT-6.2 AstraOpusGeminiOpus[copywriter] The rules nobody’s touched and the customer history in your best rep’s head make the problem tangible, and A moves from hook to payoff without B’s redundant “and can get things wrong.”
Gemini 4 CarbonSolOpusOpus[copywriter] B pairs a sharper reframing hook and vivid, relatable specifics with an actionable, curiosity-driving close, whereas A stalls out on a flat, premature product-feature dump.
Gemini 4 CarbonOpusSolOpus[copywriter] Draft A pairs a sharper, contrarian hook with vivid workplace specifics to build strong curiosity for the thread, whereas Draft B kills momentum by flattening the pain point and rushing straight into a premature product pitch.
Claude Fable 5.2GeminiSolSol[customer] B opens with a punchy, relatable hook, is easy to scan with line breaks, and gives a concrete takeaway, whereas A is a dense block that feels preachy and ends on a teaser.
Claude Fable 5.2SolGeminiSol[customer] A opens with a short, relatable hook and reads cleanly with a concrete payoff, while B feels like a dense block that scolds and then trails off into a teaser.
GPT-6.2 AstraGeminiOpusOpus[customer] The opening makes me want to read the next line, and I recognize the problem of customer history living in one rep’s head, so I’d click to see the three builds.
GPT-6.2 AstraOpusGeminiOpus[customer] The opening makes me pause, and the detail about customer history living in my best rep’s head makes me want to see the three builds.
Gemini 4 CarbonSolOpusOpus[customer] B hooks me immediately with a sharp, relatable workplace reality and promises actionable tutorials in a thread rather than just pitching product features like A does.
Gemini 4 CarbonOpusSolOpus[customer] A hooks me with a relatable operational pain point and promises actionable builds in a thread, whereas B reads too much like a standard product pitch.

Where each model falls short

Checks from the Boring Marketing skills (the copy scorecard, the search-ad rules), each scored as the average of the two judges from other labs.

Long sales pages, words only
CheckOpusSolGemini
Clear in one pass100%94%100%
Specific56%62%69%
One human voice0%25%0%
A picture of the after44%62%31%
Proof for every claim19%75%19%
Honest urgency, or none94%100%94%
Flows to the button0%50%0%
Answers the main doubt25%38%44%
One ask69%100%75%
Survives an AI summary94%81%81%
10 headlines
CheckOpusSolGemini
10 different angles31%62%31%
Specific94%81%100%
Clear on its own0%19%19%
Leads with the outcome12%62%44%
No hype25%94%19%
Best one first31%44%31%
Google search ads
CheckOpusSolGemini
Echoes the search38%62%75%
Any 3 read well together6%44%50%
Each works alone6%81%50%
No repeats0%19%6%
Claims, not labels0%6%0%
Clear next step100%100%100%
Cold emails (software)
CheckOpusSolGemini
About the reader75%100%100%
One small ask25%100%62%
Specific100%100%100%
Plain subject line62%88%38%
No fake familiarity88%100%100%
One person to one person0%25%0%
Product descriptions (products)
CheckOpusSolGemini
Clear from line one25%25%38%
Sells the outcome75%100%50%
Specific100%100%88%
Scannable88%88%75%
Carries proof100%75%100%
Answers the doubt75%75%62%
Sounds human0%25%0%
Rewriting a real flop
CheckOpusSolGemini
Same subject, same facts62%94%75%
Fixes a real weakness100%100%100%
Stronger opening94%88%88%
Fits the platform81%100%81%
Specific94%88%94%
Sounds human19%19%12%

Client-ready

Share that pass
CheckOpusSolGemini
Every claim backed by the brand’s facts90%100%98%
Rewrite beat the brand’s real flop (share of votes)78%69%56%

Search-ad headlines over Google’s 30-character limit: Opus 0.0 per ad, Sol 0.0 per ad, Gemini 0.0 per ad. Average reading grade: Opus 6.0, Sol 5.9, Gemini 7.9.

Video editing · the same footage, edited in code

Opus makes the best edit

Like Motion’s test (same clip, same prompt, same harness), but for ads. Every model got the same three generated clips per brand and the brand’s real photos, and edited a 15-second Reels ad in code with HyperFrames, the route in the skills’ motion-ads mode. Lint errors went back to the model, up to twice, the same for everyone; then it rendered on our machine.

Share of votes won
AngleOpusSolGemini
As seen in the feed: 17 frames and what’s said77%23%50%
Watching with sound (Opus vs Sol only)64%36%–

Edits that rendered: Opus 8 of 8, Sol 8 of 8, Gemini 5 of 8. Repair rounds needed, on average: Opus 1.1, Sol 1.9, Gemini 2.1.

Video edit · Ridge

The same footage, edited by each model

A typical brand: of the 8, the one whose result is closest to the result across all of them.

Side by side and muted. AI-made test material, not made by or for Ridge.

Where each edit falls short

Checks from the motion-ads mode (average of the two judges)
CheckOpusSolGemini
Hook on frame 0100%86%88%
Works muted100%100%100%
Product in 2 seconds50%57%50%
A proof moment93%79%88%
Clear offer or next step100%100%100%
End card100%100%100%
Words in the safe area64%79%50%
A real edit, not a slideshow86%0%100%
Cuts around glitchy footage57%79%62%
Native to Reels7%0%0%

How each model writes · 704 pieces

Each model has a house style

Every piece made in this eval, and the brands’ own real pieces, measured in code and labelled by two models from labs that aren’t competing (Qwen 4 Max and DeepSeek V4 Pro). A label counts only when both agree. They agreed on the opening hook 73%, the shape of the piece 59%, register 68%, the call to action 87%; the shape labels are the noisiest.

Per piece, on averageOpusSolGeminiBrands
Reading grade (US school year)6.26.18.26.7
Words per sentence9.09.212.69.1
“You” per 100 words2.92.62.43.1
“We” per 100 words0.80.40.51.0
Numbers per 100 words5.44.25.62.2
Questions per piece0.710.590.650.13
Exclamation marks per piece0.050.020.050.05
Em dashes per 100 words0.010.120.690.22
AI tells per 100 words0.060.020.120.15
Most-used hooksThe product’s name 36%
A question 14%
The outcome 13%
The product’s name 41%
A question 18%
A command 11%
The product’s name 40%
A command 9%
The outcome 8%
The product’s name 26%
A curiosity gap 13%
News 12%
Most-used shapesAnnouncement 23%
How-to or list 18%
Classic persuasive arc 13%
How-to or list 24%
Announcement 16%
Feature list 14%
How-to or list 22%
Announcement 20%
Classic persuasive arc 16%
Announcement 34%
How-to or list 21%
Story 14%

Which kinds of writing win the judges’ votes

Across 1,668 model-against-model votes, counting only matchups where one piece used the hook or shape and the other didn’t. 50% means it makes no difference.

Opening hook

  • An offer or price61% of 46
  • A question58% of 94
  • The outcome56% of 118
  • A pain or problem54% of 50
  • A number52% of 64
  • A command48% of 124
  • The product’s name46% of 138
  • A story or scene32% of 34

Shape of the piece

  • Problem, agitate, solve72% of 36
  • Offer first68% of 34
  • Announcement32% of 38
  • Classic persuasive arc28% of 58

In the same votes: the harder-to-read piece won 42%; the longer piece won 48%; the piece with more “you” won 51%; the piece with more numbers won 45%; the piece with more questions won 53%; the piece with more em dashes won 44%; the piece with more AI tells won 49%.

And with real customers

The brands’ own pieces come with real outcomes: 55 proven winners and 55 flops. Too few to prove anything, but they’re real. Winners averaged reading grade 6.73 and 24 words; flops averaged grade 6.72 and 34 words.

Opening hookReal winnersReal flops
The product’s name1110
A curiosity gap65
News64
A number45
A command45
A question42
The outcome42
A pain or problem05
A story or scene22

A second panel of judges

Judges from outside the race

The council judges each pair with the one lab that isn’t in it, so a judge’s taste can look like a model’s strength. So judges from labs outside the race, the ones that passed the same tryout, judged every pair again with exactly the same inputs, in both orders.

Share of votes won, judged only by labs outside the race
AngleOpusSolGemini
Deep work57%58%35%
Copywriting (as a copywriter)66%42%42%
Search (as an SEO strategist)45%43%62%
Video editing73%21%57%

How often the outside panel’s majority picked the same winner as the council, on the same pair and order: copywriting 87% of 187, deep work 89% of 249, video editing 90% of 31, search 77% of 66. Each outside judge’s share of wins by model: Kimi K3.1 Pro: Opus 62%, Sol 47%, Gemini 41%; Qwen 4 Max: Opus 57%, Sol 49%, Gemini 44%.

Live test · real visitors, real sign-ups

Does the AI’s page get more sign-ups?

Judges aren’t customers, so we put the models’ work in front of real people. Each model rewrote the sign-up screen of our own free playbook page, from the same facts. Every visitor sees one of four screens at random, the current page or one model’s, and the only thing that differs is the marketing.

Ready to start. Results appear here as visitors arrive, and count only when the rule below ends the test.

The rule, fixed before the first visitor: run until every screen has 400 visitors or for 28 days; pause any screen that falls clearly behind (one-sided p < 0.01 after 150 visitors); a model’s screen beats the current page only if p < 0.05 after correcting for three comparisons.

Against the brand’s own work

The real piece usually wins, except on YouTube

Every job also included the brand’s real piece: half proven winners (they kept running for months, or got at least 3 times the views or engagement of a similar piece), half flops. Across channels the judges picked the AI version 19% of the time against winners and 32% against flops. On YouTube it was 46% and 73%.

ChannelShare of votes the AI version wonWinners / flops
All channels1,300 votes19% / 32%
Instagram posts456 votes8% / 6%
Meta ads192 votes10% / 25%
X posts256 votes5% / 17%
YouTube396 votes46% / 73%
  • Against the brand's proven winners
  • Against the brand's flops
  • 50%: as good as the brand's piece

These comparisons aren’t blind. Asked which piece was AI-made, the judges were right 98% of the time, so “the brand wins” may partly be judges preferring what they can tell is real. That’s why the leaderboard uses model-against-model votes only.

Can people tell? Play “Which one is real?” in the quiz. The crowd’s answer goes here once enough people have played.

Examples

What the models saw, what they made, and how the judges voted

Four pieces where the judges preferred an AI version over the brand’s own, and one where the brand won every vote. Open the panels under each one for the exact prompt and photos every model got, the prompt each model then wrote for the image model, and every judge’s vote with its reason. A judge preferring a piece isn’t proof it would do better with real customers; a live test is.

YouTube · Miro

The judges picked Sol’s version over Miro’s proven winner

Miro’s real video: image

Miro x Endava: Powering Dava.Flow™ AI-Native Delivery

Miro’s real videoIt got at least 3x the views of a similar video. See the original
Made by GPT-6.2 Sol: image

How Endava Scales AI Workflows Across Teams With Miro

Made by GPT-6.2 SolAI-made test material, not made by or for Miro.

“[Sol's version] leads with a concrete outcome (“Weeks to Days”) in a bold, high-contrast thumbnail and a clear how-to title, while [Miro's] is a jargon-heavy partner announcement with a dim, logo-over-photo image that gives viewers little reason to click.”

Claude Fable 5.2, one of the judges · 4 of 4 votes for Sol’s version
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

This is Miro's next YouTube video. Write its title and design its thumbnail.

What the video covers:
Length: 00:02:05
Description:
By deploying Miro enterprise-wide, Endava is strengthening how its teams run workshops, align stakeholders, and hand over work across programmes. Early adoption is already showing measurable improvements in workshop outcomes, stakeholder alignment, and handover quality — with some processes reduced from weeks to days through automated, multi-step AI flows.
For Endava's clients, this means:
• Shorter decision cycles
• Reduced waste and rework
• Faster movement from insight to impact
Together, Miro and Endava are helping organizations move beyond experimentation and into scalable, enterprise-wide AI transformation.

Everything known about Miro (public facts, as of November 19, 2026):

--- brief.md ---
# Miro (real brand; public facts as of 2026-11-19)

Website: miro.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- The Starter plan costs $8 per member per month when billed yearly. ("$8/month per member, billed yearly")
- The Business plan costs $20 per member per month when billed yearly. ("$20/month per member, billed yearly")
- Starter is for small teams that collaborate regularly and want unlimited boards. ("For small teams collaborating regularly with unlimited boards")
- Business is for growing organizations and consultants streamlining workflows with AI. ("For growing organizations and consultants to streamline workflows with AI")
- Business includes more than 4,700 shapes for technical and process mapping. ("4,700+ shapes to map technical systems, cloud infrastructure, and business processes with Mermaid, UML, AWS, BPMN, and more")
- Enterprise includes regional data hosting in the EU, US, Australia, and Japan. ("Data residency options in EU, US, Australia, and Japan")
- Enterprise can add premium 24/7 support with guaranteed SLAs. ("Access premium 24/7 support and guaranteed SLAs")

## Who it's for (their words)

- Miro calls itself the AI platform for teamwork. ("The AI platform for teamwork")
- It is meant for team and cross-team collaboration with AI, not only individual productivity. ("Move beyond individual AI productivity to team and cross-team collaboration with AI.")
- The Intelligent Canvas is where a team and agents think, plan, and build together. ("The Intelligent Canvas where your team and agents think, plan, and build together")
- The Free plan is for small teams getting started with Miro. ("For small teams getting started with Miro")
- Enterprise is for large organizations that need security, governance, and AI at scale. ("For large organizations that need security, governance, and AI at scale")
- Business is described as best for teams and consultants. ("Best for teams and consultants")

## Proof they publish

- More than 250,000 companies use Miro. ("See how over 250,000 companies are getting great done in Miro")
- Miro cites 100 million-plus people collaborating on the product. ("100M+ people collaborating on Miro")
- Miro has more than 20,000 reviews on Capterra, G2, and TrustRadius. ("20,000+ reviews from Capterra, G2 and Trustradius")
- Miro cites 3.6x faster time to market. ("3.6x faster time to market")
- Miro cites a 50% shorter planning process. ("50% shorter planning process")
- The Free plan highlights more than 7,000 Miro and community templates. ("Start faster with 7000+ Miro and community-made templates")

## Offers

- On the Free plan, unlimited boards can be created and shared, but only the three most recent stay editable. ("Create and share unlimited boards. Three most recent ones will remain editable")
- Yearly billing is presented as a standing 20% saving versus monthly. ("MonthlyYearly (save 20%)")

## Sources

- https://miro.com/
- https://miro.com/pricing/

--- site.md ---
[457 words of Miro’s homepage text, copied from miro.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[8 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Customer-facing words use only the facts above (the subject and the brand's facts): nothing invented, facts kept exact.
- The image is made by an image model from your prompt. Describe exactly what's in it. Put any words that appear in the image in quotes, and keep them few.
- No real person's face or likeness, and no celebrities. If the piece needs a person, describe a generic one (an unnamed founder, a customer), never a named, real person. The brand's name may appear as text; no other logos.
- The image model also gets the 2 reference photo(s) of Miro's real product shown below. When the product appears, refer to them by number in your image prompt ("the wallet from Reference 1") so it's shown exactly as it is. Don't invent product details.
- Return only the fields asked for.

The brand’s photos it was given

Collaborative Miro canvas with boards, videos, and sticky notes
ref-1.jpg: Collaborative Miro canvas with boards, videos, and sticky notes
Miro roadmap timeline screen for Q4 planning
ref-2.jpg: Miro roadmap timeline screen for Q4 planning

Settings

Image model
GPT Image 2 at 2K, the same for every model, fed the model’s prompt and the photos
Reasoning
Each model’s default
Answer format
Structured fields: title, thumbnail_prompt
System prompt
You are a senior marketer doing client work. Follow the job’s instructions exactly.
Attempts
One. No retries for quality, no cherry-picking
What each model wrote for the image model the same image model made every version; only the prompt differs

GPT-6.2 Sol’s prompt to the image model

Create a 16:9 YouTube thumbnail at 1280 × 720 with a bold yellow background and a clean two-column layout. On the left, set “WEEKS TO DAYS” in oversized, heavy black sans-serif type, stacked as “WEEKS” above “TO DAYS”. Place the smaller plain-text byline “Endava + Miro” directly below. On the right, show a large, straight-on crop of the Miro roadmap timeline from Reference 2, preserving its layout, pastel timeline bars, and vertical marker exactly as shown. Select a crop where the bars dominate and the original interface text is too small to read; do not redraw the interface or add labels. Frame the crop with a thin black border. Keep all headline text clear of the edges and leave the lower-right corner free of important details for YouTube’s duration badge. No people, logos, or other added text.
What the judges saw the question, word for word, and every vote

The question

Two pieces of marketing for Miro on YouTube, about the same subject. One of them will do better with Miro’s audience: it gets far more views from its title and thumbnail. You see what a customer would see, never the numbers. Which one? Answer A or B; say tie only if you truly can’t separate them. One sentence on why.

[Then each piece: its words, and its image.]
Every vote between the pieces shown above (4). Each pairing is judged in both orders, by judges from labs that didn’t make the AI piece.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Claude Fable 5.2Miro’s real oneSol’sSol’sB leads with a concrete outcome ("Weeks to Days") in a bold, high-contrast thumbnail and a clear how-to title, while A is a jargon-heavy partner announcement with a dim, logo-over-photo image that gives viewers little reason to click.
Claude Fable 5.2Sol’sMiro’s real oneSol’sA's title promises a clear, searchable benefit (scaling AI workflows) and its bold 'Weeks to Days' thumbnail communicates a concrete outcome, whereas B leans on jargon-heavy branding and a generic partnership logo shot.
Gemini 4 CarbonMiro’s real oneSol’sSol’sItem B uses a high-contrast, benefit-driven thumbnail ('WEEKS TO DAYS') and a clear, relatable 'How-to' title about scaling AI workflows, whereas Item A relies on dark corporate imagery and unfamiliar proprietary jargon ('Dava.Flow™') that fails to hook general viewers.
Gemini 4 CarbonSol’sMiro’s real oneSol’sItem A focuses on a clear, relatable benefit ('WEEKS TO DAYS' and scaling AI workflows) with a high-contrast product thumbnail, whereas Item B relies on unfamiliar corporate jargon ('Dava.Flow™') and a generic, dimly lit partnership graphic.

YouTube · Peloton

The judges picked Opus’s version over Peloton’s proven winner

Peloton’s real video: image

Peloton Tread Flex Assembly

Peloton’s real videoIt got at least 3x the views of a similar video. See the original
Made by Claude Opus 5.5: image

How to Assemble Your Peloton Tread: Full Step-by-Step Setup Guide

Made by Claude Opus 5.5AI-made test material, not made by or for Peloton.

“The how-to title matches what a new Tread owner would search for, and the thumbnail shows someone assembling it, making the step-by-step promise clear at a glance.”

GPT-6.2 Astra, one of the judges · 4 of 4 votes for Opus’s version
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

This is Peloton's next YouTube video. Write its title and design its thumbnail.

What the video covers:
Length: 00:09:47
Description:
0:00 Disclaimer
0:10 Intro
0:19 Space Requirements
0:38 Unboxing Deck Box
1:35 Unboxing Accessory Box
1:56 Unlocking Stow Bolt
2:15 Installing Uprights
3:17 Installing Handrail
4:04 Fully Tighten Uprights
4:21 Installing Covers
5:03 Installing Neck Assembly
5:18 Installing the Screen
5:56 Installing Water Bottle Holders, Tray and Safety Key
6:11 Deck Leveling
6:51 Connect to Wifi
6:55 Belt Alignment
8:51 Stowing and Locking
9:21 Stowing
Chapters: Disclaimer; Intro; Space Requirements; Unboxing Deck Box; Unboxing Accessory Box; Unlocking Stow Bolt; Installing Uprights; Installing Handrail; Fully Tighten Uprights; Installing Covers; Installing Neck Assembly; Installing the Screen; Installing Water Bottle Holders, Tray and Safety Key; Deck Leveling; Connect to Wifi

Everything known about Peloton (public facts, as of November 19, 2026):

--- brief.md ---
# Peloton (real brand; public facts as of 2026-11-19)

Website: onepeloton.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- An All-Access Membership is required to use all content and features on Peloton hardware. ("Peloton All-Access Membership required to access all Peloton content")
- One All-Access Membership covers one of each type of Peloton hardware per household. ("A single All-Access Membership provides access to Peloton content on one of each type of Peloton hardware")
- Membership standard monthly pricing, accessories, and taxes are charged separately. ("Peloton All-Access Membership (standard monthly pricing), accessories and taxes separate.")
- Peloton Tread+ Vision purchases require a $299 assembly fee. ("Additional required $299 assembly fee with all purchases of Peloton Tread+ Vision.")
- Peloton also sells apparel with instructor-approved styles and performance fabrics. ("Look and train your best with instructor-approved styles, performance fabrics, and exclusive collabs.")

## Who it's for (their words)

- Peloton says it has instructors for whatever members are feeling. ("Whatever you're feeling, there's an expert instructor who lives for it.")
- Classes are built around a community across running, cycling, strength, yoga, and more. ("From running and cycling to strength, yoga, and more, every class is built around a community")
- Peloton IQ is framed as personalized guidance to chase personal bests. ("Get personalized guidance and insights to help you chase your personal bests.")
- Commercial workouts are for people keeping a streak or trying Peloton away from home. ("Keep your streak alive, or try it for the first time with workouts that travel with you.")

## Proof they publish

- Peloton says members can choose from over 10,000 classes. ("Choose from over 10,000 classes across more than 15 workout types")
- Peloton says members can move with millions of other Members. ("Move with millions of Members by your side")
- Named member Jocelyn from Union, NJ is quoted about consistency. ("It's been such a journey learning to respect myself, be consistent, and be my own cheerleader.")
- Named member Marcia from NYC, NY is quoted about feeling proud. ("There's strength in feeling proud that you did the thing you said you were gonna do.")
- Named member Seth from Los Angeles, CA is quoted about showing up. ("When it comes to fitness, success looks like showing up for yourself")

## Offers

- Treads include a 12-month limited warranty plus longer belt, motor, and frame guarantees. ("Includes a 12-month Limited Warranty, a 3-year Belt & Motor Guarantee, and a 5-year Frame Guarantee for Treads.")
- Eligible buyers can pay for equipment with pre-tax HSA or FSA funds through Truemed. ("Use pre-tax funds to pay for your equipment with Truemed.")
- If the home trial is not a fit, Peloton will pick up the equipment and refund the order excluding the return fee. ("If it's not for you, we'll pick it up and refund your order, excluding the return fee.")

## Sources

- https://onepeloton.com/

--- site.md ---
[453 words of Peloton’s homepage text, copied from onepeloton.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[8 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Customer-facing words use only the facts above (the subject and the brand's facts): nothing invented, facts kept exact.
- The image is made by an image model from your prompt. Describe exactly what's in it. Put any words that appear in the image in quotes, and keep them few.
- No real person's face or likeness, and no celebrities. If the piece needs a person, describe a generic one (an unnamed founder, a customer), never a named, real person. The brand's name may appear as text; no other logos.
- The image model also gets the 1 reference photo(s) of Peloton's real product shown below. When the product appears, refer to them by number in your image prompt ("the wallet from Reference 1") so it's shown exactly as it is. Don't invent product details.
- Return only the fields asked for.

The brand’s photos it was given

Side view of a Peloton treadmill with screen
ref-1.jpg: Side view of a Peloton treadmill with screen

Settings

Image model
GPT Image 2 at 2K, the same for every model, fed the model’s prompt and the photos
Reasoning
Each model’s default
Answer format
Structured fields: title, thumbnail_prompt
System prompt
You are a senior marketer doing client work. Follow the job’s instructions exactly.
Attempts
One. No retries for quality, no cherry-picking
What each model wrote for the image model the same image model made every version; only the prompt differs

Claude Opus 5.5’s prompt to the image model

YouTube thumbnail, 16:9, clean and bright. The black Peloton treadmill from Reference 1, shown exactly as in the reference (same side-view angle, same frame, handrail, deck, red accent line and screen), placed on the right two-thirds of the frame on a light wood floor in a minimal, softly lit home room with a plain light-gray wall. The treadmill's screen is turned off and shows a plain dark glass surface with no image. In the left foreground, a generic adult seen from behind and to the side, face not visible, kneels next to the base of the treadmill's upright, holding a simple silver hex key toward the base where the upright meets the deck. A few flattened cardboard boxes lean against the wall in the background, slightly blurred. Large bold white sans-serif text with a subtle black drop shadow on the upper left reads "TREAD SETUP", and below it smaller red text reads "STEP BY STEP". No other text, no logos other than what appears on the product in Reference 1, high contrast, sharp focus on the treadmill.
What the judges saw the question, word for word, and every vote

The question

Two pieces of marketing for Peloton on YouTube, about the same subject. One of them will do better with Peloton’s audience: it gets far more views from its title and thumbnail. You see what a customer would see, never the numbers. Which one? Answer A or B; say tie only if you truly can’t separate them. One sentence on why.

[Then each piece: its words, and its image.]
Every vote between the pieces shown above (4). Each pairing is judged in both orders, by judges from labs that didn’t make the AI piece.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Gemini 4 CarbonPeloton’s real oneOpus’sOpus’sItem B uses a search-friendly 'How to' title paired with a bright, clear thumbnail showing a person actively assembling the popular flagship Tread alongside bold, readable text, whereas Item A is overly dark and lacks human action.
Gemini 4 CarbonOpus’sPeloton’s real oneOpus’sItem A uses a search-friendly 'how-to' title and a bright, high-contrast thumbnail clearly showing a person assembling the machine, making it much easier to find and recognize than B's overly dark image and vague title.
GPT-6.2 AstraPeloton’s real oneOpus’sOpus’sThe how-to title matches what a new Tread owner would search for, and the thumbnail shows someone assembling it, making the step-by-step promise clear at a glance.
GPT-6.2 AstraOpus’sPeloton’s real oneOpus’sA’s how-to title matches what owners would search for, and its thumbnail shows someone working on the Tread, making the promise of step-by-step help clear at a glance.

Instagram · Ridge

The judges picked Sol’s version over Ridge’s proven winner

Ridge’s real post: image

Straight from the clear-tech era. Atomic Purple puts the build on display across Ridge wallets and the magnetic power bank. Limited edition.

Ridge’s real postIt got at least 3x the plays or likes of a similar post. See the original
Made by GPT-6.2 Sol: image

Atomic Purple. A transparent shell that shows how it’s built. Available in a limited run for the Ridge Wallet and Magnetic Power Bank.

Made by GPT-6.2 SolAI-made test material, not made by or for Ridge.

“[Sol's] bright, vivid hero shot of the transparent purple wallet with a clear title is more striking and legible in-feed than [Ridge's] dark, muted composition, even though [Ridge's] has the nostalgic N64 hook.”

Claude Fable 5.2, one of the judges · 4 of 4 votes for Sol’s version
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

Make Ridge's next Instagram post about the subject below: one image and its caption.

The subject:
- Ridge wallets are sold in an Atomic Purple finish.
- A magnetic power bank comes in that same finish.
- The finish is offered only as a limited run.
- The shell is transparent so the internal construction can be seen.

Everything known about Ridge (public facts, as of November 19, 2026):

--- brief.md ---
# Ridge (real brand; public facts as of 2026-11-19)

Website: ridge.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- Ridge wallets are slim, RFID-blocking, and guaranteed for life. ("Slim, RFID-blocking, Guaranteed for Life")
- Power banks offer 5-in-1 power, MagSafe readiness, and built-in cables. ("5-in-1 Power, MagSafe-ready, cables built in.")
- Hardshell luggage is weatherproof, rugged, and travel-ready. ("Weatherproof, rugged build and travel-ready.")
- Men's rings have a premium build with a lifetime guarantee. ("Premium build, lifetime guarantee included")
- Ridge sells a 24 oz water bottle engineered to outlast. ("Ridge 24 oz Water Bottle Engineered To Outlast")
- MagSafe wallets are described as next-level compatible. ("MagSafe® Wallet Next Level Compatible")
- Vacuum packing sets are sold to fit more in the same bag. ("Vacuum Packing Sets Same Bag, More Room")

## Who it's for (their words)

- The brand speaks to guys as gift recipients. ("For every guy on the list")
- Products are positioned as gear used every day. ("The gear you rely on every day")
- Women's wallets are framed as premium everyday gear. ("Women's Wallets Premium Everyday Gear")
- Men's rings are built for life. ("Men's Rings Built For Life")
- Ridge offers bulk and corporate orders. ("Bulk & Corporate Orders Personal Touch. Premium Gear.")
- Backpacks and bags are purpose-built for adventure. ("Backpack & Bags Purpose-Built For Adventure")

## Offers

- Shoppers can return an item for a full refund if it is not as promised. ("Live with it. If it's not everything we promised, return it for a full refund.")
- Products are backed by a lifetime warranty. ("Made to last, backed by a promise that never fades.")
- Shipping is fast and free, with no added fees. ("Delivered swiftly, carefully, and without added fees.")
- Gear is guaranteed for life. ("Overbuilt. Guaranteed for life. Used every day.")

## Sources

- https://ridge.com/
- https://ridge.com/products/magnetic-power-bank-matte-black

--- site.md ---
[440 words of Ridge’s homepage text, copied from ridge.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[2 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Customer-facing words use only the facts above (the subject and the brand's facts): nothing invented, facts kept exact.
- The image is made by an image model from your prompt. Describe exactly what's in it. Put any words that appear in the image in quotes, and keep them few.
- No real person's face or likeness, and no celebrities. If the piece needs a person, describe a generic one (an unnamed founder, a customer), never a named, real person. The brand's name may appear as text; no other logos.
- The image model also gets the 3 reference photo(s) of Ridge's real product shown below. When the product appears, refer to them by number in your image prompt ("the wallet from Reference 1") so it's shown exactly as it is. Don't invent product details.
- Return only the fields asked for.

The brand’s photos it was given

Two gunmetal Ridge wallets on a white background
ref-1.jpg: Two gunmetal Ridge wallets on a white background
Orange, olive, and black Ridge magnetic wallets
ref-2.jpg: Orange, olive, and black Ridge magnetic wallets
Carbon-fiber Ridge wallets with elastic cash straps
ref-3.jpg: Carbon-fiber Ridge wallets with elastic cash straps

Settings

Image model
GPT Image 2 at 2K, the same for every model, fed the model’s prompt and the photos
Reasoning
Each model’s default
Answer format
Structured fields: caption, image_prompt
System prompt
You are a senior marketer doing client work. Follow the job’s instructions exactly.
Attempts
One. No retries for quality, no cherry-picking
What each model wrote for the image model the same image model made every version; only the prompt differs

GPT-6.2 Sol’s prompt to the image model

Create a single 4:5 Instagram product photograph. Show only the front-facing wallet from Reference 1, centered and rotated slightly clockwise in a tight three-quarter view. Preserve its exact silhouette, proportions, screw positions, thumb cutout, and layered edge. Change only the gunmetal shell to transparent Atomic Purple, letting the existing construction show through without adding any components or decorative patterns. Use a seamless matte charcoal background and a soft white strip light from the upper left to reveal the shell’s transparency without washing out the purple. Leave clean negative space above the wallet for the small, white, uppercase headline "ATOMIC PURPLE". Keep the original "RIDGE" wordmark on the wallet. No other text, logos, props, or people.
What the judges saw the question, word for word, and every vote

The question

Two pieces of marketing for Ridge on Instagram, about the same subject. One of them will do better with Ridge’s audience: it gets far more plays and likes. You see what a customer would see, never the numbers. Which one? Answer A or B; say tie only if you truly can’t separate them. One sentence on why.

[Then each piece: its words, and its image.]
Every vote between the pieces shown above (4). Each pairing is judged in both orders, by judges from labs that didn’t make the AI piece.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Claude Fable 5.2Ridge’s real oneSol’sSol’sB's bright, crisp hero shot of the vivid translucent purple wallet with a clear product name is more eye-catching and instantly readable than A's dark, muted, cluttered image.
Claude Fable 5.2Sol’sRidge’s real oneSol’sA's bright, vivid hero shot of the transparent purple wallet with a clear title is more striking and legible in-feed than B's dark, muted composition, even though B has the nostalgic N64 hook.
Gemini 4 CarbonRidge’s real oneSol’sSol’sItem B's vibrant, studio-lit 3D presentation makes the translucent purple color pop immediately on the feed with clear on-screen text, whereas Item A looks dark and muted while obscuring the wallet against the controller beneath it.
Gemini 4 CarbonSol’sRidge’s real oneSol’sItem A serves as a vibrant, high-contrast hero reveal that makes the translucent purple color pop instantly in the feed, whereas Item B is dimly lit, muted in color, and obscures the wallet's signature look.

Meta ads · Grammarly

The judges picked Opus’s version over Grammarly’s flop

Grammarly’s real ad: image

Work faster and smarter with an AI assistant that supports you at every step. Headline: Your AI writing assistant Button: Sign up

Grammarly’s real adIt was switched off within two weeks. See the original
Made by Claude Opus 5.5: image

Grammarly is your AI writing partner, helping you through every stage of your work so you get things done faster and better. Jayesh J., an MBA student, says Grammarly lets him send messages with confidence because his writing looks polished. Trusted by 50,000 organizations and 40 million people. Sign up and get Grammarly today. Headline: Hit send with confidence. Sign up free. Button: Sign Up

Made by Claude Opus 5.5AI-made test material, not made by or for Grammarly.

“[Opus's ad] shows how a tone suggestion can make a work message sound more confident, giving readers a concrete reason to sign up free that [Grammarly's] testimonial alone doesn’t provide.”

GPT-6.2 Astra, one of the judges · 4 of 4 votes for Opus’s version
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

Make one Meta ad (Facebook and Instagram feed) for Grammarly about the subject below.

The subject:
- The product shown is Grammarly.
- It is presented as an automated helper for composing text.
- It is said to assist people through each stage of their work so tasks get done sooner and more effectively.
- A quoted user named Jayesh J. is identified as an MBA student.
- He credits the tool with letting him send messages confidently because the wording appears polished.
- Readers are prompted to register and obtain the product now.

Everything known about Grammarly (public facts, as of November 19, 2026):

--- brief.md ---
# Grammarly (real brand; public facts as of 2026-11-19)

Website: grammarly.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- The Free plan is described as mistake-free writing. ("Get peace of mind with writing that's mistake-free.")
- Free includes 100 AI prompts for generating text. ("Generate text with 100 AI prompts")
- Pro includes 2,000 AI prompts for generating text. ("Generate text with 2,000 AI prompts")
- Pro is billed per member per month annually, or €30 when billed monthly. ("/ member / month, billed annually**€30** when billed monthly")
- Pro can rewrite full sentences with a click. ("Rewrite full sentences with a click")
- Pro can detect plagiarism and AI-generated text. ("Detect plagiarism and AI generated text")
- Enterprise Grammarly is available through Superhuman Go. ("Drive results across your organization with Grammarly, available through Superhuman Go.")

## Who it's for (their words)

- Grammarly presents itself as an AI partner for clear, credible writing. ("Work with an AI partner that helps turn your thoughts into writing that's clear, credible, and impossible to ignore.")
- Suggestions are for writing for yourself or for your brand. ("whether writing for yourself or your brand.")
- The product is framed for professional, clear, convincing writing in a few clicks. ("Be perfectly professional, clear, and convincing in a few clicks, not a few hours.")
- Pro is described for people working alone or as a team. ("Deliver impactful writing, whether working alone or as a team.")
- On the plans page, Pro is for eligible individuals and teams. ("For eligible individuals and teams")

## Proof they publish

- Grammarly says it is trusted by 50,000 organizations and 40 million people. ("Trusted by 50,000 organizations and 40 million people")
- Organizations that deploy Grammarly save an average of $5,000 per employee per year. ("Organizations that deploy Grammarly save an average of $5,000 per employee per year.")
- Grammarly calls itself the AI writing leader for more than a decade. ("Work smarter with the AI writing leader for more than a decade.")
- A customer used to spend 20-30 hours a week reviewing, rewriting, and coaching. ("I used to spend 20-30 hours a week reviewing, rewriting, and coaching.")
- A customer said Grammarly cut that review work by at least half. ("Grammarly has cut that by at least half, and that's allowed my team to scale without scaling.")
- A customer said Grammarly reduces time spent reviewing written work. ("Grammarly reduces the time our team spends reviewing written work.")
- Grammarly cites a SOC 2 Type 2 report for security, privacy, availability, and confidentiality. ("Grammarly's SOC 2 (Type 2) report attests to our enterprise-grade system and organization controls regarding security, privacy, availability, and confidentiality.")

## Offers

- Pro can be tried for €0 today. ("Try Pro for €0 today")

## Sources

- https://grammarly.com/
- https://www.grammarly.com/plans

--- site.md ---
[443 words of Grammarly’s homepage text, copied from grammarly.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[8 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Customer-facing words use only the facts above (the subject and the brand's facts): nothing invented, facts kept exact.
- The image is made by an image model from your prompt. Describe exactly what's in it. Put any words that appear in the image in quotes, and keep them few.
- No real person's face or likeness, and no celebrities. If the piece needs a person, describe a generic one (an unnamed founder, a customer), never a named, real person. The brand's name may appear as text; no other logos.
- The image model also gets the 3 reference photo(s) of Grammarly's real product shown below. When the product appears, refer to them by number in your image prompt ("the wallet from Reference 1") so it's shown exactly as it is. Don't invent product details.
- Return only the fields asked for.

The brand’s photos it was given

Rephrase panel offering a clarity fix and Insert button
ref-1.jpg: Rephrase panel offering a clarity fix and Insert button
Tone suggestion card recommending confident wording
ref-2.jpg: Tone suggestion card recommending confident wording
Grammar fix card highlighting a corrected sentence
ref-3.jpg: Grammar fix card highlighting a corrected sentence

Settings

Image model
GPT Image 2 at 2K, the same for every model, fed the model’s prompt and the photos
Reasoning
Each model’s default
Answer format
Structured fields: primary_text, headline, cta, image_prompt
System prompt
You are a senior marketer doing client work. Follow the job’s instructions exactly.
Attempts
One. No retries for quality, no cherry-picking
What each model wrote for the image model the same image model made every version; only the prompt differs

Claude Opus 5.5’s prompt to the image model

Square 1:1 clean product graphic for a social feed ad. Background: the soft blue-to-periwinkle gradient with faint dot grid from Reference 2. Center foreground: the Tone Suggestion card from Reference 2, shown exactly as it is (the 'Confident' label with the handshake emoji slider, the sentence 'I have an idea that should improve campaign performance.' with its purple highlighted words, the green 'Accept' button and 'Dismiss'), large and crisp with a subtle soft shadow. Slightly behind it, offset to the lower right and partially overlapped, the 'Fix grammar and spelling' card from Reference 3, shown exactly as it is, smaller and slightly faded for depth. No people, no devices, no other logos. Above the cards, in a clean bold dark sans-serif headline: "Send it with confidence." Small 'Grammarly' wordmark text in the bottom left corner in dark green. Minimal, bright, modern, plenty of breathing room.
What the judges saw the question, word for word, and every vote

The question

Two pieces of marketing for Grammarly on Facebook and Instagram feed ads, about the same subject. One of them will do better with Grammarly’s audience: the advertiser would keep it running because it wins customers. You see what a customer would see, never the numbers. Which one? Answer A or B; say tie only if you truly can’t separate them. One sentence on why.

[Then each piece: its words, and its image.]
Every vote between the pieces shown above (4). Each pairing is judged in both orders, by judges from labs that didn’t make the AI piece.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Gemini 4 CarbonGrammarly’s real oneOpus’sOpus’sItem B visually demonstrates how the product actually works through clear UI mockups, pairs a strong benefit-driven visual headline with strong social proof, and explicitly highlights that signing up is free.
Gemini 4 CarbonOpus’sGrammarly’s real oneOpus’sAd A visually demonstrates how the product actually works with clear UI examples, highlights that signing up is free, and backs its claims with massive social proof.
GPT-6.2 AstraGrammarly’s real oneOpus’sOpus’sB shows how a tone suggestion can make a work message sound more confident, then gives viewers a clear invitation to try Grammarly for free.
GPT-6.2 AstraOpus’sGrammarly’s real oneOpus’sA shows how a tone suggestion can make a work message sound more confident, giving readers a concrete reason to sign up free that B’s testimonial alone doesn’t provide.

Instagram · Glossier

Glossier’s proven winner beat all three AI versions

Glossier’s real post: image

Puts the plush in Cloud Paint Plush Blush 🫆

Glossier’s real postIt got at least 3x the plays or likes of a similar post. See the original
Made by Claude Opus 5.5: image

Top-rated: Cloud Paint Plush Blush 🌸 We believe beauty is about having fun, celebrating freedom, and being present. Pick a compact (or a few) and see where the day takes you. No matter where you are in your beauty journey, you look good. Right now: up to 30% off sitewide, plus a free gift on qualifying orders. Free standard shipping on orders $40+.

Made by Claude Opus 5.5AI-made test material, not made by or for Glossier.
Made by GPT-6.2 Sol: image

Cloud Paint Plush Blush. Top-rated.

Made by GPT-6.2 SolAI-made test material, not made by or for Glossier.
Made by Gemini 4 Neon: image

Top-rated Cloud Paint Plush Blush. Made with our Skin First ethos and inspired by real life, because we believe beauty is about having fun, celebrating freedom, and being present. No matter where you are in your beauty journey, you look good. Shop now at glossier.com for up to 30% off sitewide, plus a free gift on qualifying orders and free standard shipping on orders $40+.

Made by Gemini 4 NeonAI-made test material, not made by or for Glossier.

“The fingertip swatch makes “plush” feel tangible at a glance, and the playful one-liner fits Glossier’s Instagram voice better than [Gemini's] lengthy sales pitch.”

GPT-6.2 Astra, one of the judges · 12 of 12 votes for Glossier’s real post
What the model saw the exact prompt, the photos and the settings, the same for all three

The prompt, word for word

Make Glossier's next Instagram post about the subject below: one image and its caption.

The subject:
Glossier Cloud Paint Plush Blush
A blush product

Everything known about Glossier (public facts, as of November 19, 2026):

--- brief.md ---
# Glossier (real brand; public facts as of 2026-11-19)

Website: glossier.com. Facts below come from the brand's own site, each with the exact words it says.

## What they sell

- Glossier You eau de parfum is offered in 8 ml, 50 ml, and 100 ml sizes. ("8 ml, 50 ml, 100 ml")
- Glossier You 100 ml is listed at €155. ("Add to bag  €155  Notify me  €155")
- Glossier You is described as a soft, warm, familiar skin-scent fragrance. ("Glossier You is a soft, warm and familiar skin-scent enhancing fragrance.")
- Purchases of Glossier You are limited to 5 per customer. ("Limited to 5 per customer")
- Boy Brow grooming pomade in Dark Brown is priced at €29. ("Boy Brow 

Grooming pomade 

Dark Brown 

€29")
- Lash Slick film-form mascara in Black is priced at €26. ("Lash Slick 

Film form mascara 

Black 

€26")
- Balm Dotcom nourishing lip balm is priced at €21. ("Balm Dotcom 

Nourishing lip balm 

NEW  Just Baked 

€21")

## Who it's for (their words)

- Glossier makes products inspired by real life and a skin-first ethos. ("we make products inspired by real life, embracing the ethos of Skin First.")
- The brand says beauty is about fun, freedom, and being present. ("We believe beauty is about having fun, celebrating freedom, and being present.")
- It speaks to people at any point in a beauty journey. ("No matter where you are in your beauty journey, you look good.")
- Custom skincare sets are positioned for people meeting skin goals. ("Create a Custom Skincare Set to meet your skin goals")
- Body products are framed as an upgrade to a body care routine. ("Upgrade your body care routine")

## Proof they publish

- Glossier You is marked as a best seller. ("Coming soon 30% Off Best Seller")
- Cloud Paint Plush Blush is labeled top-rated. ("Top-rated

###   Cloud Paint Plush Blush")
- A Glossier You review is rated 5 out of five stars. ("5 out of five stars")
- A reviewer says people who smell good are always wearing Glossier. ("Whenever people smell good, it's _always_ Glossier.")
- The five-star review is attributed to Jade at Glossier HQ. ("it's _always_ Glossier."  


Jade, Glossier HQ")

## Offers

- Standard shipping is free on orders of $40 or more. ("Free standard shipping on orders $40+")
- In Germany, shipping is free on orders over €65. ("Free shipping on orders over €65 EUR")
- In Germany, express shipping is free on orders over €130. ("Free express shipping on orders over €130 EUR")
- Duties and taxes are included for shoppers in Germany. ("Duties and taxes are included.")
- Germany shoppers are offered easy 30-day returns. ("Free express shipping on orders over €130 EUR 
  * Easy, 30-day returns.")

## Sources

- https://glossier.com/
- https://glossier.com/en-de/products/glossier-you

--- site.md ---
[410 words of Glossier’s homepage text, copied from glossier.com on November 19, 2026. Left out of this page because it’s the brand’s own copy.]

--- reviews.md ---
[8 real customer reviews, word for word and cut at 60 words, from Trustpilot. Left out of this page because they’re the customers’ words.]


Rules for this job:
- Customer-facing words use only the facts above (the subject and the brand's facts): nothing invented, facts kept exact.
- The image is made by an image model from your prompt. Describe exactly what's in it. Put any words that appear in the image in quotes, and keep them few.
- No real person's face or likeness, and no celebrities. If the piece needs a person, describe a generic one (an unnamed founder, a customer), never a named, real person. The brand's name may appear as text; no other logos.
- The image model also gets the 3 reference photo(s) of Glossier's real product shown below. When the product appears, refer to them by number in your image prompt ("the wallet from Reference 1") so it's shown exactly as it is. Don't invent product details.
- Return only the fields asked for.

The brand’s photos it was given

Glossier priming moisturizer jars and squeeze tubes
ref-1.jpg: Glossier priming moisturizer jars and squeeze tubes
Open red jar revealing white cream inside
ref-2.jpg: Open red jar revealing white cream inside
Assorted cloud paint blush compacts, several opened
ref-3.jpg: Assorted cloud paint blush compacts, several opened

Settings

Image model
GPT Image 2 at 2K, the same for every model, fed the model’s prompt and the photos
Reasoning
Each model’s default
Answer format
Structured fields: caption, image_prompt
System prompt
You are a senior marketer doing client work. Follow the job’s instructions exactly.
Attempts
One. No retries for quality, no cherry-picking
What each model wrote for the image model the same image model made every version; only the prompt differs

Claude Opus 5.5’s prompt to the image model

Bright, airy overhead flat-lay product photo on a soft milky-pink seamless background with gentle natural daylight and soft shadows. The Glossier Cloud Paint Plush Blush compacts from Reference 3 are arranged in a loose, playful scatter, shown exactly as they appear in Reference 3: the same rectangular compacts in the same colors (rose, peach, bright pink, coral, lilac, berry), with the same embossed "Glossier." and "cloud paint plush blush" lettering on the lids. Several compacts are open with their lids flipped back, showing the blush pans inside exactly as in Reference 3. Do not add or change any product details, shades, packaging shapes, or labels. Clean, minimal, modern beauty aesthetic with a lot of breathing room. In the upper left corner, small clean sans-serif text in white reads "Top-rated". No people, no other logos, no other text.

GPT-6.2 Sol’s prompt to the image model

Create one 4:5 vertical Instagram still life shot from directly overhead. Show exactly three Glossier Cloud Paint Plush Blush compacts from Reference 3: the open vivid red compact from the upper right, the closed dusty rose compact from the upper left, and the closed coral compact from the bottom center. Match their packaging, proportions, colors, and the red compact’s lid angle and visible pan exactly. Arrange them in a loose triangle on a seamless pale pink backdrop, with the open red compact just above center and the two closed compacts offset below it. Leave a small gap between each compact. Use direct studio light from the upper left to cast clean, short shadows. Keep only the original packaging text: “Glossier.”, “cloud paint™”, and “plush blush”. No overlay text, props, people, or products from References 1 and 2.

Gemini 4 Neon’s prompt to the image model

Vertical 4:5 editorial product photograph in natural morning sunlight, featuring five of the rectangular beveled Glossier Cloud Paint Plush Blush compacts from Reference 3 arranged artfully on a clean, smooth off-white ceramic vanity countertop. The bright coral-red compact from Reference 3 sits open in the foreground at a slight angle, displaying its smooth rectangular blush pan inside the white inner frame. Beside it, the soft baby pink compact from Reference 3 rests open, and the deep berry compact from Reference 3 sits partially open nearby. Next to them, the closed bright pink and dusty rose compacts from Reference 3 are casually stacked, clearly showing the printed "Glossier." and "cloud paint" text on their lids exactly as seen in Reference 3. Warm directional sunlight streams across the scene from the left, casting crisp, airy shadows across the countertop and subtle light reflections against soft-focus glossy white wall tiles in the background. In the softly blurred edge of the frame, the corner of a clean pale pink cotton towel adds a real-life morning routine feel. Captured with a natural medium-format film aesthetic, sharp focus on the compacts, true-to-life colors, minimal and bright composition, with no added graphics, no extra text, and no other logos.
What the judges saw the question, word for word, and every vote

The question

Two pieces of marketing for Glossier on Instagram, about the same subject. One of them will do better with Glossier’s audience: it gets far more plays and likes. You see what a customer would see, never the numbers. Which one? Answer A or B; say tie only if you truly can’t separate them. One sentence on why.

[Then each piece: its words, and its image.]
Every vote between the pieces shown above (18). Each pairing is judged in both orders, by judges from labs that didn’t make the AI piece.
JudgeShown as AShown as BPickedWhy, in the judge’s words
Claude Fable 5.2Glossier’s real oneGemini’sGlossier’s real oneA's short, playful caption and striking close-up texture shot of the fingerprint swatch feels native and intriguing, while B reads like a generic promotional ad with a long sales-heavy caption.
Claude Fable 5.2Gemini’sGlossier’s real oneGlossier’s real oneB's short, playful caption and striking tactile close-up of the fingerprint swatch feel like native Glossier content, while A reads as a sales ad with promo-heavy copy that typically draws less organic engagement.
GPT-6.2 AstraGlossier’s real oneGemini’sGlossier’s real oneThe fingertip swatch makes “plush” feel tangible at a glance, and the playful one-liner fits Glossier’s Instagram voice better than B’s lengthy sales pitch.
GPT-6.2 AstraGemini’sGlossier’s real oneGlossier’s real oneThe fingertip swatch makes the blush’s texture almost tangible, and the playful one-line caption feels more at home on Instagram than A’s sales pitch.
Claude Fable 5.2Glossier’s real oneSol’sGlossier’s real oneThe close-up fingertip swatch paired with the compact shows texture and pigment in a tactile, scroll-stopping way with a playful caption, whereas B is a generic product flat lay with a bland 'top-rated' line.
Claude Fable 5.2Sol’sGlossier’s real oneGlossier’s real oneThe macro fingertip swatch shows the actual texture and pigment in a tactile, distinctive way with a playful caption, which is more engaging than a standard product flat-lay with a generic 'top-rated' line.
Gemini 4 CarbonGlossier’s real oneSol’sGlossier’s real oneThe tactile finger swatch visual paired with playful copy feels much more organic, satisfying, and native to Glossier's aesthetic than Item B's generic, ad-like 'Top-rated' framing.
Gemini 4 CarbonSol’sGlossier’s real oneGlossier’s real oneItem B uses a playful, native caption and a tactile, sensory split-screen visual showing the blush's bouncy texture on skin, which resonates much better on Instagram than Item A's generic ad-style copy and standard product flatlay.
Gemini 4 CarbonGlossier’s real oneOpus’sGlossier’s real oneItem A uses a punchy, organic caption and a satisfying, tactile visual of the product's texture, whereas Item B reads and looks like a generic promotional sale ad that audiences typically scroll past.
Gemini 4 CarbonOpus’sGlossier’s real oneGlossier’s real oneItem B uses a satisfying, sensory texture shot and a punchy organic caption that resonates strongly with beauty enthusiasts, whereas Item A reads and looks like a standard promotional sale ad that audiences typically scroll past.
GPT-6.2 AstraGlossier’s real oneOpus’sGlossier’s real oneThe fingertip swatch makes the blush’s color and texture almost tangible at a glance, while B feels more like a sale ad.
GPT-6.2 AstraOpus’sGlossier’s real oneGlossier’s real oneThe close-up fingertip swatch makes “plush” feel tangible, and the fingerprint emoji playfully echoes the image in a way A’s sale copy doesn’t.
Claude Fable 5.2Gemini’sSol’sGemini’sA's warm, sunlit bathroom scene showing multiple open shades feels more lifestyle and tactile than B's flat studio shot, and its caption adds a concrete sale incentive that gives viewers more reason to engage.
Claude Fable 5.2Sol’sGemini’sGemini’sB's sunlit bathroom lifestyle shot with multiple open shades feels more native and tactile than A's flat studio product shot, and its caption adds a concrete sitewide discount and free gift offer that gives the audience a reason to engage.
GPT-6.2 AstraGemini’sOpus’sOpus’sB’s colorful lineup makes it fun to pick a favorite shade, and the on-image “Top-rated” cue gives scrollers a reason to pause before they even read the caption.
GPT-6.2 AstraOpus’sGemini’sOpus’sThe colorful spread of compacts invites viewers to pick a favorite shade at a glance, and the playful, easy-to-skim caption reinforces that invitation.
Gemini 4 CarbonSol’sOpus’sSol’sItem A uses a clean, editorial-style product shot and a minimalist caption that fits Glossier's signature organic Instagram aesthetic, whereas Item B reads and looks like a cluttered promotional ad.
Gemini 4 CarbonOpus’sSol’sSol’sItem B uses Glossier's signature minimalist, editorial aesthetic and punchy organic caption, whereas Item A reads and looks like a cluttered promotional ad with discount copy and text overlay that audiences typically scroll past.

Client-ready checks

Would you send it to the client?

Every AI piece was checked before judging. Two judges from other labs looked for any claim the brand’s facts don’t back, in the words or drawn into the image; a piece fails only when both find the same one and the quote is really there. When a model used the brand’s product photos, two judges checked the product was drawn as it really is. Code checked platform limits.

Share of each model’s 110 pieces that pass
CheckOpusSolGemini
Every claim backed by the brand’s facts99%100%100%
Product drawn as it really is98%97%98%
Text fits the platform (not cut off)51%74%39%

For comparison, the brands’ own pieces fit the platform 71% of the time. Em dashes per 100 words: Opus 0.00, Sol 0.16, Gemini 0.82; the brands 0.22. The one honesty failure: the image model printed 5.5 oz on a bag that really says 4 oz.

Reading the market

Can a model tell which piece will work?

Before choosing the judges, we tested them. Each model saw 106 real pairs of posts, ads, videos and pages, one of which won with real customers, and had to pick it in both orders. Only models that beat a simple rule got to judge.

ModelPicked the real winner, both ordersScore
Gemini 4 Carbonjudge69%60%–77%
Gemini 4 Neoncontestant69%59%–77%
Claude Fable 5.2judge64%55%–73%
GPT-6.2 Astrajudge64%56%–72%
Claude Opus 5.5contestant63%54%–73%
Rule: the shorter one winsrule61%52%–70%
Kimi K3.1 Pronot used59%50%–69%
GPT-6.2 Solcontestant57%48%–66%
Grok 4.7dropped50%41%–59%

Grok 4.7 scored like a coin flip, and Kimi K3.1 Pro didn’t beat the rule either. GPT-6.2 Sol makes the best social posts here but is the weakest of the three contestants at telling which real piece will win.

How we ran it

The method

  1. Real brands, recent work. 110 real pieces (38 Instagram posts, 16 Meta ads, 34 YouTube videos, 22 X posts) from 35 tech and direct-to-consumer brands, all published after July 1, 2026, after the models were trained.
  2. Same facts, own craft. Each model got the brand’s dated facts, homepage text, customer reviews, up to 3 of its real product photos, and the facts of what the piece was about. It never saw the real piece, its words, its image or its angle.
  3. One image model for everyone. Every model wrote its own image prompt, and GPT Image 2 rendered all of them, so this tests the marketer, not the image tool. Landing pages could use only the brand’s real photos.
  4. Judges from other labs. Claude Fable 5.2, GPT-6.2 Astra and Gemini 4 Carbon, chosen because they picked real winners better than a simple rule. A judge never rates its own lab’s model. Every pair is judged in both orders, and a tie is allowed.
  5. Ratings with error bars. Votes become Bradley-Terry ratings, with 95% ranges from resampling the jobs. Where the ranges overlap, we say tied.

The brands: Canva, ClickUp, Descript, ElevenLabs, Figma, Fly By Jing, Framer, Glossier, Grammarly, Granola, HubSpot, Huel, Kosas, Linear, Lovable, Miro, Notion, Our Place, Peloton, Perplexity, Raycast, Replit, Retool, Rhode, Ridge, Runway, Siete, Skims, Solo Stove, Supabase, Tower 28, True Classic, Vercel, WHOOP, Zapier. AI pieces shown here are test material, not made by or for these brands.

What this can’t tell you yet

  • Judges aren’t customers. The judges were tested against real results first, but a preference isn’t a sale. A live test with real budget is next.
  • Small numbers per channel. 16 Meta ads is few, so a single channel’s score is a rough read; the whiskers show how rough.
  • Paid reach can look like craft. Pairs where the winner’s likes per view were far below the loser’s were flagged as likely paid views.
  • Near-copies left out. For very short pieces, like a one-line question, the facts pin down the words, and a few AI versions came out almost identical to the real one. Those 20 votes are left out of the comparisons with the brand.
  • One brand’s screenshots name an AI model. Framer’s real product screenshots show a model picker, so 12 pieces were made from screenshots that name a model. The next version screens reference photos for that.

All numbers on this page: data.json.

Think you can pick better than the models?

Real pairs, real results. Ten rounds, about two minutes, no sign-up.