The 2025 Email A/B Testing Playbook That Revived a $200M Retailers “Dead” Email List!
Think your email list is tapped out? So did this $200M retailer.
This 9-figure retailer was pulling in $47 million a year from email, SMS, and retention.
On paper, everything looked solid.
But behind the scenes?
Performance was plateauing, engagement was fading, and their once-powerful email list felt like it had nothing left to give.
Sound familiar?
Here’s the truth:
Your email list isn’t dead – the relationship you had with your customers is what’s REALLY dead.
And once you start seeing that plateau—you have two options:
Keep running the same dusty old playbook and hope Q3 pulls you out.
Or break the damn thing and rebuild it around what actually works.
We did the latter.
We didn’t throw more campaigns at it.
We didn’t redesign the emails to be more “gorgeous”.
We didn’t hire expensive copywriters who just use ChatGPT anyway.
We didn’t pour budget into paid.
We tested. Ruthlessly.
Why focus on testing? Simple:
If you don’t test, you don’t learn. If you don’t learn, you don’t refine. If you don’t refine, you don’t grow.
And in just one quarter—Q2—
And in Q2 alone, that strategy revived their retention program and unlocked an extra $26 million in revenue—without sending more, spending more, or adding a single new product.
Now, I’m going to show you exactly how we did it—because this isn’t just about one brand.
If you’re an ecommerce business sitting on a list that “used to work,” this is your turning point too.
What got your brand to $1M/year won;’t get you to $10M or $100M unless you embrace a culture of testing. And it starts with this mindset:
You have opinions.I have opinions.Data is the tiebreaker.
A/B testing gives you that data and you’ll start sailing once you implement the learnings fromit. Like the case study I’m about the share with you.
Here’s how we helped a 9-figure retailer go from $47M to $73M with one bold pivot:
A/B testing everything.
Act I: The Playbook That Needed to Die
The brand had a routine:
Every 1st of the month = ONE DAY SALE.
617,000 “engaged” subscribers blasted with a standard email.
$109K in revenue. On the surface? Great.
But look deeper:
No segmentation
No personalization
No testing
Massive ESP costs for email volume
No clue why things worked (or didn’t)
This was not a scalable system.
It was a band-aid.
So we scrapped it and started testing—aggressively.
Act II: The Q2 Pivot That Changed Everything
We didn’t just dip a toe into testing.
We built a testing machine.
Step 1: Segmentation
We broke their 617K “engaged” list into high-intent micro segments:
Apple fans
Sony loyalists
Canon buyers
Active browsers
1x buyers with high AOV
After deduping and filtering based on behavior, we ended up with 288,000 real opportunities.
Less volume. More precision.
Step 2: Personalization
Then we rebuilt the email experience:
If you were an Apple buyer, you got Apple everything—subject line, header, products, CTA, landing page.
Sony folks got Sony.
Canon folks got Canon.
Every segment got their own experience.
From subject line to URL, every click screamed, “we see you.”
Step 3: Execution
We hit send.
Result?
From 288K emails → $190K in revenue.
That’s 70% more revenue from 50% fewer emails.
And it kept compounding.
We applied the same segmentation + personalization + A/B testing formula for the next 6 months.
And that same retailer scaled to $73 million/year from email, SMS, and retention alone.
But none of that would’ve happened if we hadn’t committed to one thing:
A Culture of A/B Testing.
Act III: Testing is the New Retention Strategy
Here’s what changed everything:
We made testing the core culture of their retention team.
Because when you stop guessing and start testing, you get:
✅ Higher open and click rates
✅ Lower ESP costs
✅ Real-time customer insights
✅ A/B test learnings that fuel every channel
✅ And… you make way more money
But most brands don’t test.
Why? Because they don’t know what to test, how to test, or why to test.
So let me give you what works.
Act IV: My Top 11 A/B Tests That Drive Real Revenue
These are the exact tests we’ve used to unlock massive wins for top retailers and DTC brands. You can grab my free 2025 Email A/B Testing Playbook here. Each one is designed to increase either open rate, click rate, or conversion rate—the three stats that matter most.
🧪 1. Subject Line Testing
Test subject lines across evergreen campaigns (Deals, New Drops)
KPI: Open Rate, Click-to-Open Rate
Testing Plan: 5 subject lines (1 BAU, 4 variants)
Rollout: 4–8 campaigns, 20% test pool → Winner to remainder
🧪 2. Send Time Optimization
Algorithmic send time vs. business-as-usual timing
KPI: Open Rate, Click Rate, Conversion Rate
Testing Plan: 50/50 split (BAU vs. optimized)
Rollout: 8 campaigns minimum
🧪 3. Postcard vs. PDP-Based Emails
Visual postcard layout vs. classic product grid
KPI: Click Rate, Conversion Rate
Testing Plan: DOTD Postcard vs. Standard PDP
Rollout: 10/10 test over 8 campaigns (clickers only)
🧪 4. Reveal vs. No Reveal
Do you tease the offer or show it upfront?
KPI: Click Rate, Conversion Rate
Testing Plan: 50% see offer, 50% must click to reveal
Rollout: 50/50 split (clickers and openers)
🧪 5. Countdown Timer / Kinetic Content
Add urgency with motion-based countdowns
KPI: Click Rate, Conversion Rate
Testing Plan: BAU vs. Email with timer
Rollout: 50/50 split (clickers + openers)
🧪 6. Featured Products Count
Test product volume for ideal engagement
KPI: Click Rate, Conversion Rate
Testing Plan: 4 vs. 8 vs. 12 products
Rollout: 5-way split, clickers only
🧪 7. Curated vs. Dynamic Products
Manual product selection vs. AI-powered recommendations
KPI: Click Rate, Conversion Rate
Testing Plan: 4 campaigns, 50/50 split
Rollout: Clickers and openers
🧪 8. Dynamic vs. Static Content
Subscriber-specific content vs. fixed assets
KPI: Click Rate, Conversion Rate
Testing Plan: Dynamic (rewards, personalized offers) vs. static
Rollout: 50% of list, 25/25 split
🧪 9. Content Length
How much is too much?
KPI: Click Rate, Time on Site, Conversion
Testing Plan: 3 vs. 6 vs. 12 content blocks
Rollout: 5-way split, 20% test audience
🧪 10. Blended Content
Articles vs. Videos vs. Both
KPI: Click Rate, Time on Site
Testing Plan: Articles-only vs. Videos-only vs. Blended
Rollout: 3-way split, clickers only
🧪 11. Email + SMS Incrementality
Which channel drives the real lift?
KPI: Click Rate, Conversion Rate
Testing Plan:
Segment 1: Email only
Segment 2: SMS only
Segment 3: Email + SMS crossover
Rollout: Same offer across 3 audiences, 4–8 iterations
Bonus: More Testing Ideas We Love
CTA wording: % OFF vs. $ OFF
Ratings & reviews in creative
Nav bar vs. no nav
Financing amounts in subject lines
In-store pickup vs. local delivery
Dynamic banners based on behavior
Your Turn to Pivot
If your Q1 was flat…
If you’re tired of high send costs and low returns…
If you’re still running “blasts” and crossing your fingers…
Here’s your next move:
👉🏻 Steal My Top 10 A/B Testing Playbook
👉🏻 Watch the Case Study: $26M Unlocked in 1 Quarter
Because what got you to $47M…
Won’t get you to $73M.
But testing will.
Let’s go.
— Isaac
Founder, HiFlyer Digital
Loved this blog post? Take one of these next steps:
Next Steps: Book a Free Email, SMS and Retention Audit.
Get access to over $12,000 worth of email, SMS and retention content when you book a free audit with our strategists.