.st0{fill:#FFFFFF;}

Reason #4: Zero Focus on A/B Testing 

 November 29, 2022

By  HiFlyer

This ecommerce strategy article is an excerpt from our new book, The Ultimate Ecommerce Email & SMS Playbook. We’re diving into our ecommerce strategy chapter focused on the 7 Reasons Why Ecommerce Customers Leave Your Brand.


In the startup world, there’s a project management process called the Lean Methodology. In short, the Lean Methodology is a way of optimizing the people, resources, effort, and energy of your organization toward creating value for the customer. The way startups achieve that is through a cycle of build-measure-learn, a term coined by Eric Ries in his book, The Lean Startup.

I can speak for hours on the process, but here it is in a digestible format: the fastest growing brands in the world get their product out to market fast, measure results, get feedback from customers, and learn from the insights, thereby creating a better product or idea. They test, learn and refine. Note how this is yet another flywheel approach startups love, seeing a trend here in how brands scale fast? 

Most brands, when it comes to email and SMS, put limited to zero focus on learning or A/B testing. And, as you can see from above, if you’re not testing, you’re not learning. In some cases, if they actually do some A/B testing, the test isn’t very scientific or limited in scalability, which leads to empty conclusions. 

Case-in-point: A/B testing the subject line of a single Memorial Day campaign doesn’t exactly help you increase open rates for a Black Friday campaign. They are two different times of year, different promotions, different audiences, and different strategies. 

I have a great example of the power of testing. Our client, a multi-billion-dollar e-commerce brand, decided to start testing subject lines and template layouts to measure incrementality. Before we even analyzed the results, their brand saw a 30% lift in revenue simply because they implemented testing! 

After one campaign, the revenue lift alone justified the “risk” of testing (why brands think testing is a risk is beyond me) and led to further ideas, insights, and inspiration. The best part: the culture of the company shifted to a testing culture instead of merely an order-taking one.

If brands don’t test how best to communicate with their customers, they don’t learn and refine the dialogue. The result is an underperforming channel and indifferent subscribers; that’s why brands fail at email & SMS. 


Loved the article? Take one of these next steps:

Leave a Reply

Your email address will not be published. Required fields are marked

{"email":"Email address invalid","url":"Website address invalid","required":"Required field missing"}

Subscribe to our newsletter now!