The Two Safeguards to Stopping an AB Test
I feel like I can spend only spend a few paragraphs and a graph motivating why waiting for statistical significance is important in AB testing. Here is a test we ran for an ecommerce client: The goal we are measuring here is successful checkouts (visitors reaching the receipt page). The orange variation is beating the blue […]
Ecommerce Goals for Optimizely or VWO: What goals should you use in AB tests?
I see a lot of clients use just these goals on ecommerce AB tests in Optimizely or VWO (Visual Website Optimizer): Engagement (included by default by Optimizely) Revenue Checkouts That’s a good start (Except engagement, have you ever made an actionable decision based on the engagement goal?). But you could get a lot more information […]
eCommerce Copywriting Case Study: 3 Advanced Tactics We Used to Increase Product Page Conversion Rates 13.9%
We partnered with copywriter Brian Speronello of Accelerated Conversions on this project. This case study was written by Brian and edited by Devesh and Brian. Writing powerful eCommerce copy that improves conversion rates is one of the most effective ways to generate more revenue for your online business. Just by changing the words your visitors read […]
Should you AB test large site redesigns, and if so how?
An issue that’s come up with more than one client for us recently is when a large site redesign is “in the pipeline” and people in the company disagree about whether or not they should test the large redesigns or feature release. The arguments for not testing large site redesigns is usually some flavor of the […]
The ROI of AB Testing: When is AB testing worth it?
I have a simple 2-step criteria for determining if AB testing has a high enough ROI to be seriously considered for your marketing team: Criteria #1: Your business makes $2,000,000 or more in revenue Criteria #2: You get 100,000 monthly unique visitors or more to your site Yes, like any numerical “cutoff”, these numbers are […]