Expert answer · 5 min read
Can I A/B test different discount amounts in emails?
The short answer
In depth
Can I A/B test different discount amounts in emails?
Yes, and email is one of the cleanest places to do it. Your list gives you a ready-made audience you can split randomly, and discount amount is a single, easy-to-isolate variable. Done properly, one good test answers a question that guesswork never will: how much margin are you paying for each extra order?
The setup that keeps the test honest
- One variable only. Same subject line, same products, same send time. Only the number changes: 10% versus 20%, not 10% off versus "$15 off plus free shipping".
- Random split. Assign subscribers to arms randomly, not by engagement or segment. Non-random groups make the result unreadable.
- Unique codes per arm. Each variant gets its own code so redemption tracking is clean and sharing between groups is visible.
- Enough volume and time. The standard worth following: roughly 100 conversions per variant and 1 to 2 weeks minimum, so weekly cycles and luck do not decide the winner. Small lists may need longer.
Always keep a no-discount holdout
Hold back a small random slice, around 10% of the list, that receives no discount email at all. This group is the only honest baseline. Without it, "20% off converted 4%" tells you nothing, because you do not know how many of those buyers would have purchased anyway. With a holdout, the difference between an arm and the holdout is your true incremental lift. When a vendor or a case study claims a big lift, the first question is always: compared to which holdout?
Pick test arms that can actually teach you something
Testing 10% against 12% wastes a month on a difference too small to measure. Choose arms far enough apart to move behavior. Growth Suite's walk-away customer data gives a useful sense of scale: offers in the 10 to 15% depth range converted hesitant visitors at 8 to 12%, while offers of 20%+ converted at 17 to 23%, nearly double. Discounts of 1 to 5% were the weakest in every store. A 10% versus 20% test sits right on that meaningful gap. For more on selecting the depth, see this guide on choosing the optimal discount rate.
Judge the winner on profit, not applause
Open rates measure curiosity, not money. Compare arms on:
- Revenue per recipient: total revenue divided by emails sent in that arm.
- Incremental orders: arm conversions minus holdout baseline conversions.
- Margin after discount: a 20% code that doubles orders can still lose to a 10% code once you subtract the discount cost on every order, including buyers who would have paid full price.
The winning variant is the one with the highest profit per recipient, and that is often not the biggest discount.
Protect your brand while you test
Frequent deep-discount tests train your list to wait for the next big number. Keep tests occasional, keep the deeper arm targeted rather than list-wide where possible, and remember that anyone who screenshots both versions will post them. Unique single-use codes per subscriber keep the test contained and stop coupon-site leaks from polluting your data.
How Growth Suite handles this
Growth Suite applies the same discipline on-site: personalized offers go to hesitant visitors, a holdout group sees nothing, and single-use codes expire on the server. The result is a clean read on what each discount depth actually adds, without training your whole audience to wait for sales.
Frequently asked questions
How big should each test arm be?
Big enough for about 100 orders per arm. With a 2% email conversion rate, that means roughly 5,000 recipients per variant. Smaller lists should test bigger gaps or run longer.
Can I test percentage against fixed-dollar amounts?
You can, but keep the perceived value comparable and know you are then testing two things at once: depth and framing. Start with depth first.
What if the bigger discount wins on revenue?
Check profit per recipient before celebrating. Revenue ignores the discount cost on orders that would have happened anyway.
How often can I run these tests?
A few times per quarter is plenty. Constant discount testing is itself a discount program, with the same training effect on your audience.
Should existing customers and new subscribers be mixed?
Ideally not. Their baselines differ, so split them and analyze separately if volume allows.
Growth Suite for Shopify
Put this answer to work in your store.
Growth Suite reads what each visitor is about to do and triggers the right offer at the right second — so the strategy above runs on its own.
14-day free trial · No credit card · Cancel anytime
Go deeper
Resources
Shopify Upselling & Cross-Selling
Most Shopify stores leave 10-30% of revenue on the table because they do not upsell or cross-sell effectively. This...
Shopify Conversion Rate: The Complete Resource Hub
Your conversion rate is the most important number in your Shopify store. Learn how to measure it, diagnose problems,...
Shopify Holiday & Seasonal Campaign Strategies
Every holiday has its own shopping psychology. Plan year-round campaigns with the right discount, right timing, and...
Shopify Countdown Timer
Adding a timer takes 5 minutes. Making it convert without destroying trust? That's strategy. The complete guide to...
Shopify Cart Abandonment
70% of Shopify carts are abandoned. Learn why customers leave, how to prevent abandonment in real-time, and recover...
Shopify Discount
Master Shopify discounts without sacrificing your profit margins. Learn strategic discount techniques, timing...