A/B testing offers
Compare two versions of an offer, read the results, pick the winner.
Starting a test
- Open a live offer (not a fixed bundle) and press A/B test, or press A/B in the Offers list.
- MixMaxer duplicates it as “<name> (B)”, a draft in the same group. Change exactly one thing in B: the discount level, the tiers, the title or the layout.
- Publish B. From now on visitors are split in half.
How the split works
- The storefront assigns each visitor to A or B at random on the first view and remembers it in the browser, so a visitor always sees the same variant.
- The choice is written to the cart, and the discount Function applies only the variant the visitor saw. POS, draft orders and visitors without a cart bucket get A.
- Both variants rank as one offer in the priority order.
- If one variant is paused, the other one shows to everyone; the split resumes when both are live.
Reading the results
Analytics › Experiments lists impressions, add-to-carts, orders, conversion and revenue per variant. A leader is marked after 20 impressions per variant; treat it as a hint until each side has a few hundred impressions. Pick A or Pick B keeps the winner live for everyone and pauses the loser; End without a winner detaches the two offers.
Common problems
Pick B is refused.
B must be published (Active) before it can win. Publish it or pick A.
One variant has far fewer impressions.
Normal in the first hours; visitors are assigned on their first product view, not per page load. Very uneven numbers over days mean one variant is hidden (paused, expired) or the product page caches per variant.
Can I test three variants?
No; two at a time. Run a second test against the winner afterwards.
More in Analytics & reports
- How analytics are calculated
- CSV export and the weekly performance email
- Post-purchase upsell: setup, approval, behaviour
← All articles · Next: CSV export and the weekly performance email · Still stuck? Contact support