Caffeine Checkout Suite · Experiments
A/B tests that measure revenue, not clicks
Every shopper is assigned to a variant by a deterministic hash, the same on the storefront and on the server, so a shopper sees the same variant everywhere, and an hourly check pauses a test whose split drifts. Results report revenue per visitor, conversion rate or average order value, with the statistics shown rather than a single winner badge.
New experiment
RunningWhere it shows
- Storefront tests run through the Experiments app embed in your theme
- Checkout block and post-purchase tests run inside those surfaces
What you can test
- Storefront CSS, feature flags and redirects
- Checkout block content
- Recommendations and Bundle Builder
- Bundle discount depth
- Post-purchase offers, assigned per order
Setup
- Two to six variants with one control and weights that add to 100
- Target new or returning visitors, desktop or mobile, markets and page types
- Schedule a start and an end
- A sample-size estimate for every test
Statistics
- Fixed-horizon tests: two-proportion z-test for conversion, Welch's t-test for revenue
- Sequential tests (mSPRT) that stay valid when you check early
- Probability to beat control alongside confidence intervals
- Sample-ratio mismatch checks hourly; a test with a broken split pauses itself
How it is measured
- Revenue per visitor, conversion rate or average order value as the primary metric
- Accept rate for post-purchase tests
- Results refreshed hourly and nightly
Good to know
- Checkout upsell tests are not available yet
- Storefront tests need the Experiments app embed in your theme
Also in the suite
Included on the same plan.
Checkout blocks
Trust, FAQ, review, shipping and message blocks for checkout, Thank you and Order status, with copy and images edited in the Caffeine portal.
Post-purchase offers
Offer one or two products between payment and the Thank you page. Accepting adds them to the order that was just placed, with no second checkout.
Upsells and recommendations
Add-on offers on product pages and in the cart drawer, plus a checkout upsell block, all driven by campaigns and product logic you set in the portal.
Bundle Builder
A theme block that turns a collection into a build-your-own bundle, with tiered percentage discounts applied by a Shopify discount Function.
Analytics
One attributed-revenue ledger behind every report: revenue overview, offer funnel, post-purchase, offer history, products and experiment results.
Request access
Put the suite on your checkout.
Caffeine Checkout Suite is in Shopify App Store review. Request access and we will set your store up with you as soon as it is approved.