Shopify announced on October 28, 2026 that Sidekick can suggest some storefront changes, build them in an unpublished theme and compare that theme with the live storefront using simulated shoppers. Shopify explicitly says this is not a live A/B test with real customers. For a brand, the useful next step is to treat the result as a hypothesis to review, not proof of a revenue lift.
What the test actually covers
Shopify's Help Center says Sidekick Pulse displays recommendations on the admin Home page. For certain theme suggestions, Sidekick prepares an unpublished copy of the live theme and SimGym compares the two in simulated shopping sessions. A “Tested by Sidekick” label appears when that copy has a higher simulated add-to-cart rate. Shopify tests only eligible desktop-visible changes intended to help shoppers add products to cart. A suggestion without that label may still be reviewable.
The feature is available to some stores with recent sales activity. The owner or an admin staff member needs Shopify Network Intelligence enabled; theme tests also require a live theme compatible with Canvas. Viewing a draft does not change the live storefront. Customers see the change only if the merchant publishes the draft theme.
How to evaluate a suggested theme
Ask what changed, which products and devices are affected, and whether the edit fits the brand's merchandising rules. Preview the unpublished storefront across key templates. Check mobile even though Shopify says the simulation tests desktop changes. If you edit the suggested draft, Shopify says the original simulated result no longer describes that revised draft.
Before publishing, document the hypothesis and a real measurement plan using the store's own analytics. Watch add-to-cart, conversion, average order value and return behavior after release; a simulated add-to-cart improvement does not establish a lift in orders or profit. This is Etail Rocket's operating analysis, not a Shopify performance claim.
A controlled release sequence
- Check whether the store has an eligible Pulse recommendation and inspect the draft in Canvas.
- Review product accuracy, brand presentation, accessibility and mobile behavior.
- Record any edits made after the simulation and avoid attributing the original test result to them.
- Publish only with an owner and a plan to monitor real customer outcomes.
For an independent review of your storefront growth plan, talk with Etail Rocket.