Testing Store Changes With Shopify SimGym's AI Shoppers
SimGym, the AI shopper simulator Shopify previewed in its Winter '26 Edition, opened to all eligible merchants on March 11 with no waitlist. On March 26, Shopify added the option to analyze a single theme on its own. It's a useful way to spot friction before customers do, but it doesn't replace testing with real traffic.
Published Mar 27, 2026. Author: Ecomm Guys. 4 min read.
Key Points
- SimGym is available to all eligible merchants as an AI Research Preview, with no waitlist.
- It uses AI shoppers with human-like profiles to simulate how buyers use your store.
- You can compare an unpublished theme with your live theme, or analyze one theme on its own.
- Reports cover navigation, product discovery, add-to-cart friction, and directional indicators.
- Use it to find problems early, then confirm changes with real customer tests.
What SimGym Is
Shopify introduced SimGym in December as part of the Winter '26 Edition, describing it as a flight simulator for your store. It builds AI shopper personas from aggregated shopping patterns across Shopify and runs them through your storefront, so you can get early signals on a change before real customers see it.
On March 11, Shopify made it available to all eligible merchants with no waitlist. It's still labelled an AI Research Preview, and you install the SimGym app from the Shopify App Store to use it.
Two Ways to Use It
The first is a comparison. You choose an unpublished theme from your theme library and run a simulation against your current theme. SimGym reports on navigation and product discovery, the add-to-cart flow and friction points, and gives directional performance indicators. It then recommends which theme performs better.
The second, added on March 26, is a deep analysis of one theme. You choose any live or draft theme and can focus on areas such as the homepage, product pages, collection pages, or cart. Shopify says each analysis gives findings specific to your store, with what's working, where there's room to improve, and next steps.
Where It Helps
SimGym is most useful before a launch. A redesign, a new theme, or a reworked product page usually goes live with only internal review. Running it past a set of AI shoppers first can surface problems your team stopped seeing long ago. Think of a filter that's hard to find, a size selector that confuses, or a cart that hides the shipping cost.
It also helps smaller stores. A store with modest traffic can wait weeks for an A/B test to reach a clear result. Shopify pitched SimGym as giving smaller businesses insights they couldn't get otherwise, and for early direction that's fair.
Where to Be Careful
AI shoppers aren't your customers. They're built from aggregated patterns, not your audience's habits, and Shopify describes the indicators as directional. A simulation can tell you a checkout step is confusing. It can't tell you how much revenue a change will make for your store.
That's why we treat SimGym results as a list of things to check. If SimGym says a new theme performs better, we still launch it as a test where we can. Otherwise we roll it out and compare conversion, average order value, and add-to-cart rate against the old theme over a few weeks.
How We'd Fit It Into a CRO Process
This is the process we'd use. It keeps SimGym in the role it suits best, as an early warning.
- Run a single-theme analysis on your live theme to build a list of friction points.
- Fix the clear issues, such as unclear labels or hidden costs, without waiting for a test.
- For bigger changes, compare a draft theme with your live theme in SimGym first.
- Confirm the result with real traffic before you call it a win.
- Repeat after each major change, since the analysis is quick to run.
Run Your First Analysis
Install SimGym and run a single-theme analysis on your product and cart pages. Compare its findings with what you already know from analytics and customer feedback. Where they agree, fix it. Where SimGym finds something new, test it.
Want help building a testing plan for your Shopify store? Book a call with our team.
Sources
- Shopify SimGym is now available in AI Research Preview for all eligible merchants Shopify Changelog, March 2026
- Run a deep analysis on your online store theme with SimGym Shopify Changelog, March 2026
- Renaissance for the modern era: Winter '26 Edition reimagines what's possible Shopify, December 2025