Checkout Probe Help

Quick start

1. Open Checkout Probe from Apps in your Shopify admin.
2. If your store has no usable address and no test address is saved, the app shows "Add a test address to run the test". In "Test settings", pick a country, click "Fill a sample address" or type an address, and click "Save settings".
3. Click "Run checkout test". The report lists what would stop an agent, with a fix for each finding.
4. After you change a setting in your store, click "Run checkout test" again to check the result. Every run is kept in "Test history".

How the test works

When you click "Run checkout test", the app opens a checkout on your own store the way an AI shopping agent would. It fills in a test buyer and a shipping address, reads what the checkout returns, and then cancels the checkout.

• Test buyer: the reserved address agent-checkout-test@example.com, with the names "Agent" and "Checkout Test". It is not a real person.
• Shipping address: your store's own address, or the test address you save in "Test settings".
• The test never completes a checkout, never places an order, never charges anything, and never changes your store settings.

Reading the report

The "What would stop an agent" section lists each problem the test found. Each finding is marked "Will stop agents" or "May stop agents". The test looks for:

• Checkout rules that ask the buyer for input, for example an age check.
• Shop Pay not offered at checkout.
• No delivery option offered at checkout.
• Shipping rates that are set up in your store but not offered at checkout.

Each finding has a fix ("How to fix") and a link to the matching settings page in your Shopify admin.

"How the test ran" shows each call the test made to your store, in order, with what came back and how long it took, ending with the cancelled test checkout. Click "Replay" to watch the steps again.

"Test history" lists your recent tests with the product, the ship-to address, and the result. Click a date to open that report; "Show latest test" takes you back to the newest one.

What the test cannot see

The "Not checked by this test" section of the report lists what the test cannot see, so you know what to review yourself:

• Checkout rules that run only when the order is placed.
• Checkout apps that ask the buyer for input, such as checkboxes, date pickers, or age gates.
• Shipping rates from carriers and apps: they get their names at checkout, so the test cannot tell if one is missing.

Test settings

• Test product: click "Choose product" to pick the product the test checks out with. By default the test uses the first product that can be bought.
• Test shipping address: leave it empty to use your store address, or enter the address the test should ship to. Use your business address or another address you choose, not a customer's address.
• Country: pick the country first. "Fill a sample address" fills in a public place in that country, such as a station or museum. The list shows the countries your store ships to; if a country has no sample yet, enter an address yourself.
• Click "Save settings" to keep your changes, or "Use defaults" to go back to the default product and your store address.

Test setups, daily tests and alerts (Complete plan)

• Click "Upgrade to Complete plan" in the app, or "Pricing" in the footer, to choose the plan on Shopify's pricing page. "Manage plan" changes or cancels it.
• Test setups: "Add test setup" saves up to 5 products and shipping addresses. "Run checkout test" then opens and cancels one test checkout per setup, and "Setups in this test" links each report.
• Daily test: with "Run the test every day" on, every setup is tested once a day without opening the app. The next time shows under the switch, and Test history marks those runs "Daily".
• Alerts: with "Show an alert when a result changes" on, a daily test whose result differs from that setup's previous test (a new problem, a fixed one, or a test that could not run) shows "Your daily test found a change" at the top of the app until you dismiss it.
• Back on the Free plan, your setups stay saved but only the first one runs; the others show as "Paused".

Data and privacy

• Read-only access: the app only reads your products, shipping settings, and markets.
• The app keeps your test setups, the daily test schedule, and the last 50 test reports for your store. It holds no customer data: the test buyer is fictional.
• The app contains no third-party analytics or tracking.
• Uninstalling the app deletes your settings and test reports.
• Full details: see the Datenschutzerklärung.

Pricing and languages

The Free plan tests one product and address, as often as you like. The Complete plan ($9.99 every 30 days, no trial) adds up to 5 test setups, a daily test and in-app alerts. Billing goes through Shopify. The app is available in English.

Support

Email sean.gemify@gmail.com. Include your store URL and, if a test did not run, the message the app showed.