OrderSurvey
← All articles

Agentic Commerce

Did an AI Shopping Assistant Help? A Shopify Survey You Can Copy

A customer discovers your brand on a podcast, asks ChatGPT which of your three tents works best in the rain, and buys the one it suggests. If your thank-you page asks only “How did you hear about us?” the honest answer is “podcast.” Your product team would probably like to hear about that tent conversation, too.

A short post-purchase poll lets a Shopify merchant hear about that middle step. A good first question depends on what you plan to change. The team buying podcast ads needs a different answer from the team writing tent specifications.

Find out which shopping job the assistant handled

Keep the store’s usual attribution poll intact while you study what happened between discovery and checkout. A returning customer who already owns one of your tents can still use an assistant to choose a different model. Include that buyer if the decision concerns product guidance. A first-order and repeat-order poll can separate trial from replenishment when the reasons differ. If you need to measure first discovery instead, use the guide to discovery survey answer options.

For a product decision, ask “Did you use an AI assistant while choosing what to buy today?” Offer “Yes,” “No,” and “I’m not sure.” Follow a yes with one question: “What was the main thing it helped you do?” Try these choices:

  • Find a product I hadn't heard of
  • Compare products I was considering
  • Check a detail about a product
  • Understand shipping, returns, or store policies
  • Something else

Single choice is appropriate because the wording asks for the main task. If you want every task, change both the question and the answer format. One buyer may have discovered a product, compared alternatives and checked shipping in the same conversation.

Give a buyer an easy way out

Make the poll optional and let a no finish the survey. On a phone, “Which assistant did you use, and what did you ask it?” looks like homework seconds after paying. If the product team needs language for a specific comparison, run a separate product comparison poll during its next research window.

Show the question on a thank-you page you have tested. Shopify documents different purchase paths for AI channels, including purchases that finish in the merchant's online store and purchases that finish within a channel. Your survey audience consists of the buyers who reach its placement. Shopify's guide to agentic storefronts

Read a week of answers like a merchant

Imagine 80 tent buyers answer the first question. Twenty say they used an assistant, 55 say no and five are unsure. Of the 20 who said yes, 15 answer the follow-up. Nine choose comparison, four check a detail and two select discovery. Report “9 of 15 follow-up respondents used it mainly for comparison.” Keep “20 of 80 reported AI use” as a separate finding.

That tent team has a specific next move. Put packed weight, interior dimensions and seasonal rating side by side on the product pages, then ask shoppers choosing between the same tents which detail took the longest to find. The poll identified a job buyers are doing. The next poll can tell you whether the new comparison actually answers their question.

To run the two-question version, add the initial poll and a conditional follow-up for “Yes,” then place the block on the intended page. Get OrderSurvey on the Shopify App Store.

Frequently asked questions

Should I add every AI assistant to my attribution poll?

Start with one recognizable AI assistant option. Ask for the tool name only when that information will change a decision.

Which buyers should see the AI shopping survey?

Use first-time buyers for brand discovery research. Include returning buyers when you want to understand help with product selection, and analyze the groups separately.

Run your first post-purchase survey

Ask how customers found you or collect feedback on Shopify's Thank you and Order status pages. One $24 USD/month plan includes unlimited use and every feature. After installing, add the survey block to each page in Shopify's editor.

Install OrderSurvey

Want help getting started? Book a 20-minute setup call.