Trace a Shopify test order from the survey answer to the report

A receipt and a friendly “Thanks” message prove the shopper reached the end of a survey. The next question comes from the person reading the report on Monday. Can they find that exact order, see the answers the shopper intended, and exclude the test from the customer count? Follow a single response through those handoffs before using a new poll to make a decision.

Write the expected result before placing the order

Make a small test log with the survey name, wording version, date and time zone, intended checkout page, order reference, expected answers and observed result. Give the run a short label in your own notes, such as “November attribution check B.” If the survey has an optional text field, you can enter that label as a harmless test response. Keep real names, personal email addresses and shipping details out of survey answers and shared screenshots.

Choose a branch with a predictable result. For example, ask “Where did you hear about us?” and choose “Podcast.” Under that choice, ask “Which show?” and enter “Test show B.” Write down that you expect one completed order with two answers. If your production survey only asks a single-choice question, use the order reference and time in the log to identify the run. Adding a special answer choice that real buyers can see would change the survey you are trying to check.

Match the receipt to the saved record

Use a suitable test store when possible. Shopify documents simulated payment options and explains that customers cannot place live orders while payment providers are in test mode. Choose a method appropriate to the store before touching payment settings. Shopify's test order instructions.

1. Complete a fresh order and capture the internal order reference available in the admin. Record the display number separately if you use it. Keep the full confirmation link private.
2. Answer the intended question on the Thank you page. Record the local time, question wording, choices selected and any follow-up you actually saw. Confirm the saved state.
3. Open Responses in OrderSurvey and match the order identifier, survey, date and placement. The list shows the first answer and a count of additional answers. For the podcast example, look for “Podcast” and one more answer. In a busy store, the newest row alone is a poor identifier.
4. If the survey also runs on Order status, revisit the order after submitting. Check whether the completed survey is offered again, then count saved submissions for the test order. The placement guide explains why a return visit is a different page.

Check the units in the export

On a plan with CSV export, select the survey and date range on the Responses page before exporting. In the downloaded file, filter the Order ID column to your test order. Examine the question and answer columns. In the podcast example, a file containing a row for “Podcast” and a row for “Test show B” contains two answered questions from one completed order. A pivot table that counts rows would double this order's contribution to the response total. If the file seems empty, first check the date range and time zone surrounding the test.

Preserve the original file. In the analysis copy, exclude the test order by its identifier, then verify that both example rows disappear while unrelated orders remain. Record this exclusion alongside your survey denominator rules. Testing before a report window opens can save cleanup later, but a dated exclusion list also handles mid-campaign QA.

A useful sign-off is short enough for the next operator to repeat. For example, “One eligible test order, two expected answers, two matched answer rows, one excluded order.” To run the dashboard check on your store, install OrderSurvey from the Shopify App Store. The listing identifies which plan includes the extra CSV check.

Frequently asked questions