OrderSurvey
← All articles

Attribution

Did Free Shipping Change What Your Shopify Customers Bought?

A shopper spends $52 at a store that offers free shipping at $50. They might have added a $6 bar of soap to qualify. They might also have come for a $52 gift set. The order total looks the same. To learn which happened, ask “Did the free shipping offer change what you put in your cart today?” Then compare answers from orders just below and just above the threshold.

Give buyers who paid for shipping a way to answer

Use one optional, single-choice question after purchase. These four answers give you different decisions to make:

Answer choice What to investigate
I added something to qualify. Which item did the buyer add? One optional follow-up can tell you whether a cart suggestion helped.
I already had enough in my cart. How many orders qualified on their own? These buyers would be easy to misclassify from order value alone.
I saw the offer and kept my cart below the minimum. What made paying for shipping the better choice?
I didn’t notice the offer, or I’m not sure. Check where shoppers can see the offer before choosing their items.

Show the question to returning buyers as well as first-time customers if both can use the offer. Publish the block on the Thank you page and, if you want buyers to answer when they revisit their order, on the Order status page. A setup walkthrough covers the two placements.

Pick comparable orders before you count the answers

Choose one offer, date range, shipping destination group and currency. Write down how the offer actually worked that week. For a Shopify free shipping discount with a minimum purchase, qualifying product prices reflect any combinable product discounts. Taxes do not count. A $52 basket with a $5 qualifying product discount can therefore fall below a $50 minimum. If you used a shipping rate or a third-party app, check that rule separately. Shopify’s free shipping discount documentation

For a $50 offer, you might start with two bands of qualifying merchandise value: $45 to under $50, and $50 to under $55. Choose the bands before reading answers. Exclude local pickup and digital-only purchases, and set aside orders where you cannot establish which offer applied. A $0 shipping charge alone cannot identify the offer.

Export the period’s orders from Shopify. Its CSV includes the order ID, subtotal, shipping charge and shipping method. Additional items from one order can occupy extra rows. Group those lines into one order first. In OrderSurvey, export responses for the same question and period, import both ID columns as text, and match Order ID to Shopify’s Id. Keep orders with no answer in the worksheet. Shopify order export fields · OrderSurvey CSV instructions

Read two numbers from the same worksheet

In this illustrative week, 12 eligible orders fell just above $50. Eight buyers answered the question. Three said they added an item, four already qualified, and one was unsure. Report both figures:

  • 3 of 8 respondents said they added something to qualify.
  • 8 of 12 eligible orders had an answer. The other four buyers’ reasons are unknown.

Suppose another eight orders fell just below $50. Four buyers answered, and three said they saw the offer and kept their cart below the minimum. Read their optional explanations before adjusting the threshold. “I only needed one bottle” and “I couldn’t find anything near $5” suggest different changes. The second answer gives you a specific idea to test: make an appropriate small item easier to find.

A post-purchase survey reaches people who bought. To decide whether a threshold change pays for itself, compare completion and contribution after shipping costs in a controlled test that also includes people who leave. Use the survey answers to choose what to test.

Install OrderSurvey to ask the question. Free includes 100 responses per rolling 30 days across the store. Unlimited is $24 USD per month and includes CSV export for the order match. See plans.

Frequently asked questions

Should I ask only customers who received free shipping?

Include buyers on either side of the threshold who could use the same offer. Someone who chose to pay for shipping can tell you why adding another item was unappealing.

Can this survey tell me how many shoppers abandoned checkout because of shipping?

Only buyers who completed their purchase can answer on the Thank you or Order status page. Use checkout funnel data to investigate abandonment.

Run your first post-purchase survey

Ask how customers found you or collect feedback on Shopify's Thank you and Order status pages. One $24 USD/month plan includes unlimited use and every feature. After installing, add the survey block to each page in Shopify's editor.

Install OrderSurvey

Want help getting started? Book a 20-minute setup call.