Analytics & Reporting
How to Categorize Other Survey Answers in a Spreadsheet
7 min read · Updated
To categorize open-ended survey responses, keep the original text, define a small set of categories, apply the same rules to every answer, and leave unclear answers unresolved. Then count the orders that answered your chosen question. This turns a list of comments into a report you can check and repeat.
For a Shopify discovery survey, the immediate question is often: what are buyers putting in Other? They may name a creator, a podcast, ChatGPT, or a source your answer list missed. The workflow below uses OrderSurvey's Responses export and a spreadsheet. It is a manual analysis process, not an automatic classification feature.
Start with one question and a defined reporting period
Choose one survey and one question, such as “Where did you first hear about us?” Write down the reporting dates, intended audience and exact question wording. Keep discovery answers separate from answers about what persuaded someone to buy today.
In OrderSurvey, open Responses, select the survey and date filter, then choose Export CSV. If your reporting window differs from the available date filters, export a wider period and filter the Date column in your spreadsheet. Export dates use UTC; choose a reporting time zone and apply it consistently.
The Responses CSV contains Date, Order ID, Question, Answer, Other Text, Location, Tags and Customer Tag Status. It has one row per answered question. It does not include order revenue or an automatic channel classification.
Keep an untouched copy of the export. In your working copy:
- Filter to the discovery question. If two questions have identical wording, resolve which rows belong to the intended question before counting them.
- Read Answer alongside Other Text. If you used a separate conditional text question, its answer appears on another row. Use the same order ID and response date within the selected survey to find that detail; flag ambiguous matches for review.
- Keep order IDs as text. Resolve repeated IDs before counting answering orders. Do not combine all blank IDs into one order; report those rows separately if you cannot identify them reliably.
- Add your analysis columns beside the original data. Do not overwrite what a customer wrote.
Watch the product walkthrough and inspect its illustrative export to see why one order can produce several question rows.
Write a short category guide before counting
A category guide defines what each label includes and what it excludes. Start by reading a small batch of answers, then write rules another person could apply without knowing your marketing strategy.
For a discovery report, useful working columns are:
| Analysis column | Purpose |
|---|---|
| Category | A broad source, such as AI assistant, podcast or word of mouth |
| Named source | The tool, publication or creator actually mentioned |
| Review status | Clear, ambiguous, no detail, or does not answer the question |
| Coding note | Why you chose the category, especially for an unusual answer |
| Rule version | The dated category guide used for this batch |
These are columns you add yourself. They are separate from the export's Tags and Customer Tag Status fields. Editing a spreadsheet category does not apply a tag to a Shopify customer.
Use a conservative rule: classify what the answer says, not what you hope it means. “Instagram” identifies a platform; it does not tell you whether the buyer saw an ad, a creator's post or a friend's message. “A reel” does not even identify the platform.
If an answer names several sources without saying which came first, use a Multiple sources; order unclear category for this single-source report. Keep the detail. Do not silently pick the channel with the largest advertising budget.
Worked example: twelve Other answers
Every answer below is invented to demonstrate the method. These are not OrderSurvey customer results.
| Original detail | Category | Named source or review note |
|---|---|---|
| Chat GPT recommended you | AI assistant | ChatGPT; normalize the spelling only in the analysis column |
| chatgpt | AI assistant | ChatGPT |
| Claude | AI assistant | Claude |
| My neighbor told me | Word of mouth | Neighbor |
| My brother | Word of mouth | Brother |
| Saw a reel | Social video; source unclear | Platform and paid/organic status unknown |
| An Instagram ad | Paid social | Instagram; the answer explicitly says ad |
| Weekend Kitchens podcast | Podcast | Weekend Kitchens; fictional show name |
| YouTube video | Online video | YouTube; creator and paid/organic status unknown |
| Not sure | Cannot recall | Keep separate from a missing detail |
| [empty field] | No detail supplied | Buyer selected Other but supplied no detail |
| Good packaging | Does not answer discovery question | Do not turn this into a marketing source |
This yields three AI-assistant answers, two word-of-mouth answers, four other identifiable or partly identifiable source answers, and three answers without usable discovery detail. Retain those last three in the report; removing them would make the identified sources look more common.
For larger batches, have a second person review the ambiguous answers and a sample of the clear ones. Discuss disagreements, clarify the rule, and apply the revised rule to earlier rows that it affects. Do not let the same phrase mean one thing this week and something else next week.
Build the summary without changing the denominator
After resolving duplicates, make a table with one row per answering order for the discovery question. Keep a separate record of excluded or unresolved rows and why they were excluded. This is a count of answering orders, not unique people or all store customers.
In Google Sheets, select that table, choose Insert → Pivot table, add Category under Rows, and count Order ID under Values. Use COUNTA only after your input table has one row per nonblank order ID. Google's pivot-table instructions explain the source-range and field controls. When adding a new batch, check that the pivot's range includes it.
Keep these two questions distinct:
| Illustrative calculation | What it describes |
|---|---|
| 3 AI mentions ÷ 12 Other answers = 25% | The share of the Other-answer group naming AI |
| 3 AI mentions ÷ 48 total discovery-answer orders = 6.25% | The share of all answering orders represented by those three mentions |
The second example assumes there were 48 distinct answering orders in the period. If other answer options also contain AI mentions, include those before reporting a total AI-mentioned share. Neither calculation establishes the share of all orders acquired by AI, and neither measures incremental sales.
Include the reporting dates, audience, question wording, rule version, unknown count and denominator beside the summary. If you need order values, that is a separate join; follow the survey-to-channel-report guide.
Use the findings to improve one decision
Repeated Other answers can reveal a missing option, a creator worth asking about, or wording customers find unclear. Choose one next action: review a named source, add an optional follow-up, or clarify an answer choice. A few mentions are a reason to investigate, not proof that a channel deserves a larger budget.
If you add a new option, record the date and start a new comparison period. Asking customers to recall a source in their own words is different from showing it in a list. Pew Research Center's question-design guidance explains why wording, answer choices and question context matter when measuring change over time.
Use the survey change-log guide to save the old configuration, document the new one and compare periods without confusing a questionnaire change with a marketing result.
The answer-options guide helps choose the next list. If a new option reveals a conditional follow-up, use the branch-testing checklist before publishing it.
Choose the plan for the reporting job
OrderSurvey Free includes 100 responses per rolling 30 days, with conditional follow-ups and first/repeat-order targeting. Unlimited is $24 USD/month and adds unlimited responses, CSV export and webhook alerts. The manual spreadsheet categorization described here is work you do with the exported file; OrderSurvey does not automatically perform it for you.
Install OrderSurvey to start collecting answers, or book personal setup help to choose a useful question and verify your Thank you and Order status blocks. Keep the first survey short enough that you can read and act on what comes back.
Frequently asked questions
Does OrderSurvey automatically categorize free-text answers?
No. This guide describes a manual spreadsheet workflow using the Responses CSV, which is included in Unlimited at $24 USD/month. Keep the original answers and add your analysis categories in separate columns.
Should I count every exported row as a different customer?
No. The Responses CSV has a row for each answered question. Filter to one survey and discovery question, then resolve duplicate order IDs before counting answering orders. An order is not necessarily a unique customer.
When should an Other answer become a new survey option?
Consider a separate option when the source recurs and distinguishing it would change a real decision. Record the change date and keep earlier results separate, because explicitly naming a source can change how customers answer.
Run your first post-purchase survey
Ask how customers found you or collect feedback on Shopify's Thank you and Order status pages. One $24 USD/month plan includes unlimited use and every feature. After installing, add the survey block to each page in Shopify's editor.
Install OrderSurveyWant help getting started? Book a 20-minute setup call.