Research analysis and reporting

Give your team a clearer comparison of survey groups

Your next survey report could show which groups need a closer look, with the numbers behind each percentage in plain sight. A cross-tabulation puts answers from different groups side by side, so your team can discuss the findings with their limits in view.

01

Make every percentage easy to explain

For an insights team reporting on a programme, a useful comparison connects a finding to its supporting answers. Instead of presenting “80%” on its own, show that it means eight people out of ten who answered that question. Everyone can then see the scale of the evidence before discussing a change.

Agree the question, reporting period and groups first. Keep each person in one group for this comparison, and count their answer once. State whether a percentage uses everyone who returned the survey or only those who answered that question. This number is its denominator: the total you divide by.

02

Read the result alongside the people counted

Synthetic demonstration, not client findings: an invented programme team asks, “Was it easy to find the session information?” The options are Yes and No; people may skip the question. Each row below represents a different session group in the same reporting period. Every answer has equal weight.

Yes answers, divided by Yes plus No answers within each group
SessionYes / answeredYes %Skipped
Morning18 / 3060%10
Evening8 / 1080%2
Weekend0 / 0No answers3

The evening group has the higher share among those who answered. But changing just one of its ten answers from Yes to No would move 80% to 70%. That is a ten percentage point change. A small group can move sharply with one answer; the table alone cannot establish a reliable difference across all participants.

Skipped questions stay visible and do not count as No. For the morning group, dividing 18 by all 40 survey returns gives 45%. That answers a different question: the share of all returns containing Yes. Calling it “the share of people who answered this question” would be wrong. With no Yes or No answers in the weekend group, a percentage is undefined, not 0%.

03

Turn the comparison into useful follow-up

These invented records illustrate the calculation only. In a real voluntary survey, people who respond may differ from those who do not. A higher percentage does not show that the session caused a better experience. Missing answers may also change the picture. The AAPOR survey guidance covers how people are chosen to take part, missing responses and clear reporting.

Use the annotated cross-tab and synthetic source records to trace the counts and the no-answer case. Before sharing a real comparison, have your method reviewer check who was included, the missing answers and what conclusions the study supports. Ask your reviewer whether further calculations are needed to judge a group difference or describe how uncertain it is. This example includes no such calculations.

Datimore can help build a report that keeps each comparison, its answer counts and review notes together. Our community insight case shows information brought together for review; it does not prove this survey method. Bring one survey question, your group definitions and the intended use of the report. The aim is a discussion where the team can explain the finding and choose a sensible follow-up.

Continue with another article

Put the decision in a wider context.

Data analysis

Make business reviews clearer with the right analysis

Match the question to a useful method, explain what the result means and give the team a sensible next step.

Read article