Identify biased survey questions

Detailed Explanation: Identify biased survey questions

A survey question is biased when its wording or answer choices push people toward a particular response. A difficult or controversial topic is not automatically biased; the bias comes from how the question is asked.

Use these steps:

1. Look for emotionally charged words, such as wasteful, terrible, or wonderful.
2. Check whether the question assumes something is already true.
3. Notice phrases that pressure agreement, such as “Don’t you agree?”
4. Check whether the answer choices are balanced.

Example

A school asks:

“Don’t you agree that our school should finally stop wasting money on unhealthy cafeteria food?”
Yes / No

Step 1: Look at the wording.

The phrase “Don’t you agree?” encourages students to say Yes. The words “wasting money” and “unhealthy” are emotionally charged and present opinions as if they were facts.

Step 2: Check for an assumption.

The question assumes that the cafeteria food is unhealthy and that the school is wasting money. Students are not given a neutral way to consider those claims.

Step 3: Check the answer choices.

The choices are only Yes and No. There is no choice such as “Not sure,” and the question is already pushing students toward Yes.

Step 4: Explain the effect on the data.

This question is biased because its wording may cause more students to choose Yes than they would if the question were neutral. The results might make it seem that more students support changing the cafeteria, weakening the school’s conclusion about what the whole student population really thinks.

A more balanced version would be:

“What is your opinion about changing the school cafeteria menu?”
Strongly support / Somewhat support / Neither support nor oppose / Somewhat oppose / Strongly oppose

This version asks about the same general topic without telling students what to think.