The Finch Formerly Known As Gold

4 January 2007

The center doesn't hold

You've seen the Likert scale before: you're given a list of statements, and you're supposed to:

  • Strongly disagree.
  • Disagree.
  • Neither agree nor disagree.
  • Agree.
  • Strongly agree.

The scale itself isn't biased, but how it's displayed can be:

Our bias for the left-hand side of space could be distorting large-scale surveys. Past research has shown that when people are asked to bisect a horizontal line down the centre, most will cross the line too far to the left. This leftward bias is thought to stem from the right hemisphere — it plays a dominant role in allocating our attention and is also responsible for processing the left-hand side of space. It may also be related to a cultural tendency to read from left to right. Now Andrea Loftus and colleagues have reported this spatial bias could be distorting survey results.

The researchers presented two groups of students with the same questionnaire statements about their experience at university (e.g. "My course has been enjoyable"), except that one group answered using a 5-item Likert scale that ranged left-to-right, from "definitely disagree" to "definitely agree", whereas the other group answered using a scale that ranged left-to-right across the page, from "definitely agree" to "definitely disagree". The positive questionnaire statements were the same as those used by the Higher Education Funding Council for England (HEFCE) in its survey of 250,000 students.

In the current study, the students' natural bias for the left meant those answering using the Likert scale that started on the left with "definitely agree", responded with that answer to 27 per cent more statements than did the other group of students — that is, their views came out as more positive. By contrast, those students who answered using the scale that began on the left with "definitely disagree" responded more often with "mostly disagree", meaning their views came out overall as more negative.

The most expedient solution, it would seem, would be to prepare all surveys of this type with half the forms with "Strongly agree" on the left and half with "Strongly disagree" on the left. Still undetermined: whether this bias persists to the same extent with extended Likert scales, with seven or nine choices. Also still undetermined: whether my beginning the description of the scale with "Strongly disagree" instead of "Strongly agree" reflects my bias.

(Via Zack Wendling.)

Posted at 7:48 AM to Almost Yogurt

If you're anything like me, Chaz, you strongly disagree with most things.

Posted by: Kirk Leggott at 3:12 PM on 4 January 2007

I disagree with that, though not strongly.

Posted by: CGHill at 6:42 PM on 4 January 2007

Darling, do you forgive me for forgetting our anniversary? Please check one of the following:

[ ]Yes [ ]Yes [ ]Yes [ ]Yes [ ]No

(Aim left ...)

Posted by: robohara at 2:48 PM on 5 January 2007