Translation of Agreement Answer Scales: Effects on Category Response Curves

• Activity Number: 284
• Type: Contributed
• Date/Time: Tuesday, August 4, 2009 : 8:30 AM to 10:20 AM
• Sponsor: Section on Survey Research Methods
• Author(s): Ana Villar and Mario Callegaro*+
• Companies: Knowledge Networks and University of Nebraska Lincoln
• Keywords: Answer Scales ; Translation ; Adaptation ; Item Response Theory ; Response styles ; Cross-cultural research

Abstract

The use of agreement answer scales in survey instruments is widely accepted, but little is known about how to word the labels that are presented to respondents. In multilingual research, this matter is further complicated because answer scales must be translated. Using ISSP data from 2002, we compare results from more than 30 countries that used one type of answer scales: a close translation of the original (strongly agree, agree, neither/nor, disagree, strongly disagree) or an adaptation of it (strongly agree, somewhat agree, and so on). Using Graded Response Models we show that changes response category labels commonly found in multilingual research affect how respondents use answer scales and the usefulness of each of the 5 scale points to measure the underlying construct. These results are discussed in relation to existing literature on response styles differences across cultures.