Developing, Translating, and Pretesting Questionnaires for Cross-cultural Surveys

About

This course introduces you to cross-cultural research and, notably to what it means to produce comparable multilingual questionnaires that ensure data quality and comparability, and ultimately valid conclusions in research.
On day 1, you will be introduced to the types, aims, and basic concepts of cross-cultural research, and particularly to the concepts of “equivalence” and “bias.” Furthermore, we will delve into questionnaire design in cross-cultural contexts. Time will be devoted to methods of evaluating and pretesting questionnaire items, such as cognitive interviewing and web probing, to ensure that items indeed measure what they are supposed to measure and are comparable across languages.
On day 2, you will learn how the quality of survey questions can be estimated. You will be introduced to a tool (specifically, the Survey Quality Predictor [SQP]) that will allow you to predict the quality of your own survey items and that you can use for translation checks when dealing with different language versions of the same item. You will be trained in a very hands-on manner how you can implement the tool in your own research project
On day 3, you will learn about the crucial step of questionnaire translation, including best practices for translation and assessment methods that are typically discussed in this context. Furthermore, you will learn about aspects to consider in questionnaire translation and potential error sources. The course will conclude with a wrap-up session, bringing all aspects together.
On each day, you will gain hands-on experience on some of the methods and tools presented to get an idea of challenges or subtleties inherent in cross-cultural research – and you will have the opportunity to marvel about and discuss cultural and linguistic (dis)similarities!

Course leader

Dorothee Behr, Patricia Hadler and Lydia Repke, GESIS - Leibniz Institute for the Social Sciences

Target group

You will find the course useful if:
- you are involved in cross-cultural data collection or cross-cultural survey projects,
- you need to develop, translate, and/or pretest your own (translated) questionnaires for cross-cultural surveys,
- you are interested in analyzing cross-cultural research data and want to understand how sound (or not so sound) cross-cultural questionnaire design and translation procedures can impact survey data quality and comparability

Course aim

By the end of the course, you will:
- be aware of the challenges involved in cross-cultural measurement and strategies to mitigate or overcome these,
- be able to set up sound procedures for developing, translating, and/or pretesting questionnaires,
- be able to evaluate the comparability and quality of items used in cross-cultural surveys

Fee info

The rates include the tuition fee and the course materials.