<info>

Summer School on survey design and quality

Understanding survey quality

Venue:

Lausanne, Switzerland

Date:

13 - 20 August 2010

Organisers:

Dominique Joye, University of Lausanne, Switzerland

Peter Mohler, University of Mannheim, Germany

Lars Lyberg, Statistics Sweden & University of Stockholm

Peter Lynn, University of Essex, UK

Summary:

This course provided an introduction to survey quality and the survey production process, looking at the lifecycle of a survey. It covered the challenges to quality that are encountered when developing surveys designed to provide multi-national, multi-cultural or multi-lingual comparisons. It covered all aspects of the design and planning of surveys, including sample design, question development and testing, quality in data collection, controlling for measurement error and non-response error, data processing, weighting, and imputation, as well as analysis, documentation and publication. Wherever possible practical exercises were provided.

References:

Harkness J.A., Braun, M, Edwards, B., Johnson, T., Lyberg, L., Mohler, P. Ph., Pennell, B.-E., Johnson, T., Smith, T.W., (editors) (2010). Survey Methods in Multinational, Multicultural and Multiregional Context, Hoboken, New Jersey, John Wiley and Sons.

Harkness, J., Van de Vijver, F.J.R. and Mohler, P.Ph. (eds.) (2003), Cross-Cultural Survey Methods, Wiley Series in Survey Methodology. Hoboken, New Jersey: John Wiley and Sons.

de Leuuw, E., Hox, J., and Dillman, D. (eds.) International Handbook of Survey Methodology, Hyattsville, VA: Erlbaum.

Biemer, P. P. and Lyberg, L. E. (2003), Introduction to Survey Quality, Hoboken, NJ: John Wiley & Sons.

PROGRAMME

Day 1: Friday 13 August
14.00	Welcome and introduction to QMSS2 Dominique Joye
14.30	Introduction to participants and instructors Dominique Joye
15.00	What is survey quality? Lars Lyberg Historical review of surveys and concepts of quality Continuous quality improvement: quality assurance and quality control	Presentation The evolution of survey quality
16.00	What is survey quality? (Cont'd) Recent developments; frameworks; standards Risk assessment for surveys Tools for quality improvement
Day 2: Saturday 14 August
09.00	Recap previous day Lars Lyberg
09.30	The survey production process 1 Lars Lyberg The survey lifecycle The total survey error framework
11.15	The survey production process 2 Lars Lyberg Governance issues; constraints, limitations and opportunities Survey practice
14.00	The survey production process 3 Lars Lyberg The role of new technologies
16.00	The survey production process 4 Lars Lyberg Indicators and measures of quality
Day 3: Sunday 15 August
	Excursion (organised by Dominique Joye)
Day 4: Monday 16 August
09.00	Question time
09.30	3M (Multilingual, multinational & Multicultural) surveys 1 Janet Harkness & Peter Mohler Quality in comparative surveys: the challenge
11.15	3M (Multilingual, multinational & Multicultural) surveys 2 Janet Harkness & Peter Mohler Approaches to quality comparative surveys
14.00	3M (Multilingual, multinational & Multicultural) surveys 3 Janet Harkness & Peter Mohler Localisation, standardization harmonization
16.00	3M (Multilingual, multinational & Multicultural) surveys 4 Janet Harkness & Peter Mohler Comparative design: context, culture and language
Day 5: Tuesday 17 August
09.00	Question time
09.30	Design and planning 1 Lars Lyberg Users of surveys Types of surveys
11.15	Design and planning 2 Lars Lyberg Conceptualisation and organisational structure
14.00	Design and planning 3 Guest teacher Half day course on question development, testing and pre-testing
16.00	Course (Cont'd)
Day 6: Wednesday 18 August
09.00	Question time
09.30	Design and planning 4 Peter Lynn Sample design	Presentation Sample design
11.15	Design and planning 5 Peter Lynn Sample design (Cont'd)
14.00	Design and planning 5 Guest teacher Quality in data collection
16.00	Design and planning 5 Quality in data collection (Cont'd)
Day 7: Thursday 19 August
	Design and planning 6 & 7 Control of measurement error Control of non-response error Data processing: coding, weighting, imputation, derived variables, estimation Analysis, documentation and presentation	Presentation Non-response
Day 8: Friday 20 August
09.00	Assessing quality 1 Peter Mohler & Janet Harkness Asking the right questions - and understanding the answers
11.15	Quality assurance and quality monitoring 2 Peter Mohler & Janet Harkness Documenting and reporting survey quality
13.00	Participants' presentations 1
15.00	Participants' presentations 2
16.30	Outlook
17.00	Close

Quantitative Methods in theSocial Sciences 2

Summer School on survey design and quality

Quantitative Methods in the
Social Sciences 2