Test-retest reliability analysis

A few thoughts on conducting test-retest reliability analysis on questionnaires, based on my own recent experiences;
– DO pay attention to your coding sheet before doing the test, it will influence your questionnaire design
– DO make sure you pilot your questionnaire for ambiguity and understanding before doing the test, it may not be essential but it is logical
– DO capture the data yourself, it will give you insight and a deeper appreciation of the process
– DO make sure you have a way to uniquely identify each questionnaire, and simple codes are better than complex ones
– DO make sure you ask participants to uniquely identify each form they complete, but make sure to preserve anonymity

– DO NOT rely on handwriting recognition to achieve the last point if you forgot to do it, it will waste your time and take you into a valley of despair
– DO NOT rush the process, you will make mistakes if you do

By Michael Rowe

I'm a lecturer in the Department of Physiotherapy at the University of the Western Cape in Cape Town, South Africa. I'm interested in technology, education and healthcare and look for places where these things meet.