Michael Rowe

Trying to get better at getting better

Test-retest reliability analysis

A few thoughts on conducting test-retest reliability analysis on questionnaires, based on my own recent experiences.

DO:

  • pay attention to your coding sheet before doing the test, it will influence your questionnaire design
  • make sure you pilot your questionnaire for ambiguity and understanding before doing the test, it may not be essential but it is logical
  • capture the data yourself, it will give you insight and a deeper appreciation of the process
  • make sure you have a way to uniquely identify each questionnaire, and simple codes are better than complex ones
  • make sure you ask participants to uniquely identify each form they complete, but make sure to preserve anonymity

DO NOT:

  • rely on handwriting recognition to achieve the last point if you forgot to do it, it will waste your time and take you into a valley of despair
  • rush the process, you will make mistakes if you do

Share this


Discover more from Michael Rowe

Subscribe to get the latest posts to your email.