Using write-in responses to improve survey measures

Abstract

Conscientious quantitative researchers are always looking to fine-tune their survey instruments to best capture the responses of populations. In order to continue this work and update their instrument, the staff at a large-scale multi-institution survey undertook a study of write-in responses collected from instructional staff in the 2013-2016 administrations. These responses were analyzed to determine whether they could have fit into an existing response option, would require editing the item, or signaled confusion among respondents. Once these distinctions were drawn, researchers made decisions about whether and how to change response options to more fully represent the population's needs.