The Dependability of the Updated NSSE: A Generalizability Study

Abstract

This study utilized generalizability theory to assess the context where the National Survey of Student Engagement’s (NSSE) summary measures, the Engagement Indicators, produce dependable group-level means. The dependability of NSSE group means is an important topic for the higher education assessment community given its wide utilization and usage in institutional assessment and accreditation. We found that the Engagement Indicators produced dependable group means for an institution derived from samples as small as 25 to 50 students. Furthermore, we discuss how the assessment community should use NSSE data.Using survey data from 156 bachelor's-granting institutions, this study explored the relationship between academic advising services and seniors' grades and self-perceived gains. We found advising experiences has a positive relationship with students' grades and self-perceived gains. In addition, our results indicate that the institutional advising climate is positively correlated with perceived gains, but not grades. The results also showed that the relationships between advising and students' learning and development varied across institutions. Implications for policy and practice were discussed.