Measuring learning through cross sectional testing
Main Article Content
Abstract
The measurement of student learning is becoming increasingly important in U.S. higher education. One way to measure learning is through longitudinal testing, but this becomes especially difficult when applied to cumulative learning within programs in situations of low persistence. In particular, many Hispanic Serving Institutions (HSIs) find themselves in such situations. Cross sectional testing is a pragmatic alternative, so long as maturity and selection effects can be estimated. The purpose of this paper is to demonstrate the utility and mechanics of measuring learning through cross sectional testing.
Downloads
Article Details
- Authors retain copyright and grant the Journal of the Scholarship of Teaching and Learning (JoSoTL) right of first publication with the work simultaneously licensed under a Creative Commons Attribution License, (CC-BY) 4.0 International, allowing others to share the work with proper acknowledgement and citation of the work's authorship and initial publication in the Journal of the Scholarship of Teaching and Learning.
- Authors are able to enter separate, additional contractual agreements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in the Journal of the Scholarship of Teaching and Learning.
- In pursuit of manuscripts of the highest quality, multiple opportunities for mentoring, and greater reach and citation of JoSoTL publications, JoSoTL encourages authors to share their drafts to seek feedback from relevant communities unless the manuscript is already under review or in the publication queue after being accepted. In other words, to be eligible for publication in JoSoTL, manuscripts should not be shared publicly (e.g., online), while under review (after being initially submitted, or after being revised and resubmitted for reconsideration), or upon notice of acceptance and before publication. Once published, authors are strongly encouraged to share the published version widely, with an acknowledgement of its initial publication in the Journal of the Scholarship of Teaching and Learning.
References
AACSB. (2012). www.aacsb.edu/accreditation/business/standards/aol/learning_goals. Retrieved June 4, 2012.
ACT, Inc. (2010). National collegiate retention and persistence to degree rates. Iowa City, IA.
Adams, G.R., & Schvaneveldt, J.D. (1985). Understanding Research Methods. White Plains, NY: Longman.
Allen, J., Robbins, S., Casillas, A., & Oh, I. (2008). Third-year college retention and transfer: Effects of academic performance, motivation, and social connectedness. Research in Higher Education, 49, 647-664.
Alon, S., Domina, T., & Tienda, M. (2010). Stymied mobility or temporal lull? The puzzle of lagging Hispanics college degree attainment. Social Forces, 88(4), 1807-1832.
Archibald, R.B., & Feldman, D.H. (2008). Graduation rates and accountability: Regressions versus production frontiers. Research in Higher Education, 49, 80-100.
Burke, J.C. (2002). Funding Public Colleges for Performance. New York: Rockefeller Institute Press.
Caison, A.L. (2007). Analysis of institutionally specific retention research: A comparison between survey and institutional database methods. Research in Higher Education, 48, 435-451.
Clauss, J., & Geedey, K. (2010). Knowledge surveys: Students ability to self-assess. Journal of the Scholarship of Teaching and Learning, 10(2), 14-24.
Dellwo, D.R. (2010). Course assessment using multi-stage pre/post testing and the components of normalized change. Journal of the Scholarship of Teaching and Learning, 10(1), 55-67.
Gansemer-Topf, A., & Schuh, J. (2006). Institutional selectivity and institutional expenditures: Examining organizational factors that contribute to retention and graduation. Research in Higher Education, 47, 613-642.
Harackiewicz, J.M., Barron, K.E., Tauer, J.A., & Elliot, A.J. (2002). Predicting success in college: A longitudinal study of achievement goals and ability measures as predictors of interest and performance from freshman year through graduation. Journal of Educational Psychology, 94, 562-575.
Kraiger, K. (2002). Decision-based evaluation. In K. Kraiger (Ed.) Creating, Implementing, and Managing Effective Training and Development: State-of-the-Art Lessons for Practice (pp. 331376). San Francisco: Jossey-Bass.
Kraiger, K., Ford, J., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning to new methods of training evaluation. Journal of Applied Psychology, 78, 311-328.
Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121-1134.
Martell, K., & Calderon, T. (2005). Assessment in business schools: What it is, where we are, and where we need to go now. In K. Martell and T. Calderon (Eds.) Assessment of Student Learning in Business Schools: Best Practices Each Step of the Way (pp. 1-26). Tallahassee: Association for Institutional Research.
Mundhenk, R. (2005). Assessment in the context of accreditation. In K. Martell and T. Calderon (Eds.) Assessment of Student Learning in Business Schools: Best Practices Each Step of the Way (pp. 27-42). Tallahassee: Association for Institutional Research.
Pace, D. (2011). Assessment in history: The case for “decoding” the discipline. Journal of the Scholarship of Teaching and Learning, 11(3), 107-119.
Pascarella, E.T., & Terenzini, P.T. (2005). How College Affects Students: A Third Decade of Research. San Francisco: Jossey-Bass.
Robbins, S., Lauver, K., Le, H., Davis, D., Langley, R., & Carlstrom, A. (2004). Do psychosocial and study skill factors predict college outcomes? A meta-analysis. Psychological Bulletin, 130, 261-288.
Rubin, R., & Martell, K. (2009). Assessment and accreditation in business schools. In S. Armstrong and C. Fukami (Eds.) The SAGE Handbook of Management Learning, Education and Development (pp. 364-384). Los Angeles: Sage.
Seifert, T.A., Pascarella, E.T., Erkel, S.I., & Goodman, K.M. (2010). The importance of longitudinal pretest-posttest designs in estimating college impact. New Directions for Institutional Research, Assessment Supplement, Winter, 5-16.
Sitzmann, T., Ely, K., Brown, K., & Bauer, K. (2010). Self-assessment of knowledge: A cognitive learning or affective measure? Academy of Management Learning and Education, 9(2), 169-191.
Thompson, K. (2004). A conversation with Milton Blood: The new AACSB standards. Academy of Management Learning and Education, 3, 429-439.
Tinto, V. (1975). Dropout from higher education: A theoretical synthesis of recent research. Review of Educational Research, 45, 89-125.
Tinto, V. (1993). Leaving College: Rethinking the Causes and Cures of Student Attrition (2nd ed.). Chicago: University of Chicago Press.
United States Census Bureau. (2010). Educational attainment in the United States: 2010 Detailed Tables. Retrieved April 29, 2012 from https://www.census.gov/hhes/socdemo/education/data/cps/2010/tables.html
United States Department of Education. (2011). Moving America forward: President Obama’s agenda for the Latino community, pp. 1-5. Retrieved April 29, 2012 from http://www.2.ed.gov/about/inits/list/hispanic-initiative/obama-agenda.pdf.
United States Department of Labor. (2011). The Hispanic labor force. Retrieved April 29, 2012 from http://www.dol.gov/_sec/media/reports/hispanicelaborforce.pdf.
Vockell, E. L., & Asher, J. W. (1995). Educational Research (2nded.). Englewood Cliffs, NJ: Prentice Hall.
Willingham, W.W., Lewis, C., Morgan, R., & Ramist, L. (1990). Predicting College Grades: An Analysis of Institutional Trends over Two Decades. Princeton, NJ: Educational Testing Service.