The Role of Using Formative Assessments in Problem-based Learning: A Health Sciences Education Perspective

Main Article Content

Kristi W. Kelley
Julaine M. Fowlin
Andrew A. Tawfik
Max C. Anderson

Abstract

Practitioners in the field of pharmacy are often confronted with ill-structured problems. Specifically, pharmacists are tasked with making patient-specific recommendations that are both safe and effective, which requires combining knowledge from the biomedical, behavioral, and pharmaceutical sciences. Given the dynamic nature of pharmacy as a profession, the field has begun to explore learning strategies that go beyond mere content coverage to strategies that better support higher-order learning outcomes. One of these approaches is problem-based learning (PBL). While studies have focused on how to support PBL to improve learning outcomes, the role of assessment is often overlooked. Further exploration is thus needed since assessment plays a pivotal role in teaching and learning. This Voices paper will explore this idea within a larger context; we will also share the experience of how a subject matter expert (SME) worked with a team of instructional designers (IDs) to revise an existing course to more explicitly employ PBL and thus adopt an inquiry-based mindset needed for complex clinical decision making. Given the inherent challenges of assessment in PBL, further discussion will be focused on how to (a) design ill-structured problems, (b) align assessments to the PBL curriculum, and (c) how to hold students accountable in cases where a traditional grade is not attached.

Article Details

Section
Voices from the Field

References

Accreditation Council for Pharmacy Education. (2018). PharmD program accreditation. Retrieved from https://www.acpe-accredit.org/pharmd-program-accreditation/

Azer, S. A., McLean, M., Onishi, H., Tagawa, M., & Scherp- bier, A. (2013). Cracks in problem-based learning: What is your action plan? Medical Teacher, 35(10), 806–814.

Bate, E., Hommes, J., Duvivier, R., & Taylor, D. M. (2014). Problem-based learning (PBL): Getting the most out of your students - their roles and responsibilities: AMEE guide no. 84. Medical Teacher, 36(1),1–12.

Berkhout, J. J., Helmich, E., Teunissen, P. W., van der Vleuten, C. P. M., & Jaarsma, A. D .C. (2018). Context matters when striving to promote active and lifelong learning in medical education. Medical Education, 52, 34–44.

Chan, C. K. Y. (2016). Facilitators’ perspectives of the factors that affect the effectiveness of problem-based learning process. Innovations in Education and Teaching International, 53(1), 25–34.

deChambeau, A., & Ramlo, S. (2017). STEM high school teachers’ views of implementing PBL: An investigation using anecdote circles. Interdisciplinary Journal of Problem-based Learning, 11(1), 7.

Ertmer, P., & Simons, K. (2006). Jumping the PBL implementation hurdle: supporting the efforts of K–12 teachers. Interdisciplinary Journal of Problem-based Learning, 1(1).

Gabelica, C., Van den Bossche, P., De Maeyer, S., Segers, M., & Gijselaers, W. (2014). The effect of team feedback and guided reflexivity on team performance change. Learning and Instruction, 34, 86–96.

Ge, X., Law, V., & Huang, K. (2016). Detangling the interrelationships between self-regulation and ill-structured problem solving in problem-based learning. Interdisciplinary Journal of Problem-based Learning, 10(2), 11.

Graesser, A., Foltz, P. W., Rosen, Y., Shaffer, D., Forsyth, C., & Germany, M.-L. (2018). Challenges of Assessing Collaborative Problem Solving. In E. Care, P. Griffin, & M. Wilson (Eds.), Assessment and Teaching of 21st Century Skills: Research and Applications (pp. 75–91). Heidelberg, Germany: Springer.

Grob, R., Holmeier, M., & Labudde, P. (2017). Formative assessment to support students’ competences in inquiry- based science education. Interdisciplinary Journal of Problem-based Learning, 11(2), 6.

Hartling, L., Spooner, C., Tjosvold, L., & Oswald, A. (2010). Problem-based learning in pre-clinical medical education: 22 years of outcome research. Medical Teacher, 32(1), 28–35.

Henry, H., Tawfik, A. A., Jonassen, D. H., Winholtz, R., & Khanna, S. (2012). “I know this is supposed to be more like the real world, but . . .”: Student perceptions of a PBL implementation in an undergraduate materials science course. Interdisciplinary Journal of Problem-based Learning, 6(1). https://doi.org/10.7771/1541-5015.1312

Hmelo-Silver, C., & Barrows, H. (2006). Goals and strategies of a problem-based learning facilitator. Interdisciplinary Journal of Problem-based Learning, 1(1). https://doi.org/10.7771/1541-5015.1004

Hmelo-Silver, C., & DeSimone, C. (2013). Problem-based learning: an instructional model of collaborative learning. In C. Hmelo-Silver, C. A. Chinn, C. Chan, & A. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 370–385). Routledge.

Jonassen, D. H. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology Research and Development, 45(1), 65–94.

Ju, H., & Choi, I. (2017). The Role of Argumentation in Hypothetico-Deductive Reasoning During Problem- Based Learning in Medical Education: A Conceptual Framework. Interdisciplinary Journal of Problem-based Learning, 12(1), 4.

Kim, N. J., Belland, B. R., & Walker, A. E. (2017). Effectiveness of Computer-Based Scaffolding in the Context of Problem-Based Learning for Stem Education: Bayesian Meta-analysis. Educational Psychology Review, 1–33.

Liaison Committee on Medical Education. (2018). Functions and structure of a medical school. Retrieved from http://lcme.org/publications/

Lucieer, S. M., van der Geest, J. N., Eloi-Santos, S. M., Del- bone de Faria, R. M., Jonker, L., Visscher, C., ... Themmen, A. P. N. (2016). The development of self-regulated learning during the pre-clinical stage of medical school: A comparison between a lecture-based and a problem-based curriculum. Advances in Health Sciences Education, 21, 93–104.

New Tech Network. (2016, August 8) The learning organization framework. Retrieved from https://newtechnetwork.org/resources/learning-organization-framework/

Rovers, F. E., Clarebout, G., Savelberg, H. H. C. M., & van Merrienboer, J. J. G. (2018). Improving student expectations of learning in a problem-based environment. Computers in Human Behavior, 87, 416–423.

Salinitri, F. D., Wilhelm, S. M., & Crabtree, B. L. (2015). Facilitating Facilitators: Enhancing PBL through a Structured Facilitator Development Program. Interdisciplinary Journal of Problem-based Learning, 9(1), 11.

Schinske, J., & Tanner, K. (2014). Teaching more by grading less (or differently). CBE-Life Sciences Education, 13(2), 159–166.

Schmidt, H. G., Rotgans, J. I., & Yew, E. H. J. (2011). The process of problem-based learning: What works and why. Medical Education, 45, 792-806.

Strohfeldt, K., & Khutoryanskaya, O. (2015). Using problem-based learning in a chemistry practical class for pharmacy students and engaging them with feedback. American Journal of Pharmaceutical Education, 79(9), 1–11.

Tamim, S., & Grant, M. (2013). Definitions and uses: Case study of teachers implementing project-based learning. Interdisciplinary Journal of Problem-based Learning, 7(2). https://doi.org/10.7771/1541-5015.1323

van Aalst, J. (2013). Assessment in collaborative learning. In C. Hmelo-Silver, C. A. Chinn, C. Chan, & A. O’Donnell (Eds.), The International Handbook of Collaborative Learning (pp. 280–296). Routledge.

Walling, A., Istas, K., Bonaminio, G. A., Paolo, A. M., Fon- tes, J. D., Davis, N., & Berardo, B. A. (2017). Medical student perspectives of active learning: A focus group study. Teaching and Learning in Medicine, 29(2), 173–180.

Watson, S. L., Koehler, A. A., Ertmer, P., Kim, W., & Rico, R. (2018). An Expert Instructor’s Use of Social Congruence, Cognitive Congruence, and Expertise in an Online Case-Based Instructional Design Course. Interdisciplinary Journal of Problem-based Learning, 12(1), 3.

Wijnen, M., Loyens, S. M. M., Smeets, G., Kroeze, M., & van der Molen, H. (2017). Comparing problem-based learning students to students in a lecture-based curriculum: learning strategies and the relation with self-study time. European Journal of Psychology of Education, 32(3), 431–447.

Wijnen, M., Loyens, S., Smeets, G., Kroeze, M., & Van der Mollen, H. (2017). Students’ and teachers’ experiences with the implementation of problem-based learning at a university law school. Interdisciplinary Journal of Problem- based Learning, 11(2), 5.

Wilder, S. (2015). Impact of problem-based learning on academic achievement in high school: a systematic review. Educational Review, 67(4), 414–435.