Improving Problem-based Learning in Creative Communities Through Effective Group Evaluation
Main Article Content
Abstract
In this case study, we researched one cohort from the Center for Animation, a higher education teaching environment that has successfully fostered group creativity and learning outcomes through problem-based learning. Through live and videotaped observations of the interactions of this community over 18 months, in addition to focused interviews with nine key community leaders, we considered the evaluative culture and actions of this community, and how these evaluative practices improved their creative problem solving. We describe their evaluation practices in the context of principles derived from the Joint Committees’ Evaluation Standards (Yarbrough, Shulha, Hopson, & Caruthers, 2011), which are well-respected standards used by professional evaluators. Specifically, we found that problem-based learning strategies were successful in part because the community members (1) established a context and culture of high expectations, collaboration, and evaluation; (2) united the students, teachers, and industry leaders as shared stakeholders in the success of the project; (3) identified early the key criteria for evaluating progress; and (4) asked questions to evaluate progress towards meeting the criteria, using many approaches to gathering information. We discuss the implications for applying these principles to other problem-based learning environments, particularly in higher education, as well as future research.
Article Details
1. Publication and Promotion: In consideration of the Publisher’s agreement to publish the Work, Author hereby grants and assigns to Publisher the non-exclusive right to print, publish, reproduce, or distribute the Work throughout the world in all means of expression by any method now known or hereafter developed, including electronic format, and to market or sell the Work orany part of it as Publisher sees fit. Author further grants Publisher the right to use Author’s name in association with the Work inpublished form and in advertising and promotional materials
2. Copyright: Copyright of the Work remains in Author’s name.
3. Prior Publication and Attribution: Author agrees not to publish the Work in print form prior to publication of the Work by the Publisher. Author agrees to cite, by author, title, and publisher, the original Interdisciplinary Journal of Problem-based Learning publication when publishing the Work elsewhere
4. Author Representations: The Author represents and warrants that the Work:
(a) is the Author’s original Work and that Author has full power to enter into this Agreement;
(b) does not infringe the copyright or property of another;
(c) contains no material which is obscene, libelous, defamatory or previously published, in whole or in part.
Author shall indemnify and hold Publisher harmless against loss of expenses arising from breach of any such warranties.
5. Licensing and Reuse: Reuse of the published Work will be governed by a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0; http://creativecommons.org/licenses/ by-nc/4.0/). This license lets others remix, tweak, and build upon the Work non-commercially; although new works must acknowledge the original Interdisciplinary Journal of Problem-based Learning publication and be non-commercial, they do not have to be licensed on the same terms.
References
Artino, A. R. (2008). A brief analysis of research on problem-based learning. Eric Document: ED501593. Barrows, H. S., & Tamblyn, R. (1980). Problem-based learning: An approach to medical education. New York: Springer.
Belland, B. R., French, B. F., & Ertmer, P. A. (2009). Validity and problem-based learning research: A review of instruments used to assess intended learning outcomes. Interdisciplinary Journal of Problem-based Learning, 3(1), 59–89. http://dx.doi.org/10.7771/1541-5015.1059
Belski, I. (2009). Teaching thinking and problem solving at university: A course on TRIZ. Creativity and Innovation Management, 18(2), 101–108. http://dx.doi.org/10.1111/j.1467-8691.2009.00518.x
Bielaczyc, K., & Collins, A. (2006). Fostering knowledge-creating communities. In A. M. O’Donnell, C. E. Hmelo-Silver, & G. Erkens (Eds.), Collaborative learning, reasoning, and technology (pp. 37–60). Mahwah, NJ: Lawrence Erlbaum Associates.
Brandt, C. B., Cennamo, K., Douglas, S., Vernon, M., McGrath, M., & Reimer, Y. (2013). A theoretical framework for the studio as a learning environment. International Journal of Technology and Design Education, 23(2), 329–348. http://dx.doi.org/10.1007/s10798-011-9181-5
Bridges, M. E., & Hallinger, P. (1995). Implementing problem-based learning in leadership. Eugene, OR: ERIC Clearinghouse on Educational Management.
Cheung, M. (2011). Creativity in advertising design education: An experimental study. Instructional Science, 39(6), 843–864. http://dx.doi.org/10.1007/s11251-010-9157-y
Engeström, Y. (1999). Innovative learning in work teams: Analyzing cycles of knowledge creation in practice. In Y. Engeström, R. Miettinen, & R.-L. Punamaki (Eds.), Perspectives on activity theory (pp. 377–404). Cambridge, UK: Cambridge University Press. http://dx.doi.org/10.1017/CBO9780511812774.025
Gibbons, A. S., & Brewer, E. K. (2005). Elementary principles of design languages and notation systems for instructional design. In J. M. Spector, C. Ohrazda, A. Van Schaack, & D. Wiley (Eds.), Innovations in instructional technology: Essays in honor of M. David Merrill. Mahwah, NJ: Lawrence Erlbaum.
Grant, M. M. (2011). Learning, beliefs, and products: Students’perspectives with project-based learning. Interdisciplinary Journal of Problem-based Learning, 5(2), 37–69. http://dx.doi. org/10.7771/1541-5015.1254
Gullickson, A. R. (Ed.) (2003). The student evaluation standards: How to improve evaluations of students. Thousand Oaks, CA: Corwin Press.
Hakkarainen, K., Palonen, T., Paavola, S., & Lehtinen, E. (2004). Communities of networked expertise: Professional and educational perspectives. Amsterdam: Elsevier.
Herrington, A., & Herrington, J. (2008). What is an authentic learning environment? In L. Tomei, (Ed.), Online and distance learning: Concepts, methodologies, tools, and applications (pp. 68–77). Hershey, PA: IGI Global.
Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235–266. http://dx.doi.org/10.1023/B:EDPR.0000034022.16470.f3
Hmelo-Silver, C. E., & Barrows, H. S. (2006). Goals and strategies of a problem-based learning facilitator. Interdisciplinary Journal of Problem-based Learning, 1(1), 21–39. http://dx.doi.org/10.7771/1541-5015.1004
Hsu, Y. C. (1999). Evaluation theory in problem-based learning approach. In Proceedings of Selected Research and Development Papers Presented at the National Convention of the Association for Educational Communications and Technology [AECT], Houston, TX, February 10–14.
Jones, E. K. (2010). “Will you please sign on the dotted line?” A problem-based learning approach to social responsibility in race, gender, and media courses. Multicultural Education, 19(3), 60–64.
Kirschner, P. A., & Clark, R. E. (2006). Work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75–86. http://dx.doi.org/10.1207/s15326985ep4102_1
Kumar, M., & Kogut, G. (2006). Students’ perceptions of problem-based learning. Teacher Development, 10(1), 105–116. http://dx.doi.org/10.1080/13664530600587295
Kwan, T. Y. L. (2008). Student-teachers’ evaluation on the use of different modes of problem- based learning in teacher education. Asia-Pacific Journal of Teacher Education, 36(4), 323–343. http://dx.doi.org/10.1080/13598660802375933
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage.
Merriam, S. B. (1998). Qualitative research and case study applications in education (Rev. ed.). San Francisco, CA: Jossey-Bass.
Papinczak, T., Young, L., & Groves, M. (2007). Peer assessment in problem-based learning: A qualitative study. Advances in Health Sciences Education: Theory and Practice, 12(2), 169–186. http://dx.doi.org/10.1007/s10459-005-5046-6
Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation. New York: Guilford.
Penrod, S., & Jeppesen, R. (2008, March). BYU creating a new center focusing on computer animation. KSL.com. Salt Lake City. Retrieved from http://www.ksl.com/?nid=148&sid=2950565
Rogers, C. R. (1954). Toward a theory of creativity. ETC: A Review of General Semantics, 11(4), 249–319.
Savery, J. R. (2006). Overview of problem-based learning: Definitions and distinctions. Interdisciplinary Journal of Problem-based Learning, 1(1), 9–20. http://dx.doi.org/10.7771/1541-5015.1002
Sawyer, R. K. (2008). Group genius: The creative power of collaboration. Cambridge, UK: Perseus Books Group.
Sayer, K., Wilson, J., & Challis, S. (2006). Problem based learning in constructed textile design. International Journal of Art & Design Education, 25(2), 156–163. http://dx.doi.org/10.1111/j.1476-8070.2006.00480.x
Schmidt, H. G., Loyens, Sofie M. M., van Gog, T., Paas, F. (2007). Problem-based learning is compatible with human cognitive architecture: Commentary on Kirschner, Sweller, and Clark (2006). Educational Psychologist, 42(2), 37–41. http://dx.doi.org/10.1080/00461520701263350
Spradley, J. P. (1979). The ethnographic interview. Belmont, CA: Wadsworth, Cengage Learning.
Steele, D. J., Medder, J. D., & Turner, P. (2000). A comparison of learning outcomes and attitudes in student- versus faculty-led problem-based learning: An experimental study. Medical Education, 34(1), 23–29. http://dx.doi.org/10.1046/j.1365-2923.2000.00460.x
West, R. E. (2009). What is shared? A framework for understanding shared innovation within communities. Educational Technology Research and Development, 57(3), 315–332. http://dx.doi.org/10.1007/s11423-008-9107-4
West, R. E., & Hannafin, M. J. (2011). Learning to design collaboratively: Participation of student designers in a community of innovation. Instructional Science, 39(6), 821-841.
Williams, D. D., & Graham, C. R. (2010). Evaluating e-learning. In P. P. Peterson, E. Baker, & B. McGaw (Eds.), International Encyclopedia of Education (3rd ed., pp. 530–538). Oxford: Elsevier. http://dx.doi.org/10.1016/B978-0-08-044894-7.01643-2
Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage.