Exploring the Relationships Between Tutor Background, Tutor Training, and Student Learning: A Problem-based Learning Meta-Analysis
Main Article Content
Abstract
Despite years of primary research on problem-based learning and literature reviews, no systematic effort has been made to analyze the relationship between tutor characteristics and student learning outcomes. In an effort to fill that gap the following meta-analysis coded 223 outcomes from 94 studies with small but positive gains for PBL students (g = 0.24). Specific sub-group analyses indicate randomly controlled designs may be more sensitive to differences that favor PBL students, even while there is no relationship between tutor content expertise and student learning. Perhaps surprisingly, student learning decreases as tutor experience increases. Limitations and future work are discussed within a context of scholarly and practical significance.
Article Details
1. Publication and Promotion: In consideration of the Publisher’s agreement to publish the Work, Author hereby grants and assigns to Publisher the non-exclusive right to print, publish, reproduce, or distribute the Work throughout the world in all means of expression by any method now known or hereafter developed, including electronic format, and to market or sell the Work orany part of it as Publisher sees fit. Author further grants Publisher the right to use Author’s name in association with the Work inpublished form and in advertising and promotional materials
2. Copyright: Copyright of the Work remains in Author’s name.
3. Prior Publication and Attribution: Author agrees not to publish the Work in print form prior to publication of the Work by the Publisher. Author agrees to cite, by author, title, and publisher, the original Interdisciplinary Journal of Problem-based Learning publication when publishing the Work elsewhere
4. Author Representations: The Author represents and warrants that the Work:
(a) is the Author’s original Work and that Author has full power to enter into this Agreement;
(b) does not infringe the copyright or property of another;
(c) contains no material which is obscene, libelous, defamatory or previously published, in whole or in part.
Author shall indemnify and hold Publisher harmless against loss of expenses arising from breach of any such warranties.
5. Licensing and Reuse: Reuse of the published Work will be governed by a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0; http://creativecommons.org/licenses/ by-nc/4.0/). This license lets others remix, tweak, and build upon the Work non-commercially; although new works must acknowledge the original Interdisciplinary Journal of Problem-based Learning publication and be non-commercial, they do not have to be licensed on the same terms.
References
Albanese, M., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine, 68(1), 52–81.
Alleyne, T., Shirley, A., Bennett, C., Addae, J., Walrond, E., West, S., et al. (2002). Problem-based compared with traditional methods at the Faculty of Medical Sciences, Univer- sity of the West Indies: A model study. Medical Teacher, 24(3), 273–279. http://dx.doi.org/10.1080/01421590220125286
Baroffio, A., Nendaz, M. R., Perrier, A., & Vu, N. V. (2007). Tutor training, evaluation criteria and teaching environment influence students’ ratings of tutor feedback in problem-based learning. Advances In Health Sciences Education, 12(4), 427–439. http://dx.doi.org/10.1007/s10459-006-9008-4
Barrows, H. S. (1986). A taxonomy of problem-based learning methods. Medical Education, 20(6), 481–486. http://dx.doi.org/10.1111/j.1365-2923.1986.tb01386.x
Barrows, H. S. (1996). Problem-based learning in medicine and beyond: A brief overview. New Directions for Teaching and Learning, 1996(68), 3–12. http://dx.doi.org/10.1002/tl.37219966804
Barrows, H. S. (1998). The essentials of problem-based learning. Journal of Dental Education, 62(9), 630–633.
Barrows, H. S. (2002). Is it truly possible to have such a thing as dPBL? Distance Education, 23(1), 119–122. http://dx.doi.org/10.1080/01587910220124026
Blumberg, P., Michael, J. A., & Zeitz, H. (1990). Roles of student-generated learning issues in problem-based learning. Teaching and Learning in Medicine, 2(3), 149–154. http://dx.doi.org/10.1080/10401339009539448
Bochner, D., Badovinac, R. L., Howell, T. H., & Karimbux, N. Y. (2002). Tutoring in a problem-based curriculum: Expert versus nonexpert. Journal of Dental Education, 66(11), 1246–1251.
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Hoboken, NJ: John Wiley & Sons. http://dx.doi.org/10.1002/9780470743386
Budé, L., Imbos, T., van de Wiel, M. W. J., Broers, N. J., & Berger, M. P. F. (2009). The effffffect of directive tutor guidance in problem-based learning of statistics on students’ perceptions and achievement. Higher Education, 57(1), 23–36.
Budé, L., van de Wiel, M. W. J., Imbos, T., & Berger, M. P. F. (2011). The effffffect of directive tutor guidance on students’ conceptual understanding of statistics in problem-based learning. The British Journal of Educational Psychology, 81, 309–324. http://dx.doi.org/10.1348/000709910X513933
Chan, L. C. (2008). The role of a PBL tutor: A personal perspective. Kaohsiung Journal of Medical Sciences, 24(3), S34–S38. http://dx.doi.org/10.1016/S1607-551X(08)70092-5
Chng, E., Yew, E. H. J., & Schmidt, H. G. (2011). Effects of tutor-related behaviours on the process of problem-based learning. Advances in Health Sciences Education, 16(4), 491–503. http://dx.doi.org/10.1007/s10459-011-9282-7
Dahlgren, M. A., Castensson, R., & Dahlgren, L. O. (1998). PBL from the teachers ’ perspective: Conceptions of the tutor’s role within problem based learning. Higher Education, 36(4), 437–447. http://dx.doi.org/10.1023/A:1003467910288
Daniel, A. M. C. (2004). Problem Based Learning Curriculum for Clinical Laboratory Science. (Unpublished doctoral dissertation). University of Houston, Texas.
Davis, W. K., Nairn, R., Paine, M. E., Anderson, R. M., & Oh, M. S. (1992). Effects of expert and non-expert facilitators on the small-group process and on student performance. Academic Medicine, 67(7), 470–474. http://dx.doi.org/10.1097/00001888-199207000-00013
De Grave, W. S., Dolmans, D. H. J. M., & van der Vleuten, C. P. M. (1999). Profiles of effective tutors in problem-based learning: scaffolding student learning. Medical Education, 33(12), 901–906. http://dx.doi.org/10.1046/j.1365-2923.1999.00492.x
De Volder, M. L. (1982). Discussion groups and their tutors: Relationships between tutor characteristics and tutor functioning. Higher Education, 11(3), 269–271. http://dx.doi.org/10.1007/BF00155618
De Volder, M. L., De Grave, W. S., & Gijselaers, W. (1985). Peer teaching: Academic achievement of teacher-led versus students-led discussion groups. Higher Education, 14(6), 643–650. http://dx.doi.org/10.1007/BF00136502
Dede, C. (2003). The role of emerging technologies for knowledge mobilization, dissemination, and use in education. Retrieved from http://www.virtual.gmu.edu/EDIT895/knowlmob.html
Des Marchais, J. E., Bureau, M. A., Dumais, B., & Pigeons, G. (1992). From traditional to problem- based learning: A case report of complete curriculum reform. Medical Education, 26(3), 190–199. http://dx.doi.org/10.1111/j.1365-2923.1992.tb00153.x
Distlehorst, L. H., & Robbs, R. S. (1998). A comparison of problem-based learning and standard curriculum students: Three years of retrospective data. Teaching and Learning in Medicine, 10(3), 131–137. http://dx.doi.org/10.1207/S15328015TLM1003_2
Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problem-based learn- ing: A meta-analysis. Learning and Instruction, 13(5), 533–568. http://dx.doi.org/10.1016/S0959-4752(02)00025-7
Dolmans, D. H. J. M., Gijselaers, W. H., Moust, J. H. C., De Grave, W. S., Wolfhagen, I. H. A. P., & Van Der Vleuten, C. P. (2002). Trends in research on the tutor in problem-based learning: Conclusions and implications for educational practice and research. Medical Teacher, 24(2), 173–180. http://dx.doi.org/10.1080/01421590220125277
Eagle, C. J., Harasym, P. H., & Mandin, H. (1992). Effects of tutors with case expertise on problem-based learning issues. Academic Medicine, 67(7), 465–469. http://dx.doi.org/10.1097/00001888-199207000-00012
Gijbels, D., Dochy, F., Van den Bossche, P., & Segers, M. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research, 75(1), 27–61. http://dx.doi.org/10.3102/00346543075001027
Gilkison, A. (2003). Techniques used by “expert” and “non-expert” tutors to facilitate problem- based learning tutorials in an undergraduate medical curriculum. Medical Education, 37(1), 6–14. http://dx.doi.org/10.1046/j.1365-2923.2003.01406.x
Groves,M.,Régo,P.,&O’Rourke,P.(2005).Tutoringinproblem-basedlearningmedicalcurricula: The influence of tutor background and style on effectiveness. BMC Medical Education, 5(1), 20. http://dx.doi.org/10.1186/1472-6920-5-20
Hedges, H. L., Laine, R. D., & Greenwald, R. (1994). An exchange: Part I: Does money matter? A meta-analysis of studies of the effects of differential school inputs on student outcomes. Educational Researcher, 23(3), 5–14. http://dx.doi.org/10.3102/0013189X023003005
Hendry, G. D. (2009). Problem-based learning tutors’ conceptions of their development as tutors. Medical Teacher, 31(2), 145–150. http://dx.doi.org/10.1080/01421590802146026
Hendry, G. D., Phan, H., Lyon, P. M., & Gordon, J. (2002). Student evaluation of expert and non- expert problem-based learning tutors. Medical Teacher, 24(5), 544–549. http://dx.doi.org/10.1080/0142159021000012603
Hmelo-Silver, C. E., & Barrows, H. S. (2006). Goals and strategies of a problem-based learning facilitator. The Interdisciplinary Journal of Problem-based Learning, 1(1), 21–39. http://dx.doi.org/10.7771/1541-5015.1004
Hmelo-Silver, C. E., & Barrows, H. S. (2008). Facilitating collaborative knowledge building. Cognition and Instruction, 26(1), 48–94. http://dx.doi.org/10.1080/07370000701798495
Johansen, M.-L., Martenson, D. F., & Bircher, J. (1992). Students as tutors in problem- based learning: Does it work? Medical Education, 26(2), 163–165. http://dx.doi.org/10.1111/j.1365-2923.1992.tb00143.x
Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63–85. http://dx.doi.org/10.1007/BF02300500
Kalaian, H. A., Mullan, P. B., & Kasim, R. M. (1999). What can studies of problem-based learning tell us? Synthesizing and modeling PBL effects on National Board of Medical Examination Performance: Hierarchical linear modeling meta-analytic approach. Advances in Health
Sciences Education, 4(3), 209–221. http://dx.doi.org/10.1023/A:1009871001258
Kwizera, E. N., Dambisya, Y. M., & Aguirre, J. H. (2001). Does tutor subject-matter expertise influence student achievement in the problem-based learning curriculum at UNITRA Medical School? South African Medical Journal, 91(6), 514–516.
Lawless, K. A., & Pellegrino, J. W. (2007). Professional development in integrating technology into teaching and learning: Knowns, unknowns, and ways to pursue better questions and answers. Review of Educational Research, 77(4), 575. http://dx.doi.org/10.3102/0034654307309921
Mergendoller, J. R., Maxwell, N. L., & Bellisimo, Y. (2000). Comparing problem-based learning and traditional instruction in high school economics. Journal of Educational Research, 93(6), 374–382. http://dx.doi.org/10.1080/00220670009598732
Moore, T., & Kain, D. L. (2011). Student tutors for problem-based learning in dental hygiene: A study of tutor actions. Journal of Dental Education, 75(6), 805–816.
Moust, J. H., De Grave, W. S., & Gijselaers, W. H. (1990). The tutor role: A neglected variable in the implementation of problem-based learning. In Z. H. Nooman, H. G. Schmidt, & E. S. Ezzat (Eds.), Innovation in medical education: An evaluation of its present status (pp. 135–151). New York: Springer.
Moust, J. H. C., De Volder, M. L., & Nuy, H. J. P. (1989). Peer teaching and higher level cognitive learning outcomes in problem-based learning. Higher Education, 18(6), 737–742. http://dx.doi.org/10.1007/BF00155664
Moust, J. H. C., & Schmidt, H. G. (1994). Facilitating small-group learning: a comparison of student and staff tutors’ behavior. Instructional Science, 22(4), 287–301. http://dx.doi. org/10.1007/BF00891782
Murnane, R. J., & Philips, B. R. (1981). Learning by doing, vintage, and selection: Three pieces of the puzzle relating teaching experience and teaching performance. Economics of Education Review, 1(4), 453–465. http://dx.doi.org/10.1016/0272-7757(81)90015-7
Neufeld, V. R., & Barrows, H. S. (1974). The “McMaster Philosophy”: An approach to medical education. Journal of Medical Education, 49(11), 1040–1050.
Papinczak, T. (2010). Assessment: An exploration of perceptions of tutor evaluation in problem‐ based learning tutorials. Medical Education, 44(9), 892–899. http://dx.doi.org/10.1111/j.1365-2923.2010.03749.x
Park, S. E., Susarla, S. M., Cox, C. K., Silva, J. D., & Howell, T. H. (2007). Do tutor expertise and experience influence students performance in a problem-based curriculum? Journal of Dental Education, 71(6), 819–824.
Regehr, G., Martin, J., Hutchinson, C., Murnaghan, J., Cusimano, M., & Reznick, R. (1995). The effect of tutor’s content expertise on student learning, group process, and participants satisfaction in a problem-based learning curriculum. Teaching and Learning in Medicine, 7(4), 225–232. http://dx.doi.org/10.1080/10401339509539748
Savery, J. R. (2006). Overview of problem-based learning: Definitions and distinctions. The Interdisciplinary Journal of Problem-based Learning, 1(1), 9–20. http://dx.doi.org/10.7771/1541-5015.1002
Savery, J. R., & Duffy, T. M. (1995). Problem based learning: An instructional model and its constructivist framework. Educational Technology, 35(5), 31–38.
Schmidt, H. G., & Moust, J. H. C. (1995). What makes a tutor effective? A structural equations modelling approach to learning in a problem-based curricula. Academic Medicine, 70(8), 708–714.
Schmidt, H. G., Van Der Arend, A., Kokx, I., & Boon, L. (1994). Peer versus staff tutoring in problem-based learning. Instructional Science, 22(4), 279–285. http://dx.doi.org/10.1007/BF00891781
Schmidt, H. G., Van Der Arend, A., Moust, J. H. C., Kokx, I., & Boon, L. (1993). Influence of tutors’ subject-mater expertise on student effort and achievement in problem-based learning. Academic Medicine, 68(10), 784–791. http://dx.doi.org/10.1097/00001888-199310000-00018
Shadish, W., & Myers, D. (2004). Research design policy brief. Campbell Collaboration Methods Group. Retrieved from http://www.campbellcollaboration.org/artman2/uploads/1/C2_Research_Design_Policy_Brief-2.pdf
Silver, M., & Wilkerson, L. (1991). Effects of tutors with subject expertise on the problem-based tutorial process. Academic Medicine, 66(5), 298–300. http://dx.doi.org/10.1097/00001888-199105000-00017
Steele, D. J., Medder, J. D., & Turner, P. (2000). A comparison of learning outcomes and attitudes in student- versus faculty-led problem-based learning: An experimental study. Medical Education, 34(1), 23–29. http://dx.doi.org/10.1046/j.1365-2923.2000.00460.x
Steinkuehler, C. A., Derry, S. J., Hmelo-Silver, C. E., & Delmarcelle, M. (2002). Cracking the resource nut with distributed problem-based learning in secondary teacher education. Distance Education, 23(1), 23–39. http://dx.doi.org/10.1080/01587910220123964
Stemler, S. E. (2004). A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Practical Assessment, Research & Evaluation, 9(4). Retrieved from http://PAREonline.net/getvn.asp?v=9&n=4
Stes, A., Min-Leliveld, M., Gijbels, D., & Van Petegem, P. (2010). The impact of instructional development in higher education: The state-of-the-art of the research. Educational Research Review, 5(1), 25–49. http://dx.doi.org/10.1016/j.edurev.2009.07.001
Strobel, J., & Barneveld, A. V. (2009). Is PBL effective? A meta-synthesis of meta-analyses comparing PBL to conventional classrooms. Interdisciplinary Journal of Problem Based Learning, 3(1), 44–58. http://dx.doi.org/10.7771/1541-5015.1046
Swanson, D. B., Stalenhoef-Halling, B. F., & van der Vleuten, C. P. (1990). Effect of tutor charac- teristics on test performance of students in a problem-based curriculum. In W. Bender, R. J. Hiemstra, A. J. J. . Scherpbier, & R. P. Zwierstra (Eds.), Teaching and assessing clinical competence (pp. 129–34). Groningen, The Netherlands: Boek Werk Publications.
Vernon, D. T., & Blake, R. L. (1993). Does problem-based learning work? A meta-analysis of evaluative research. Academic Medicine, 68(7), 550–563. http://dx.doi.org/10.1097/00001888-199307000-00015
Walker, A. & Leary, H. (2009). A problem based learning meta-analysis: Differences across problem types, implementation types, disciplines, and assessment levels. Interdisciplinary Journal of Problem Based Learning, 3(1), 6–28. http://dx.doi.org/10.7771/1541-5015.1061
Woltering, V., Herrler, A., Spitzer, K., & Spreckelsen, C. (2009). Blended learning positively affects students’ satisfaction and the role of the tutor in the problem-based learning process: results of a mixed-method evaluation. Advances in Health Sciences Education, 14(5), 725–738. http://dx.doi.org/10.1007/s10459-009-9154-
Wortman, P. (1994). Judging research quality. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 97–109). New York: Russell Sage Foundation.
Zhang, M., Lundeberg, M., & Eberhardt, J. (2011). Strategic facilitation of problem-based discussion for teacher professional development. Journal of the Learning Sciences, 20(3), 342–394. http://dx.doi.org/10.1080/10508406.2011.553258