Integrating Technology and Problem-based Learning: A Mixed Methods Study of Two Teacher Professional Development Designs

Main Article Content

Andrew Walker
Mimi Recker
M. Brooke Robertshaw
Jeffrey Osen
Heather Leary
Lei Ye
Linda Sellers

Abstract

This article describes two consecutive enactments of technology-oriented teacher professional development designs, aimed at helping teachers find high-quality online learning resources and use them in designing effective problem-based learning (PBL) activities for their students. To align with current professional development prescriptions, in the first enactment, teachers learned PBL design skills concurrently with technology skills. Following aspects of design-based research, the professional development theory, participant feedback, and results from the first enactment informed the design of the second. In this second enactment, technology skills were separated and presented prior to learning about PBL. Results from a mixed-methods study of impact indicated that both professional development enactments were associated with large increases in teacher knowledge, experience, and confidence with regards to technology use and integration. Variations in the level of PBL usage by teachers in their activities, and the degree to which they discuss PBL and technology integration are presented alongside limitations, practical significance, scholarly significance, and planned future work.

Article Details

Section
Articles

References

Ainsworth, S., Honey, M., & Johnson, W. L. (2005). Cyberinfrastructure for Education and Learning for the Future: A Vision and Research Agenda. Computing Research Association, Washington, DC.

Angeli, C., & Valanides, N. (2005). Preservice teachers as ICT designers: An instructional design model based on an expanded view of pedagogical content knowledge. Journal of Computer-Assisted Learning, 21(4), 292-302.

Arambula-Greenfield, T. (1996). Implementing problem-based learning in a college science class. Journal of College Science Teaching, 26, 26-30.

Barker, L. (2009). Science teachers’ use of online resources and the digital library for Earth system education. (pp. 1-10). Presented at the Joint Conference on Digital Libraries, New York: ACM.

Barrows, H. S. (1986). A taxonomy of problem-based learning methods. Medical Education, 20(6), 481-6.

Barrows, H. S. (1996). Problem-based learning in medicine and beyond: A brief overview. New directions for teaching and learning, (68), 3-12.

Barrows, H. S., & Tamblyn, R. M. (1980). Problem-based learning: An approach to medical education. Springer Series on Medical Education. New York: Springer Publishing Company.

Becker, H. J. (2000). Findings from the Teaching, Learning, and Computing Survey: Is Larry Cuban Right? Education Policy Analysis Archives, 8(51).

Borko, H. (2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher, 33(8), 3-15.

Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research on teaching. Chicago: Rand McNally.

Carlson, B., & Reidy, S. (2004). Effective access: teachers’ use of digital resources (research in progress). OCLC Systems & Services, 20(2), 65-70.

Chen, H., & Doty, P. (2005). A conceptual framework for digital libraries for k–12 mathematics education: part 1, information organization, information literacy, and integrated learning. The Library Quarterly, 75(3), 231-261.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates.

Collins, A., & Halverson, R. (2009). Rethinking Education in the Age of Technology: The Digital Revolution and Schooling in America. New York: Teachers College Press.

Corbin, J. M., & Strauss, A. L. (2008). Basics of qualitative research (3rd ed.). Thousand Oaks, CA: Sage Publications, Inc.

Creswell, J. W., Clark, V. L. P., Gutmann, M. L., & Hanson, W. E. (2003). Advanced mixed methods research designs. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 209-240). Thousand Oaks, CA: Sage.

Derry, S. J., Hmelo-Silver, C. E., Nagarajan, A., Chernobilsky, E., & Beitzel, B. D. (2006). Cognitive transfer revisited: Can we exploit new media to solve old problems on a large scale? Journal of Educational Computing Research, 35(2), 145-162.

Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5-8.

Desimone, L. (2009). Improving impact studies of teachers’ professional development: Toward better conceptualizations and measures. Educational Researcher, 38(3), 181-199.

Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problem-based learning: a meta-analysis. Learning and instruction : the journal of the European Association for Research on Learning and Instruction, 13(5), 533-568.

Ertmer, P. A., & Simons, K. D. (2006). Jumping the PBL implementation hurdle: Supporting the efforts of K-12 teachers. The interdisciplinary Journal of Problem-based Learning, 1(1), 40-54.

Ertmer, P. A., Glazewski, K. D., Jones, D., Ottenbreit-Leftwich, A., Goktas, Y., Collins, K., & Kocaman, A. (2009). Facilitating technology-enhanced problem-based learning (PBL) in the middle school classroom: An examination of how and why teachers adapt. Journal of Interactive Learning Research, 20(1), 35-54.

Ferguson, C. J. (2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40, 532-538.

Ferry, B., Kervin, L., Cambourne, B., Turbill, J., Hedberg, J., & Jonassen, D. (2005). Incorporating real experience into the development of a classroom-based simulation. Journal of Learning Design, 1(1), 22-32.

Fishman, B., Marx, R., Best, S., & Tal, R. (2003). Linking teacher and student learning to improve professional development in systemic reform. Teaching and Teacher Education, 19(6), 643-658.

Garet, M., Porter, A., Desimone, L., Birman, B., & Yoon, K. (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38(4), 915-945.

Gijbels, D., Dochy, F., Van den Bossche, P., & Segers, M. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research, 75(1), 27-61.

Greenhow, C., Robelia, B., & Hughes, J. (2009). Learning, teaching, and scholarship in a digital age. Educational Researcher, 38(4), 246-249.

Gulseçen, S., & Kubat, A. (2006). Teaching ICT to teacher candidates using PBL: A qualitative and quantitative evaluation. Educational Technology & Society, 9(2), 96-106.

Hanson, K., & Carlson, B. (2005). Effective Access: Teachers’ Use of Digital Resources in STEM Teaching. Gender, Diversities and Technology Institute, Educational Development Center. https://secure.edc.org/publications/prodview.asp, 1718.

Hmelo-Silver, C. E., & Barrows, H. S. (2008). Facilitating collaborative knowledge building. Cognition and Instruction, 26(1), 48-94.

Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educatonal Researcher, 33(7), 14-26.

Khoo, M., Recker, M., Pagano, J., Palmer, B., Washington, A., & Donahue, R. A. (2008). Using webmectrics to analyze digital libraries.

Koehler, M., & Mishra, P. (2005a). Teachers learning technology by design. Journal of Computing in Teacher Education, 21(3), 94-102.

Koehler, M., & Mishra, P. (2005b). What happens when teachers design educational technology? The development of technological pedagogical content knowledge. Journal of Educational Computing Research, 32(2), 131-152.

Koehler, M., & Mishra, P. (2008). Introducing TPCK. Handbook of Technological Pedagogical Content Knowledge (TPCK) for Educators (pp. 3-30). New York: Routledge.

Koehler, M., Mishra, P., & Yahya, K. (2007). Tracing the development of teacher knowledge in a design seminar: Integrating content, pedagogy and technology. Computers & Education, 49, 740-762.

Koehler, M., Mishra, P., Hershey, K., & Peruski, L. (2004). With a little help from your students: A new model for faculty development and online course design. Journal of Technology and Teacher Education, 12(1), 25-55.

Kolodner, J., Camp, J. P., Crismond, D., Fasse, B., Gray, J., Holbrook, J., Puntambekar, S., et al. (2003). Problem-based learning meets case-based reasoning in the middle-school sci- ence classroom: Putting Learning by DesignTM into practice. Journal of the Learning Sciences, 12(4), 495-547.

Kramer, B., Walker, A., & Brill, J. (2007). The underutilization of Internet and communication technology-assisted collaborative project-based learning among international educators: A delphi study. Educational Technology Research and Development, 55(5), 527-543.

Lawless, K. A., & Pellegrino, J. W. (2007). Professional Development in Integrating Technology Into Teaching and Learning: Knowns, Unknowns, and Ways to Pursue Better Questions and Answers. Review of Educational Research, 77(4), 575.

Madden, A., Ford, N., Miller, D., & Levy, P. (2005). Using the Internet in teaching: The views of practitioners. British Journal of Educational Technology, 36(2), 255-230.

McArthur, D., & Zia, L. (2008). From NSDL 1.0 to NSDL 2.0: Towards a comprehensive cyberinfrastructure for teaching and learning (pp. 66-69). Presented at the International Conference on Digital Libraries, Pittsburgh, PA: ACM.

Means, B., Murphy, H., Javitz, G., & Toyama, Y. (2004). Design considerations for evaluating the effectiveness of technology-related teacher professional development. Menlo Park, CA: SRI International.

Murray-Harvey, R., & Slee, P. (2000). Problem based learning in teacher education: Just the beginning! Australian Association for Research in Education. Sydney.

Nielsen, J. (1993). Usability Engineering. Morgan Kaufmann.

Park, S. H., & Ertmer, P. A. (2007). Impact of problem-based learning (PBL) on teachers’ beliefs regarding technology use. Journal of Research on Technology in Education, 40(2), 247-267.

Park, S. H., & Ertmer, P. A. (2008). Examining barriers in technology-enhanced problem-based learning: Using a performance support systems approach. British Journal of Educational Technology, 39(4), 631-643.

Shrout, P., & Fleiss, J. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420-428.

Pea, R., Borgman, C. L. C., Ableson, H., Dirks, L., Johnson, R., Koedinger, K., & et al. (2008). Fostering learning in the networked world: The cyberlearning opportunity and challenge, a 21st century agenda for the National Science Foundation. National Science Foundation.

Perrault, A. (2007). An Exploratory Study of Biology Teachers’ Online Information Seeking Practices. School Library Media Research. Retrieved March 29, 2011, from http://www.ala.org/ala/mgrps/divs/aasl/aaslpubsandjournals/slmrb/slmrcontents/volume10/perrault_biologyteachers.cfm

Recker, M. (2006). Perspectives on teachers as digital library users: Consumers, contributors, and designers. D-Lib Magazine, 12(9).

Recker, M., Dorward, J., Dawson, D., Halioris, S., Liu, Y., Mao, X., Palmer, B., et al. (2005). You can lead a horse to water: teacher development and use of digital library resources. Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, 1-8.

Recker, M., Dorward, J., Dawson, D., Mao, X., Liu, Y., Palmer, B., Halioris, S., et al. (2005). Teaching, designing, and sharing: A context for learning objects. Interdisciplinary Journal of Knowledge and Learning Objects, 1, 197-216.

Robertshaw, M. B., Walker, A., Recker, M., Leary, H., & Sellers, L. (2010). Experiences in the Field: The Evolution of a Technology-Oriented Teacher Professional Development Model. In M. S. Saleh & I. M. Saleh (Eds.), New Science of Learning: Computers, Cognition and Collaboration in Education. New York: Springer.

Savery, J. R. (2006). Overview of problem-based learning: Definitions and distinctions. The interdisciplinary Journal of Problem-based Learning, 1(1), 9-20.

Shoffner, M. B., & Dalton, D. W. (1998). Effects of Problem-Based, Networked Hypermedia, and Cooperative Strategies on Visual Literacy Instruction. National Convention of the Associa- tion for Educational Communications and Technology (AECT). St. Louis, MO, February 18-22.

Strobel, J., & Barneveld, A. V. (2009). Is PBL effective? A meta-synthesis of meta-analyses comparing problem-based learning to conventional classroom learning. Interdisciplinary Journal of Problem-based Learning, 3(1), 44-58.

Sumner, T., Khoo, M., Recker, M., & Marlino, M. (2003). Understanding Educator Perceptions of “Quality” in Digital Libraries (pp. 269- 279). Presented at the Joint Conference on Digital Libraries, New York: ACM.

Surlekar, S. (1998). Teaching biochemistry in a “Guided Discovery Curriculum.” Biochemical Education, 26, 218-222.

Teddlie, C., & Tashakkori, A. (2009). Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. Thousand Oaks, CA: Sage Publications.

Walker, A., & Leary, H. (2009). A Problem-Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, and Assessment Levels. Interdisciplinary Journal of Problem-based Learning, 3(1), 12-43.

Walker, A., & Shelton, B. (2008). Problem-based learning informed educational game design. Journal of Interactive Learning Research, 19(4), 663-684.

Wayne, A. J., Yoon, K. S., Zhu, P., Cronen, S., & Garet, M. S. (2008). Experimenting with teacher professional development: Motives and methods. Educational Researcher, 37(8), 469-479.

Williams, D., & Coles, L. (2007). Evidence-based practice in teaching: an information perspective. Journal of Documentation, 63(6), 812-835.

Yin, R. (2003). Case study research: Design and methods (3rd ed.). Thousand Oaks, CA: Sage Publications Inc.