Performance Assessment Practice as Professional Learning
Main Article Content
Abstract
While performance assessment (PA) is well aligned to project-based learning (PjBL), teachers find it challenging to design and implement PA that is faithful to the authentic context of their projects and viewed externally as rigorous. In contrast to standardizing PA tasks — thereby diminishing authenticity — we formed a research-practice partnership (Coburn, Penuel, & Geil, 2013) that developed and used a “shell” to guide teachers in planning, implementing, and engaging in rigorous dialogues that evaluate and elevate PA practice across four PjBL schools. Drawing from analysis of artifacts and audio-recorded professional development sessions, we highlight how the effort to standardize PA practice while maintaining fidelity to authentic context provided rich opportunities for teacher learning and fostered higher levels of teacher responsibility for assessment.
Article Details
1. Publication and Promotion: In consideration of the Publisher’s agreement to publish the Work, Author hereby grants and assigns to Publisher the non-exclusive right to print, publish, reproduce, or distribute the Work throughout the world in all means of expression by any method now known or hereafter developed, including electronic format, and to market or sell the Work orany part of it as Publisher sees fit. Author further grants Publisher the right to use Author’s name in association with the Work inpublished form and in advertising and promotional materials
2. Copyright: Copyright of the Work remains in Author’s name.
3. Prior Publication and Attribution: Author agrees not to publish the Work in print form prior to publication of the Work by the Publisher. Author agrees to cite, by author, title, and publisher, the original Interdisciplinary Journal of Problem-based Learning publication when publishing the Work elsewhere
4. Author Representations: The Author represents and warrants that the Work:
(a) is the Author’s original Work and that Author has full power to enter into this Agreement;
(b) does not infringe the copyright or property of another;
(c) contains no material which is obscene, libelous, defamatory or previously published, in whole or in part.
Author shall indemnify and hold Publisher harmless against loss of expenses arising from breach of any such warranties.
5. Licensing and Reuse: Reuse of the published Work will be governed by a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0; http://creativecommons.org/licenses/ by-nc/4.0/). This license lets others remix, tweak, and build upon the Work non-commercially; although new works must acknowledge the original Interdisciplinary Journal of Problem-based Learning publication and be non-commercial, they do not have to be licensed on the same terms.
References
APA, AERA, & NCME. (2014). The standards for educational and psychological testing. Washington, DC: American Psychological Association.
Asia Society. (2016, September 7, 2018). ISSN workshops and resources: 2016 catalogue. Retrieved September 7, 2018 from https://asiasociety.org/files/issn-catalog-20160909 .pdf
Baartman, L., Bastiaens, T., Kirschner, P. A., & Van der Vleu- ten, C. (2006). The wheel of competency assessment: Presenting quality criteria for competency assessment programs. Studies in Educational Evaluation, 32(2), 153– 170. https://doi.org/10.1016/j.stueduc.2006.04.006
Brown, C., & Mevs, P. (2012). Quality performance assessment: Harnessing the power of teacher and student learn- ing. Boston, MA: Center for Collaborative Education.
Christophersen, K.-A., Elstad, E., & Turmo, A. (2014). Organisational factors influencing teachers’ inner sense of affective commitment to their schools in high- and low-accountability environments. International Journal of Management in Education, 9(1), 111–128.
Coburn, C. E., Penuel, W. R., & Geil, K. E. (2013). Research- practice partnerships: A strategy for leveraging research for educational improvement in school districts. New York, NY: William T. Grant Foundation.
Darling-Hammond, L. (1994). Performance-based assessment and educational equity. Harvard Educational Review, 64(1), 5–31.
Darling-Hammond, L. (2017). Developing and measuring higher order skills: Models for state performance assessment systems. Council of Chief State School Officers (CCSSO), 49.
Darling-Hammond, L., & Adamson, F. (2010). Beyond basic skills: The role of performance assessment in achieving 21st century standards of learning. Stanford, CA: Stanford Center for Opportunity Policy in Education.
Darling-Hammond, L., Ancess, J., & Falk, B. (1995). Authentic assessment in action: Studies of schools and students at work. New York, NY: Teachers College Press.
Darling-Hammond, L., & Falk, B. (2013). Teacher learning through assessment: How student-performance assessments can support teacher learning: Center for American Progress.
Davis, E. A., & Krajcik, J. S. (2005). Designing educative curriculum materials to promote teacher learn- ing. Educational Researcher, 34(3), 3–14. https://doi.org/10.3102/0013189X034003003
DeWalt, K. M., & DeWalt, B. R. (2010). Participant obser- vation: A guide for fieldworkers. New York, NY: Rowman Altamira.
Dewey, J. (1916). Democracy and education: An introduction to the philosophy of education. New York, NY: Macmillan.
Dimopoulos, I., Petropoulou, O., & Retalis, S. (2013). Assess- ing students’ performance using the learning analytics enriched rubrics. Proceedings of the Third International Conference on Learning Analytics and Knowledge (pp. 195–199). ACM.
Earl, L. M. (2012). Assessment as learning: Using classroom assessment to maximize student learning. Thousand Oaks, CA: Corwin Press.
Finch, P. A. (2016). Teacher-created student growth assessments used for teacher evaluation and the effects on teacher efficacy. (EdD), National Louis University.
Frederiksen, J. R., & Collins, A. (1989). A systems approach to educational testing. Educational Researcher, 18(9), 27–32.
French, D. (2017). The future is performance assessment. Voices in Urban Education, 46, 6–13.
Frey, B. B., Schmitt, V. L., & Allen, J. P. (2012). Defining authentic classroom assessment. Practical assessment, research & evaluation, 17(2), 1–18.
Geier, R., Blumenfeld, P. C., Marx, R. W., Krajcik, J. S., Fishman, B. J., Soloway, E., & Clay-Chambers, J. (2008). Standardized test outcomes for students engaged in inquiry-based science curricula in the context of urban reform. Journal of Research in Science Teaching, 45(8), 922–939.
Gerber, N. (2018). Pop quiz: Why should teacher candidates be trained in assessment. Retrieved September 7, 2018 from https://www.nctq.org/blog/POP-QUIZ:-Why-should-teacher-candidates-be-trained-in-assessment
Goodwin, C. (1994). Professional vision. American Anthropologist, 96(3), 606–633. https://doi.org/10.1525/aa.1994.96.3.02a00100
Greenberg, J. (2012). What teachers aren’t learning about assessment . . . And we mean any kind of assessment. National Council on Teacher Quality Blog. Retrieved September 7, 2018 from https://www.nctq.org/blog/What-teachers-arent-learning-about-assessment...and-we-mean-ANY -kind-of-assessment
Grob, R., Holmeier, M., & Labudde, P. (2017). Formative assessment to support students’ competences in inquiry- based science education. Interdisciplinary Journal of Problem-based Learning, 11(2), 6.
Gulikers, J. T. M., Kester, L., Kirschner, P. A., & Bastiaens, T. J. (2008). The effect of practical experience on perceptions of assessment authenticity, study approach, and learning outcomes. Learning and Instruction, 18(2), 172–186. https://doi.org/10.1016/j.learninstruc.2007.02.012
Harlen, W. (2005). Trusting teachers’ judgement: Research evidence of the reliability and validity of teachers’ assessment used for summative purposes. Research Papers in Education, 20(3), 245–270.
Helker, K., & Wosnitza, M. (2014). Responsibility in the school context-—development and validation of a heuristic framework. Frontline Learning Research, 2(3), 115–139.
Holdorf, W. E., & Greenwald, J. M. (2018). Toward a taxonomy and unified construct of responsibility. Personality and Individual Differences, 132, 115–125.
Jordan, B., & Henderson, A. (1995). Interaction analysis: Foundations and practice. Journal of the Learning Sciences, 4(1), 39–103.
Learning Forward. (2011). Standards for professional learning. Oxford, OH.
Lenz, B., Wells, J., & Kingston, S. (2015). Transforming schools using project-based deeper learning, performance assessment, and common core standards. San Francisco, CA: John Wiley & Sons.
Matteucci, M. C., Guglielmi, D., & Lauermann, F. (2017). Teachers’ sense of responsibility for educational outcomes and its associations with teachers’ instructional approaches and professional wellbeing. Social Psychology of Education, 20(2), 275–298.
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement. New York, NY: Macmillan.
Mislevy, R., Steinberg, L., & Almond, R. (2003). Focus article: On the structure of educational assessments. Measurement: Interdisciplinary Research & Perspective, 1(1), 3–62.
Moss, P. A., Girard, B. J., & Haniford, L. C. (2006). Validity in educational assessment. Review of Research in Education, 30(1), 109–162.
Newmann, F. M., King, M. B., & Carmichael, D. L. (2007). Authentic instruction and assessment. Des Moines, IA: Iowa Department of Education.
Palermo, C., & Thomson, M. M. (2018). Large-scale assessment as professional development: Teachers’ motivations, ability beliefs, and values. Teacher Development, 23(2), 192–212. https://doi.org/10.1080/13664530.2018.1536612
Penuel, W. R., Coburn, C. E., & Gallagher, D. J. (2013). Nego- tiating problems of practice in research-practice design partnerships. National Society for the Study of Education Yearbook, 112(2), 237–255.
Perry, N. E., & Meisels, S. J. (1996). How accurate are teacher judgments of students’ academic performance? Working paper series. Washington, DC.: National Center for Education Statistics.
Pierce, D. (2012). Performance assessment making a comeback in schools. eSchool News Special Report. http://www.eschoolnews.com/files/2012/01/eSNFeb12SR.pdf
Redecker, C., & Johannessen, Ø. (2013). Changing assess- ment—towards a new assessment paradigm using ICT. European Journal of Education, 48(1), 79–96.
Research for Action. (2014). Using common assignments to strengthen teaching and learning: Research on the 1st year of implementation. Retrieved from https://ldc.org/sites/default/files/research/CASYear1ExecutiveSummary_Sept 2014_RFA.pdf
Saldaña, J. (2015). The coding manual for qualitative researchers. Los Angeles, CA: Sage.
Salinitri, F. D., Wilhelm, S. M., & Crabtree, B. L. (2015). Facilitating facilitators: Enhancing PBL through a structured facilitator development program. Interdisciplinary Journal of Problem-based Learning, 9(1), 11. https://doi.org/10.7771/1541-5015.1509
SCALE. (2018). Performance assessment resource bank. Retrieved September 7, 2018 from https://www.performanceassessmentresourcebank.org/bin/performance-tasks
Shepard, L. A. (1997). Insights gained from a classroom-based assessment project. University of California, Los Angeles: Center for Research on Evaluation, Standards, and Student Testing, Graduate School of Education & Information Studies.
Solano Flores, G., Shavelson, R. J., & Schneider, S. A. (2001). Expanding the notion of assessment shell: From task development tool to instrument for guiding the process of science assessment development. Revista Electrónica de Investigación Educativa, 3(1). https://www.redalyc.org/pdf/155/15503103.pdf
Star, S. L. (2010). This is not a boundary object: Reflections on the origin of a concept. Science, Technology, & Human Values, 35(5), 601–617. https://doi.org/10.1177/0162243910377624
Stecher, B. (2010). Performance assessment in an era of standards-based educational accountability. Stanford, CA: Stanford Center for Opportunity Policy in Education.
Stosich, E. L., Snyder, J., & Wilczak, K. (2018). How do states integrate performance assessment in their systems of assessment? Education Policy Analysis Archives, 26(13), n13. https://doi.org/10.14507/epaa.26.2906
Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers’ judgments of students’ academic achievement: A meta-analysis. Journal of Educational Psychology, 104(3), 743. https://doi.org/10.1037/a0027627
Thomas, A. (2016). Evaluating the validity of technology- enhanced educational assessment items and tasks: An empirical approach to studying item features and scoring rubrics. (PhD), City University of New York, New York, NY.
Tung, R. (2010). Including performance assessments in accountability systems: A review of scale-up efforts. Boston, MA: Center for Collaborative Education.
Wehlage, G. G., Newmann, F. M., & Secada, W. G. (1996). Standards for authentic achievement and pedagogy. In F. M. Newmann (Ed.), Authentic achievement: Restructuring schools for intellectual quality. San Francisco, CA: Jossey-Bass.
Wei, R. C., & Cor, K. (2015). Assessing what matters: Literacy design collaborative writing tasks as measures of student learning. Paper presented at the American Education Research Association, Chicago, IL.
Zhao, Y. (2018). Reach for greatness: Personalizable education for all children. Thousand Oaks, CA: Corwin Press.