The Impact of The NTN Design on Academic Outcomes

Main Article Content

Dr. Brooke Culclasure
Dr. Eric Stocks
https://orcid.org/0000-0003-1752-3353
Dr. Michael Odell
https://orcid.org/0000-0001-7693-9207

Abstract

The effect of the New Tech Network (NTN) design on several academic measures was tested on ninth graders in four schools in the Southeastern United States. Results suggest that, when implemented with fidelity to the model, there is a significant effect of the NTN treatment on achievement test scores as students in NTN schools scored higher on both the End of Course (EOC) Math and ELA tests compared to students in control schools. This effect remained after controlling for Poverty, Race, and Preexisting Achievement Level. Students in NTN schools also were slightly more likely to earn dual credit compared to students in the control schools. However, there was no effect of the NTN treatment on dropout rate and students in NTN schools were more likely to be retained in their current grade level compared to students in the control schools.

Article Details

Section
Research Articles
Author Biographies

Dr. Brooke Culclasure, The Riley Institute at Furman

Dr. Brooke Culclasure (Ph.D. University of Virginia) served as the study’s principal investigator and oversaw all aspects of the study. Dr. Culclasure is the Research Director of the Riley Institute’s Center for Education Policy and Leadership, housed at Furman University.

Dr. Eric Stocks, University of Texas at Tyler

Dr. Eric Stocks (Ph.D. University of Kansas) served as the study’s co-investigator. Dr. Stocks is an Associate Professor in the Department of Counseling and Psychology at the University of Texas at Tyler.

Dr. Michael Odell, University of Texas at Tyler

Dr. Michael Odell (Ph.D. Indiana University) served as the study’s co-investigator. Dr. Odell is the Roosth Endowed Chair and Professor of STEM Education in the School of Education at the University of Texas.

References

Adams, J., & Duncan Grand, D. (2019). New Tech Network: Driving systems change and equity through project-based learning. Palo Alto, CA: Learning Policy Institute.

Alacapinar, F. (2008). Effectiveness of project-based learning. Eurasian Journal of Educational Research, (33), 17–34. Bracken, B. A. (1987). Limitations of preschool instruments and standards for minimal levels of technical adequacy. Journal of Psychoeducational Assessment, 5, 313–326.

Bergeron, L. (2017). Examining Student Outcomes in New Tech Network Title 1 Eligible Schools. Paper presentation at the annual conference of the Eastern Educational Research Association, Richmond, VA.

Center of Excellence in Leadership of Learning (CELL). (2011). Research Report for Fourth-Year Implementation of New Tech High Schools in Indiana. Indianapolis, IN: University of Indianapolis.

Condliffe, B. (2017). Project-based learning: A literature review. Working Paper. MDRC.

Culclasure, B., Odell, M., & Stocks, E. (2017). New Tech Network Interim Evaluation Report: Project Years 2013-14, 2014-15, and 2015-16. Expanded Evaluation and i3 Samples. Greenville, SC: Furman University.

Darling-Hammond, L., Barron, B., Pearson, P. D., Schoenfeld, A., Stage, E., Zimmerman, T., . . . Chen, M. (2008). Powerful learning: What we know about teaching for understanding. San Francisco, CA: Jossey-Bass.

Dobyns, L., Walsh, C., Lee, P., & Cuilla, K. (2012). Impacting Rural Academic Achievement and Economic Development: The Case for New Tech Network High Schools. Napa: New Tech Network.

Eslami, Z., & Garver, R. (2013). English language learners and project-based learning. In R. M. Capraro, M. M. Capraro, & J. R. Morgan (Eds.), STEM project-based learning: An integrated science, technology, engineering, and mathematics (STEM) approach (pp. 119–128). Rotterdam: Sense Publishers.

Geier, R., Blumenfeld, P. C., Marx, R. W., Krajcik, J. S., Fishman, B., Soloway, E., & Clay-Chambers, J. (2008). Standardized test outcomes for students engaged in inquiry-based science curricula in the context of urban reform. Journal of Research in Science Teaching, 45(8), 922–939.

Gellman, A., & Hill, J. (2007). Data Analysis using Regression and Multilevel/hierarchical Models. New York, NY: Cambridge Academic Press.

Grant, M. M. (2002). Getting a grip on project-based learning: Theory, cases, and recommendations. Journal of Research on Technology in Education, 65–98.

Huberman, M., Bitter, C., Anthony, J., & O’Day, J. (2014). The shape of deeper learning: Strategies, structures, and cultures in deeper learning network high schools. Report for the American Institutes for Research (AIR): The Research Alliance for New York City Schools. New York, NY.

Iacus, S. M., King, G., & Porro, G. (2011). Multivariate matching methods that are monotonic imbalance bounding. Journal of the American Statistical Association, 106(493), 345–361.

Iacus, S. M., King, G., & Porro, G. (2012). Causal inference without balance checking: Coarsened exact matching. Political Analysis, 20(1): 1–24.

Kanter, D. E., & Konstantopoulos, S. (2010). The impact of a project-based science curriculum on minority student achievement, attitudes, and careers: The effects of teacher content and pedagogical content knowledge and inquirybased practices. Science Education, 94(5), 855–887.

Krajcik, J. S., & Shin, N. (2014). Project-based learning. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 275–297). New York, NY: Cambridge University Press.

Larmer, J., & Mergendoller, J. (2015). Gold standard PjBL: Essential project design elements (by BIE). Project based learning | BIE. Retrieved September 25, 2018, from http://www.bie.org/object/document/gold_standard_pbl _essential_project_design_elements

LeBuffe, P. A., Shapiro, V. B., & Naglieri, J. A. (2009). Devereux student strengths assessment: A measure of social-emotional competencies of children in kindergarten through eighth grade. Lewisville, NC: Kaplan Early Learning.

Lynch, S., Peters-Burton, E., Spillane, N., Behrend, T., Ross, K., House, A., & Han, E. (2013). A policy-relevant instrumental case study of an inclusive STEM-focused high school: Manor New Tech High. International Journal of Education in Mathematics, Science and Technology, 5, 1.

Lynch, S., Spillane, N., Peters-Burton, E., Behrend, T., Ross, K., House, A., & Han, E. (2013). Manor New Tech High School: A case study of an Inclusive STEM-focused high School in Manor, Texas. Washington, D.C.: George Washington University Opportunity Structures for Preparation and Inspiration (OSPrI).

Maas, C. & Hox, J. (2005). Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 1, 86-92.

Mergendoller, J., Maxwell, N., & Bellisimo, Y. (2006). The effectiveness of problem-based instruction: A comparative study of instructional methods and student characteristics. Interdisciplinary Journal of Problem-Based Learning, 1(2), 49–69.

Mioduser, D., & Betzer, N. (2007). The contribution of project-based-learning to high-achievers’ acquisition of technological knowledge and skills. International Journal of Technology and Design Education, 18(1), 59–77.

National Center for Learning Disabilities (2017). Experiences in Practice: The Role of Project-Based Learning at Warren New Tech High School. New York, NY.

Parker, W. C., Lo, J., Yeo, A. J., Valencia, S. W., Nguyen, D., Abbott, R. D., Vye, N. J. (2013). Beyond breadthspeed-test: Toward deeper knowing and engagement in an advanced placement course. American Educational Research Journal, 50(6), 1424–1459.

Parker, W., Mosborg, S., Bransford, J., Vye, N., Wilkerson, J., & Abbott, R. (2011). Rethinking advanced high school coursework: Tackling the depth/breadth tension in the AP US government and politics course. Journal of Curriculum Studies, 43(4), 533–559.

Parsi, A. (2017). Experiences in practice: The role of projectbased learning at Warren New Tech High School. National Center for Learning Disabilities.

Raudenbush, S., & Byrk, A. (2002). Hierarchical Linear Models (2nd ed.) Thousand Oaks, CA: Sage.

Ravitz, J. (2010). Beyond changing culture in small high schools: Reform models and changing instruction with project-based learning. Peabody Journal of Education, 85(3), 290-313.

Reed, S. & Lee, P. (2014). Developing a supportive learning culture across a diverse network of schools. Paper presentation at the annual conference of the American Educational Research Association, Philadelphia, PA.

Rockman et al. (2006). New Technology High School Postsecondary Student Success Study. San Francisco, CA.

Rogers, W. H. (1983). Analyzing complex survey data. Santa Monica, CA: Rand Corporation.

Summers, E. J., & Dickinson, G. (2012). A longitudinal investigation of project-based instruction and student achievement in high school social studies. Interdisciplinary Journal of Problem-Based Learning, 6(1), 82–103.

Thomas, J. W. (2000). A review of research on project-based learning.

Zeiser, K., Taylor, J., Rickles, J., Garet, M., & Segeritz, M. (2014). Evidence of deeper learning outcomes. (Report #3 Findings from the study of deeper learning: Opportunities and outcomes). Washington, DC: American Institutes for Research.