Assessing the Potential Challenges of Paid LLMs and Inequities in Language Classrooms Assessments and Academic Integrity in Higher Education
Article Sidebar
Main Article Content
Abstract
This essay examines the potential impact of paid-for or premium language models, where some students may be able to afford advanced models generating superior outputs while others could face inequities due to financial constraints. It explores how this dynamic can exacerbate the digital divide, challenge traditional as well as more recent assessment methods in language education, and discusses strategies that hold promise in navigating these complexities in the era of Generative AI within the context of higher education.
Key words: Premium Large Language Models, Digital Divide, Assessment, Higher education, Language Teaching and Learning
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
- Authors retain copyright and grant the Journal of the Scholarship of Teaching and Learning (JoSoTL) right of first publication with the work simultaneously licensed under a Creative Commons Attribution License, (CC-BY) 4.0 International, allowing others to share the work with proper acknowledgement and citation of the work's authorship and initial publication in the Journal of the Scholarship of Teaching and Learning.
- Authors are able to enter separate, additional contractual agreements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in the Journal of the Scholarship of Teaching and Learning.
- In pursuit of manuscripts of the highest quality, multiple opportunities for mentoring, and greater reach and citation of JoSoTL publications, JoSoTL encourages authors to share their drafts to seek feedback from relevant communities unless the manuscript is already under review or in the publication queue after being accepted. In other words, to be eligible for publication in JoSoTL, manuscripts should not be shared publicly (e.g., online), while under review (after being initially submitted, or after being revised and resubmitted for reconsideration), or upon notice of acceptance and before publication. Once published, authors are strongly encouraged to share the published version widely, with an acknowledgement of its initial publication in the Journal of the Scholarship of Teaching and Learning.
References
Afrira-Yamoah, E., Adama, E., Graf, A., & Adusei-Asante, K. (2024). Assessment Design And Practices Toward Holistic Learning Of Higher Education Students: Empirical Evidence Via Path Analysis Modelling Approach. Journal of the Scholarship of Teaching and Learning, 24(3). doi: 10.14434/josotl.v24i3.35672
Awdry, R. (2021) Assignment outsourcing: Moving beyond contract cheating. Assessment and Evaluation in Higher Education, 46(2), 220–235. https://doi.org/10.1080/02602938.2020.1765311
Caelen, O., & Blete, M. A. (2024). Developing Apps with GPT-4 and ChatGPT. " O'Reilly Media, Inc.
Cambridge Assessment (n.d.). What makes great assessment? Retrieved from: https://www.cambridgeassessment.org.uk/insights /what-makes-great-assessment/.
Carr, B. (2023). Revolutionizing Education: Unleashing the Power of Chat GPT/AI to Empower Educators. Technology and the Curriculum: Summer 2023.
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., ... & Xie, X. (2024). A survey on evaluation of large language models. ACM Transactions on Intelligent Systems and Technology, 15(3), 1-45.
Chaudhry, I. S., Sarwary, S. A. M., El Refae, G. A., & Chabchoub, H. (2023). Time to Revisit Existing Student’s Performance Evaluation Approach in Higher Education Sector in a New Era of ChatGPT — A Case Study. Cogent Education, 10(1). https://doi.org/10.1080/2331186X.2023.2210461
Connolly, A. J., Zaza, S., & Annabi, H. (2024). PDS–The Impact of AI on the Digital Divide in Research, Education and the Workforce.
Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in education and teaching international, 61(2), 228-239.
Forrester, A. D. (2023). ChatGPT What does it mean for Language Centres. STiLE-Scholarship of Teaching in Language Education, 1(1).
Furze, L. (2024). AI detection in education is a dead end. Retrieved from: https://leonfurze.com/2024/04/09/ai-detection-in-education-is-a-dead-end/comment-page-1/
Glaser, N. (2023). Exploring the Potential of ChatGPT as an Educational Technology: An Emerging Technology Report. Technology, Knowledge and Learning. https://doi.org/10.1007/s10758-023-09684-4
Gupta, K. (2023). Validity and Reliability of Students’ Assessment: Case for Recognition as a Unified Concept of Valid Reliability. Int J Appl Basic Med Res, 13(3), 129–132. doi: 10.4103/ijabmr.ijabmr_382_23,
Hadi, M. U., Qureshi, R., Shah, A., Irfan, M., Zafar, A., Shaikh, M. B., ... & Mirjalili, S. (2023). A survey on large language models: Applications, challenges, limitations, and practical usage. Authorea Preprints.
Hsiao, Y. P., Klijn, N., & Chiu, M. S. (2023). Developing a framework to re-design writing assignment assessment for the era of Large Language Models. Learning: Research and Practice, 9(2), 148-158.
International Center for Academic Integrity (n.d.). Celebrating 30 years of academic integrity. Accessed from: https://academicintegrity.org/
Kacperski, C., Ulloa, R., Bonnay, D., Kulshrestha, J., Selb, P., & Spitz, A. (2023). Who are the users of ChatGPT? Implications for the digital divide from web tracking data. arXiv preprint arXiv:2309.02142.
Khan, I. A., & Paliwal, N. W. (2023). ChatGPT and digital inequality: A rising concern. Scholars Journal of Applied Medical Sciences, 11(9), 1646-1647.
Kuzminykh, N. (2024). LLM Prompt best practices for large context windows. WinderAI. Retrieved from: https://winder.ai/llm-prompt-best-practices-large-context-windows/
Luo, J. (2024). A critical review of GenAI policies in higher education assessment: a call to reconsider the “originality” of students’ work. Assessment & Evaluation in Higher Education, 1–14. https://doi.org/10.1080/02602938.2024.2309963
Marche, S. (2022, December 7). The college essay is dead. Nobody is prepared for how AI will transform academia. The Atlantic, https://www.theatlantic.com/technology/ archive/2022/12/chatgpt-ai-writing-college-studentessays/672371/
Meyer, J., Jansen, T., Schiller, R., Liebenow, L. W., Steinbach, M., Horbach, A., & Fleckenstein, J. (2024). Using LLMs to bring evidence-based feedback into the classroom: AI-generated feedback increases secondary students’ text revision, motivation, and positive emotions. Computers and Education: Artificial Intelligence, 6, 100199.
Mills, A. (2023) How do we prevent learning loss due to AI text generators?. Blog post. https://docs.google.com/ document/d/1m4e2VAlWBzXoteYSGvCO1eTf6GQlOsrjltoJv od0h6g/edit#heading=h.sc09s7ot25zw Mills, A. (2023b). AI text generators: Sources to stimulate discussion among teachers. https://docs. google.com/document/d/1V1drRG1XlWTBrEwgGqdcCySUB12JrcoamB5i16-Ezw/edit#heading=h.qljyuxlccr6
MonshaAI (2024). Seven strategies for redesigning assessment in response to artificial intelligence. Retrieved from: https://monsha.ai/blog/7-strategies-for-redesigning-assessment-in-response-to-ai/
Norcini, J., Anderson, B., Bollela, V., Burch, V. C., Costa, MJ., Duvivier, R., Galbraith, R., Hays, R., Kent, A., Perrott, V., & Roberts, T. (2011). Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference. Medical Teacher, 33(3), 206-214. https://doi.org/10.3109/0142159x.2011.551559
Nadeem, M., Farag, W. A., & Helal, M. Rethinking Assessment Methodologies in the Era of Artificial Intelligence: Expanding Beyond ChatGPT's Scope.
Nowik, C. (2022, December 17). The robots are coming! The robots are coming! Nah, the robots are here. Substack, https://christinenowik.substack.com/p/the-robots-arecoming-the-robots#details
Nyaaba, M., Wright, A. L., & Choi, G. L. (2024). Generative AI and Digital Neocolonialism in Global Education: Towards an Equitable Framework. arXiv preprint arXiv:2406.02966.
Perkins, M. (2023). Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching and Learning Practice, 20(2).
Rawas, S. (2024). ChatGPT: Empowering lifelong learning in the digital age of higher education. Education and Information Technologies, 29(6), 6895-6908.
Roe, J., Renandya, W., & Jacobs, G. (2023). A review of AI-powered writing tools and their implications for academic integrity in the language classroom. Journal of English and Applied Linguistics 2(1). https://animorepository.dlsu.edu.ph/jeal/vol2/iss1/3/
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of applied learning and teaching, 6(1), 342-363.
Sabzalieva, E., & Valentini, A. (2023). ChatGPT and artificial intelligence in higher education: Quick start guide. UNESCO. https://www.iesalc.unesco.org/wp-content/uploads/2023/04/ChatGPT-and-Artificial-Intelligence-in-higher-education-Quick-Start-guide_EN_FINAL.pdf
Santiago-Ruiz, E. (2023). Writing with ChatGPT in a Context of Educational Inequality and Digital Divide. International Journal of Education and Development using Information and Communication Technology, 19(3), 28-38.
Shahriar, S., Lund, B., Mannuru, N. R., Arshad, M. A., Hayawi, K., Bevara, R. V. K., ... & Batool, L. (2024). Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency. arXiv preprint arXiv:2407.09519.
Sharples, M. (2022a). Automated essay writing: An AIED opinion. International Journal of Artificial Intelligence in Education, 32(4), 1119-1126.
Sharples, M. (2022b, May 17). New AI tools that can write student essays require educators to rethink teaching and assessment. Blog. London School of Economics. https:// blogs.lse.ac.uk/impactofsocialsciences/2022/05/17/new-aitools-that-can-write-student-essays-require-educators-torethink-teaching-and-assessment/
Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in Higher Education: Considerations for Academic Integrity and Student Learning.” Journal of Applied Learning & Teaching 6 (1), 1–10.
Tauginienė, L., Gaižauskaitė, I., Razi, S., Glendinning, I., Sivasubramaniam, S., Marino, F., ... & Kravjar, J. (2019). Enhancing the taxonomies relating to academic integrity and misconduct. Journal of Academic Ethics, 17, 345-361.
Thomas Lancaster’s Blog (2024). Faking reflection with ChatGPT. Retrieved from: https://thomaslancaster.co.uk/blog/faking-reflection-with-chatgpt/
UNESCO (2023). Guidance for generative AI in education and research. Retrieved from: https://unesdoc.unesco.org/ark:/48223/pf0000386693Whitney, L. (2024, July 2023). Copilot Pro vs. ChatGPT Plus: Which AI chatbot is worth your $20 a month? ZDNet. Retrieved from: https://www.zdnet.com/article/copilot-pro-vs-chatgpt-plus-which-is-ai-chatbot-is-worth-your-20-a-month/
Van Dijk, J. A. G. M. (2017). Digital divide: Impact of access. The international encyclopedia of media effects, 1, 1-11.
Whitney, L. (2024, July 2023). Copilot Pro vs. ChatGPT Plus: Which AI chatbot is worth your $20 a month? ZDNET. Retrieved from: https://www.zdnet.com/article/copilot-pro-vs-chatgpt-plus-which-is-ai-chatbot-is-worth-your-20-a-month/
Wu, K., Wu, E., Cassasola, A., Zhang, A., Wei, K., Nguyen, T., ... & Zou, J. (2024). How well do LLMs cite relevant medical references? An evaluation framework and analyses. arXiv preprint arXiv:2402.02008.
Young Post (14th Feb 2019). Chinese schoolgirl used robot to write her homework – now everybody wants one. Retrieved from: https://www.scmp.com/yp/discover/entertainment/tech-gaming/article/3060907/chinese-schoolgirl-caught-using-robot-write