Investigating the influence of generative ai integration within Problem Based Learning on students' critical thinking in introductory physics courses

Putu Prima Juniartina; Ni Luh Putu Mery Marlinda; I Made Oka Riawan; Kadek Dwi Hendratma Gunawan

doi:10.21067/mpej.v10i1.13647

Authors

Putu Prima Juniartina Universitas Pendidikan Ganesha, Indonesia
Ni Luh Putu Mery Marlinda Universitas Pendidikan Ganesha, Indonesia
I Made Oka Riawan Universitas Pendidikan Ganesha, Indonesia
Kadek Dwi Hendratma Gunawan Universitas Sebelas Maret, Indonesia

DOI:

https://doi.org/10.21067/mpej.v10i1.13647

Keywords:

Critical thinking, Generative AI, Physics education

Abstract

While the proliferation of Generative Artificial Intelligence (GenAI) offers transformative potential in higher education, its specific impact on critical thinking when integrated into structured pedagogical frameworks remains underexplored. This study investigates the integration of GenAI as a cognitive scaffold within a Problem-Based Learning (PBL) framework and its effect on the critical thinking skills of undergraduate students in an Introductory Physics course. Employing a quantitative quasi-experimental approach with a nonequivalent pretest-posttest control group design, the research involved 38 Science Education students. Participants were divided into an experimental group utilizing GenAI-assisted PBL and a control group receiving conventional instruction. Data were collected using 15 essay items assessing critical thinking based on Ennis’s taxonomy and analyzed via ANOVA and Normalized Gain (N-Gain). Results revealed a statistically significant difference (F=100.07; p<0.001), with the experimental group achieving a "Medium" gain (N-Gain = 0.477) compared to the control group's "Low" gain (N-Gain = 0.189). These findings address a critical gap by demonstrating that when GenAI is explicitly paired with the evaluative demands of PBL, it functions effectively as intelligent scaffolding rather than causing cognitive offloading, underscoring the necessity of embedding AI literacy into the modern science curriculum.

Downloads

Download data is not yet available.

References

Akhsan, J. (2023). Analysis of the teacher’s role in educating students during the era of disruption. Enigma in Education, 1(1), 11–15. https://doi.org/10.61996/edu.v1i1.3

Alarbi, K., Halaweh, M., Tairab, H., Alsalhi, N. R., Annamalai, N., & Aldarmaki, F. (2024). Making a revolution in physics learning in high schools with ChatGPT: A case study in UAE. Eurasia Journal of Mathematics, Science and Technology Education, 20(9), Article em2499. https://doi.org/10.29333/ejmste/14983

Alfarwan, A. (2025). Generative AI use in K–12 education: A systematic review. Frontiers in Education, 10, Article 1647573. https://doi.org/10.3389/feduc.2025.1647573

Ayu, H. D., Chusniyah, D. A., Kurniawati, M. P., Purwanti, P. F., Lukitawanti, S. D., & Putri, A. N. (2024). Problem-based learning (PBL) as an effective solution to enhance understanding of physics concepts: Systematic literature review. Journal of Environment and Sustainability Education, 2(2). https://doi.org/10.62672/joease.v2i2.29

Baker, B. (2022). Higher-level thinking in advanced physics courses. In Critical thinking in the physics curriculum (pp. 5-1–5-10). AIP Publishing. https://doi.org/10.1063/9780735424234_005

Bogdanova, D., & Snoeck, M. (2019). Use of personalized feedback reports in a blended conceptual modelling course. In 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C) (pp. 672–679). IEEE. https://doi.org/10.1109/MODELS-C.2019.00103

Borah, A. R., T. N., N., & Gupta, S. (2024). Improved learning based on GenAI. In 2024 2nd International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT) (pp. 1527–1532). IEEE. https://doi.org/10.1109/IDCIoT59759.2024.10467943

Ciubotaru, B.-I. (2025). Generative AI and large language models: A comprehensive scientific review. Preprints. https://doi.org/10.20944/preprints202504.0413.v1

Ennis, R. H. (1985). Developing minds: A resource book for teaching thinking (A. L. Costa, Ed.). Association for Supervision and Curriculum Development.

Gerlich, M. (2025). From offloading to engagement: An experimental study on structured prompting and critical reasoning with generative AI. Data, 10(11), 172. https://doi.org/10.3390/data10110172

Hake, R. R. (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64–74. https://doi.org/10.1119/1.18809

Harahap, R., Sudarma, T. F., Novika, S., Mannasalwa, Z., & Putri, N. A. (2025). Effectiveness and innovation of problem-based learning in physics learning in a decade: A literature analysis of critical thinking development. Jurnal Eduscience (JES), 12(3), 813–825. https://doi.org/10.36987/jes.v12i3.7121

Helal, M. Y. I., Elgendy, I. A., Albashrawi, M. A., Dwivedi, Y. K., Al-Ahmadi, M. S., & Jeon, I. (2025). The impact of generative AI on critical thinking skills: A systematic review, conceptual framework and future research directions. Information Discovery and Delivery. Advance online publication. https://doi.org/10.1108/IDD-05-2025-0125

Jarrahi, M. H., Askay, D., Eshraghi, A., & Smith, P. (2023). Artificial intelligence and knowledge management: A partnership between human and AI. Business Horizons, 66(1), 87–99. https://doi.org/10.1016/j.bushor.2022.03.002

Jho, H. (2024). Leveraging generative AI in physics education: Addressing hallucination issues in large language models. New Physics: Sae Mulli, 74(8), 812–823. https://doi.org/10.3938/NPSM.74.812

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Kasneci, G., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Khan, N., & Saunderson, S. (2024). Generative artificial intelligence in education: A narrative literature review. World Journal on Educational Technology: Current Issues, 16(2), 112–126. https://doi.org/10.18844/wjet.v16i2.9217

Kobaba, B. M., Lihega, J. K., & Khalfan, K. A. (2025). AI in higher education: Effect on student competency and independent learning. Asian Journal of Education and Social Studies, 51(7), 1100–1106. https://doi.org/10.9734/AJESS/2025/v51i72194

Kotsis, K. T. (2025). ChatGPT and DeepSeek evaluate one another for science education. EIKI Journal of Effective Teaching Methods, 3(1). https://doi.org/10.59652/jetm.v3i1.439

Kshetri, N. (2023). The future of education: Generative artificial intelligence’s collaborative role with teachers. IT Professional, 25(6), 8–12. https://doi.org/10.1109/MITP.2023.3333070

Lawasi, M. C., Rohman, V. A., & Shoreamanis, M. (2024). The use of AI in improving students’ critical thinking skills. Proceedings Series on Social Sciences & Humanities, 18, 366–370. https://doi.org/10.30595/pssh.v18i.1279

Liang, E. S., & Bai, S. (2025). Generative AI and the future of connectivist learning in higher education. Journal of Asian Public Policy, 18(2), 329–351. https://doi.org/10.1080/17516234.2024.2386085

Liang, Y., Zou, D., Xie, H., & Wang, F. L. (2023). Exploring the potential of using ChatGPT in physics education. Smart Learning Environments, 10(1), Article 52. https://doi.org/10.1186/s40561-023-00273-7

Mahligawati, F., Allanas, E., Butarbutar, M. H., & Nordin, N. A. N. (2023). Artificial intelligence in physics education: A comprehensive literature review. Journal of Physics: Conference Series, 2596(1), 012080. https://doi.org/10.1088/1742-6596/2596/1/012080

Nemalynne, A. A., Thelma, C. D., Shermaine, A. D., Jessica, R. L., Romelyn, T. L., Ryan, B. T., Nove Lheen, C. T., & Eisle Keith, R. T. (2023). Challenges in teaching science and its transition to post-pandemic education. American Journal of Multidisciplinary Research and Innovation, 2(3), 15–22. https://doi.org/10.54536/ajmri.v2i3.1195

Şengül, Ö. (2023). Reconsidering physics education: Barriers to student learning and ways to effective physics teaching. In Eğitim Bilimleri Araştırmaları V. Özgür Yayınları. https://doi.org/10.58830/ozgur.pub171.c855

Su, K.-D. (2022). Implementation of innovative artificial intelligence cognitions with problem-based learning guided tasks to enhance students’ performance in science. Journal of Baltic Science Education, 21(2), 245–257. https://doi.org/10.33225/jbse/22.21.245

Wang, Y. (2024). Integration of AI technology and ZPD: Pinpointing the zone of student development to promote educational innovation and efficiency improvement. Journal of Education, Humanities and Social Sciences, 38, 99–104. https://doi.org/10.54097/wws14m21

Worthington, P. (2019). Development and validation of a critical thinking framework. SURG Journal, 11. https://doi.org/10.21083/surg.v11i0.5189

Wu, X., & Valente, D. (2020). Adapting differentiated cognitive load measurement in physics classroom. In Physics Education Research Conference Proceedings 2019 (pp. 663–668). American Association of Physics Teachers. https://doi.org/10.1119/perc.2019.pr.Wu

Younis, A. (2025). Advancing learning outcomes in physics education through artificial intelligence integration. European Journal of Education and Pedagogy, 6(5), 34–39. https://doi.org/10.24018/ejedu.2025.6.5.996