Implementing the rasch model to assess the level of students' critical and reflective thinking skills on the photoelectric effect

Tarpin Juandi, Ida Kaniawati, Achmad Samsudin, Lala Septem Riza

Abstract

This study aims to determine the level of students’ critical and reflective thinking skills on the topic of photoelectric effects. In this study, the cross-sectional survey approach was employed in conjunction with purposive sampling techniques.  The data collection instruments are questionnaires for critical thinking and reflective thinking skills, with 20 critical thinking items and 24 reflective thinking items. A total of 35 students, 6 males and 29 females, with an average age of 20 years, agreed to fill out the questionnaire that was distributed. The acquired quantitative data were evaluated using the Rasch model, with critical thinking skills showing that 11% of students were at a very low level, 49% were at a low level, 26% were at a high level, and 14% were at a very high level. Meanwhile, data analysis of reflective thinking skills revealed that 20% of pupils had low levels, 63% had moderate levels, and 17% had high levels. As a result, it is suggested that critical thinking and reflective thinking skills be continuously debriefed.

References

Adams, D., Chuah, K. M., Sumintono, B., & Mohamed, A. (2022). Students’ readiness for e-learning during the COVID-19 pandemic in a South-East Asian university: a Rasch analysis. Asian Education and Development Studies, 11(2), 324–339. doi: 10.1108/AEDS-05-2020-0100
Aloisi, C., & Callaghan, A. (2018). Threats to the validity of the collegiate learning assessment (Cla+) as a measure of critical thinking skills and implications for learning gain. Higher Education Pedagogies, 3(1), 57–82. doi: 10.1080/23752696.2018.1449128
Andrich, D., & Marais, I. (2019). A Course in Rasch Measurement Theory: Measuring in the Educational, Social and Health Sciences. In Springer. Singapore. doi: 10.1007/978-981-13-7496-8
Arabatzis, T. (2017). How Physica Became Physics. In Science & Education. Science & Education. doi: https://doi.org/10.1007/s11191-017-9946-7
Azid, N., Ali, R. M., El Khuluqo, I., Purwanto, S. E., & Susanti, E. N. (2022). Higher order thinking skills, school-based assessment and students’ mathematics achievement: Understanding teachers’ thoughts. International Journal of Evaluation and Research in Education (IJERE), 11(1), 290. doi: 10.11591/ijere.v11i1.22030
Boone, W. J., & Staver, J. R. (2020). Correction to: Advances in Rasch Analyses in the Human Sciences. In Springer. Switzerland. doi: 10.1007/978-3-030-43420-5_21
Braun, H. I., Shavelson, R. J., Zlatkin-Troitschanskaia, O., & Borowiec, K. (2020). Performance Assessment of Critical Thinking: Conceptualization, Design, and Implementation. Frontiers in Education, 5(September), 1–10. doi: 10.3389/feduc.2020.00156
Chee Choy, S., Yim, J. S. C., & Sedhu, D. S. (2019). Pre-service teachers’ reflection on reflective practices: A Malaysian perspective. Universal Journal of Educational Research, 7(12), 18–26. doi: 10.13189/ujer.2019.071903
Chiang, C. T., Huth, M., Trützschler, A., Kiel, M., Schumann, F. O., Kirschner, J., & Widdra, W. (2015). Boosting laboratory photoelectron spectroscopy by megahertz high-order harmonics. New Journal of Physics, 17. doi: 10.1088/1367-2630/17/1/013035
Creswell, W. J., & Creswell, J. D. (2018). Research Design: Qualitative, Quantitative adn Mixed Methods Approaches. In Journal of Chemical Information and Modeling (Vol. 53).
Damaianti, V. S., Abidin, Y., & Rahma, R. (2020). Higher order thinking skills-based reading literacy assessment instrument: An Indonesian context. Indonesian Journal of Applied Linguistics, 10(2), 513–525. doi: 10.17509/ijal.v10i2.28600
Darmaji, Kurniawan, D. A., Astalini, Perdana, R., Kuswanto, & Ikhlas, M. (2020). Do a science process skills affect on critical thinking in science? Differences in urban and rural. International Journal of Evaluation and Research in Education, 9(4), 874–880. doi: 10.11591/ijere.v9i4.20687
Erdoğan, F. (2020). The relationship between prospective middle school mathematics teachers’ critical thinking skills and reflective thinking skills. Participatory Educational Research, 7(1), 220–241. doi: 10.17275/per.20.13.7.1
Gómez, R. L., & Suárez, A. M. (2020). Do inquiry-based teaching and school climate influence science achievement and critical thinking? Evidence from PISA 2015. International Journal of STEM Education, 7(1). doi: 10.1186/s40594-020-00240-5
Gülen, S. (2018). Determination the effect of STEM integrated argumentation based science learning approach in solving daily life problems. World Journal on Educational Technology: Current Issues, 10(4), 266-285. doi: 10.18844/wjet.v10i4.4087
Gulomov, J., Aliev, R., Mirzaalimov, A., Mirzaalimov, N., Kakhkhorov, J., Rashidov, B., & Temirov, S. (2021). Studying the effect of light incidence angle on photoelectric parameters of solar cells by simulation. International Journal of Renewable Energy Development, 10(4), 731–736. doi: 10.14710/ijred.2021.36277
Han, K., Heng, L., Zhang, Y., Liu, Y., & Jiang, L. (2019). Slippery Surface Based on Photoelectric Responsive Nanoporous Composites with Optimal Wettability Region for Droplets’ Multifunctional Manipulation. Advanced Science, 6(1). doi: 10.1002/advs.201801231
Hendriana, H., Putra, H. D., & Hidayat, W. (2019). How to design teaching materials to improve the ability of mathematical reflective thinking of senior high school students in Indonesia? Eurasia Journal of Mathematics, Science and Technology Education, 15(12). doi: 10.29333/ejmste/112033
Hermann, G. (2020). The Significance for Natural Philosophy of the Move from Classical to Modern Physics. Journal for General Philosophy of Science, 51(4), 627–629. doi: 10.1007/s10838-020-09533-3
Hernández, G., & Fernández, F. (2018). Diagnostic of electron temperature from bremsstrahlung in overdense targets. Applied Physics B, 0(0), 0. doi: 10.1007/s00340-018-6999-5
Hidayati, N., Zubaidah, S., Suarsini, E., & Praherdhiono, H. (2020). The relationship between critical thinking and knowledge acquisition: The role of digital mind maps-PBL strategies. International Journal of Information and Education Technology, 10(2), 140–145. doi: 10.18178/ijiet.2020.10.2.1353
Ichsan, I. Z., Sigit, D. V., Miarsyah, M., Ali, A., Arif, W. P., & Prayitno, T. A. (2019). HOTS-AEP: Higher order thinking skills from elementary to master students in environmental learning. European Journal of Educational Research, 8(4), 935–942. doi: 10.12973/eu-jer.8.4.935
Jarrah, H. Y. (2019). The impact of using drama in education on life skills and reflective thinking. International Journal of Emerging Technologies in Learning, 14(9), 4–20. doi: 10.3991/ijet.v14i09.7978
Jiménez-Gómez, M. A., Cárdenas-Becerril, L., Velásquez-Oyola, M. B., Carrillo-Pineda, M., & Barón-Díaz, L. Y. (2019). Reflective and critical thinking in nursing curriculum. Revista Latino-Americana de Enfermagem, 27. doi: 10.1590/1518-8345.2861.3173
Kahlke, R., & Eva, K. (2018). Constructing critical thinking in health professional education. Perspectives on Medical Education, 7(3), 156–165. doi: 10.1007/s40037-018-0415-z
Kember, D., Leung, D. Y. P., Jones, A., Loke, A. Y., McKay, J., Sinclair, K., … Yeung, E. (2000). Development of a questionnaire to measure the level of reflective thinking. Assessment and Evaluation in Higher Education, 25(4), 381–395. doi: 10.1080/713611442
Khomitsky, D. V, & Kulakov, D. A. (2020). Scattering of Wave Packets on the Surface of Topological Insulators in the Presence of Potential Barriers with Magnetization. Journal of Experimental and Theoretical Physics, 130(1), 14–27. doi: 10.1134/S1063776120010057
Kim, H. J., Yi, P., & Hong, J. I. (2020). Students’ academic use of mobile technology and higher-order thinking skills: The role of active engagement. Education Sciences, 10(3). doi: 10.3390/educsci10030047
Kulygin, A. K., Kulygin, K. V, & Avilov, A. S. (2020). New Approaches to Precise Measurements of Electron Diffraction Patterns. Crystallography Reports, 65(2), 325–334. doi: 10.1134/S1063774520020145
Ling Lee, W., Chinna, K., & Sumintono, B. (2021). Psychometrics assessment of HeartQoL questionnaire: A Rasch analysis. European Journal of Preventive Cardiology, 28(12), E1–E5. doi: 10.1177/2047487320902322
Lu, K., Yang, H. H., Shi, Y., & Wang, X. (2021). Examining the key influencing factors on college students’ higher-order thinking skills in the smart classroom environment. International Journal of Educational Technology in Higher Education, 18(1), 1–13. doi: 10.1186/s41239-020-00238-7
Miriam, M., & Costa, L. (2019). Analysis of the concept of Meaningful Learning in light of the Ausubel ’ s Theory. Revista Brasileira de Enfermagem, 72(1), 248–255. doi: http://dx.doi.org/10.1590/0034-7167-2017-0691
Murtadho, F. (2021). Metacognitive and critical thinking practices in developing EFL students’ argumentative writing skills. Indonesian Journal of Applied Linguistics, 10(3), 656–666. doi: 10.17509/ijal.v10i3.31752
Mutohhari, F., Sutiman, S., Nurtanto, M., Kholifah, N., & Samsudin, A. (2021). Difficulties in implementing 21st century skills competence in vocational education learning. International Journal of Evaluation and Research in Education, 10(4), 1229–1236. doi: 10.11591/ijere.v10i4.22028
Nitko, A. J., & Brookhart, S. M. (2014). Educational Assessment of Students: Sixth Edition. In Pearson New International Edition. United States of America: Pearson Education.
Nitriani, N., Darsikin, D., & Saehana, S. (2022). Kolb’s learning style analysis in solving HOTS questions for prospective physics teacher students. Momentum: Physics Education Journal, 6(1), 59–72. doi: 10.21067/mpej.v6i1.5593
Noh, S. N. A., Zin, N. A. M., & Mohamed, H. (2020). Serious games requirements for higher-order thinking skills in science education. International Journal of Advanced Computer Science and Applications, 11(6), 211–216. doi: 10.14569/IJACSA.2020.0110627
Pieridou, M., & Kambouri-Danos, M. (2020). Qualitative doctoral research in educational settings: Reflecting on meaningful encounters. International Journal of Evaluation and Research in Education, 9(1), 21–31. doi: 10.11591/ijere.v9i1.20360
Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research : Why measurement matters. Physical Review Physics Education Research, 15(2), 20111. doi: 10.1103/PhysRevPhysEducRes.15.020111
Prieto, M. C., Palma, L. O., & Jes, P. (2019). education sciences Student Assessment of the Use of Kahoot in the Learning Process of Science and Mathematics. Education Sciences, 9(55), 1–13. doi: 10.3390/educsci9010055
Puig, M. S., Sánchez-Martí, A., Ruiz-Bueno, A., & Sánchez-Santamarí, J. (2020). The effects of learning contexts on the development of reflective thinking in university education: Design and validation of a questionnaire. Sustainability (Switzerland), 12(8), 1–18. doi: 10.3390/SU12083298
Pursitasari, I. D., Suhardi, E., Putra, A. P., & Rachman, I. (2020). Enhancement of student’s critical thinking skill through science context-based inquiry learning. Jurnal Pendidikan IPA Indonesia, 9(1), 97–105. doi: 10.15294/jpii.v9i1.21884
Ramadhan, S., Mardapi, D., Prasetyo, Z. K., & Utomo, H. B. (2019). The Development of an Instrument to Measure the Higher Order Thinking Skill in Physics. European Journal of Educational Research, 8(3), 743–751. doi: 10.12973/eu-jer.8.3.743
Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to assess critical thinking and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(1). doi: 10.1186/s40594-020-00208-5
Rosmiati, R., Liliasari, L., Tjasyono, B., Ramalis, T. R., & Satriawan, M. (2020). Measuring level of reflective thinking of physics pre-service teachers using effective essay argumentation. Reflective Practice, 00(00), 1–22. doi: 10.1080/14623943.2020.1777957
Rusland, S. L., Jaafar, N. I., & Sumintono, B. (2020). Cogent Business & Management Evaluating knowledge creation processes in the Royal Malaysian Navy ( RMN ) fleet : Personnel conceptualization , participation and differences Evaluating knowledge creation processes in the Royal Malaysian Navy ( RMN ) fleet . Cogent Business & Management, 07(01), 0–25. doi: 10.1080/23311975.2020.1785106
Sellars, M., Fakirmohammad, R., Bui, L., Fishetti, J., Niyozov, S., Reynolds, R., … Ali, N. (2018). Conversations on critical thinking: Can critical thinking find its way forward as the skill set and mindset of the century? Education Sciences, 8(4). doi: 10.3390/educsci8040205
Soltani, A., & Askarizadeh, G. (2021). How students’ conceptions of learning science are related to their motivational beliefs and self-regulation. Learning and Motivation, 73(January), 101707. doi: 10.1016/j.lmot.2021.101707
Straková, Z., & Cimermanová, I. (2018). Critical thinking development-a necessary step in higher education transformation towards sustainability. Sustainability (Switzerland), 10(10). doi: 10.3390/su10103366
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Asesmen Pendidikan. Bandung: Trim Komunikata.
Sutama, S., Fuadi, D., Narimo, S., Hafida, S. H. N., Novitasari, M., Anif, S., … Adnan, M. (2022). Collaborative mathematics learning management: Critical thinking skills in problem solving. International Journal of Evaluation and Research in Education, 11(3), 1015–1027. doi: 10.11591/ijere.v11i3.22193
Sutarno, S., Setiawan, A., Kaniawati, I., & Suhandi, A. (2019). The development of higher order thinking virtual laboratory on photoelectric effect. JIOP Conf. Series: Journal of Physics: Conf. Series 1157 (2019) 032034. doi: 10.1088/1742-6596/1157/3/032034
Talmantaite, A., Hunt, M. R. C., & Mendis, B. G. (2019). Electron Compton scattering and the measurement of electron momentum distributions in solids. Journal of Microscopy, 00(02020), 1–4. doi: 10.1111/jmi.12854
Tang, J., & Hai, L. (2021). Construction and Exploration of an Intelligent Evaluation System for Educational APP through Artificial Intelligence Technology. International Journal of Emerging Technologies in Learning, 16(5), 17–31. doi: 10.3991/ijet.v16i05.20293
van Peppen, L. M., Verkoeijen, P. P. J. L., Heijltjes, A. E. G., Janssen, E. M., Koopmans, D., & van Gog, T. (2018). Effects of Self-Explaining on Learning and Transfer of Critical Thinking Skills. Frontiers in Education, 3(November), 1–11. doi: 10.3389/feduc.2018.00100
Wahidin, D., & Romli, L. A. M. (2020). Students critical thinking development in the national sciences and mathematics competition in Indonesia: A descriptive study. Jurnal Pendidikan IPA Indonesia, 9(1), 106–115. doi: 10.15294/jpii.v9i1.22240
Wei, S., Chee, C., Looi, K., & Sumintono, B. (2020). Assessing computational thinking abilities among Singapore secondary students : a Rasch model measurement analysis. Journal of Computers in Education, (0123456789). doi: 10.1007/s40692-020-00177-2
Widhiarso, W., & Sumintono, B. (2016). Examining response aberrance as a cause of outliers in statistical analysis. PAID, 98, 11–15. doi: 10.1016/j.paid.2016.03.099
Xu, W., Celestin, S., Pasko, V. P., & Marshall, R. A. (2019). Compton Scattering Effects on the Spectral and Temporal Properties of Terrestrial Gamma-Ray Flashes. Journal of Geophysical Research: Space Physics, (May), 1–11. doi: 10.1029/2019JA026941
Yilmaz, R. (2020). Enhancing community of inquiry and reflective thinking skills of undergraduates through using learning analytics-based process feedback. Journal of Computer Assisted Learning, (2020), 1–13. doi: DOI: 10.1111/jcal.12449
Zach, S., & Ophir, M. (2020). Using simulation to develop divergent and reflective thinking in teacher education. Sustainability (Switzerland), 12(7). doi: 10.3390/su12072879

Authors

Tarpin Juandi
tarpin.student@upi.edu (Primary Contact)
Ida Kaniawati
Achmad Samsudin
Lala Septem Riza
Juandi, T., Kaniawati, I., Samsudin, A., & Riza, L. S. (2023). Implementing the rasch model to assess the level of students’ critical and reflective thinking skills on the photoelectric effect. Momentum: Physics Education Journal, 7(2), 220–231. https://doi.org/10.21067/mpej.v7i2.8252

Article Details