A rasch model approach to gender-based thermal concept analysis in East Java high schools

Fian Rifqi Irsalina; Lina Aviyanti; Renaldy Fredyan

doi:10.21067/mpej.v9i1.11007

Authors

Fian Rifqi Irsalina Universitas Pendidikan Indonesia, Indonesia https://orcid.org/0009-0004-1210-5675
Lina Aviyanti Universitas Pendidikan Indonesia, Indonesia https://orcid.org/0000-0003-1152-9703
Renaldy Fredyan National Taiwan University of Science and Technology, Taiwan https://orcid.org/0000-0002-4722-6408

DOI:

https://doi.org/10.21067/mpej.v9i1.11007

Keywords:

Conceptual Ability, Physics Learning, Rasch Model, Thermal Concept Evaluation

Abstract

This research analyzes high school students' understanding of thermal concepts in East Java, focusing on identifying gender-based differences and misconceptions. A descriptive survey with a non-experimental cross-sectional design was conducted using the Thermal Concept Evaluation (TCE) instrument, distributed via Google Forms to 171 students (94 females and 77 males). Data were analyzed using the Rasch model with Winsteps software, providing a detailed diagnosis of student ability levels and item difficulties. The findings revealed significant misconceptions about thermal conductivity and thermal equilibrium, which were challenging for both genders. Male students demonstrated better comprehension of heat transfer and temperature change, while female students showed a slightly higher understanding of boiling concepts. Practical implications include the need for targeted instructional strategies, such as inquiry-based and problem-based learning, incorporating hands-on experiments and technology-based tools like simulations to visualize abstract thermal phenomena. Policymakers and educators are encouraged to adopt conceptual-based curricula, improve laboratory facilities, and provide teacher training programs to address misconceptions and bridge gender gaps in thermal physics education. These strategies aim to enhance students' understanding and prepare them for advanced applications in science and technology.

Downloads

Download data is not yet available.

References

Al-Khatri, H., Alwetaishi, M., & Gadi, M. B. (2020). Exploring thermal comfort experience and adaptive opportunities of female and male high school students. Journal of Building Engineering, 31, 101365. https://doi.org/10.1016/j.jobe.2020.101365

Amiruddin, M. Z. Bin, Samsudin, A., Coştu, B., Suhandi, A., Kaniawati, I., & Apriliyanti, N. (2024). Impressive Analysis of High School Students’ Abilities in Physics Measurement Materials of the New Indonesian-Paradigm Curriculum Via the Rasch Model. JIPF (Jurnal Ilmu Pendidikan Fisika), 9(2), 253–265. https://doi.org/10.26737/jipf.v9i2.4808

Apridonata, W., Syarkowi, A., & Purwanto, A. (2022). Profil Aspek Interpretasi Pemahaman Konsep Materi Kinematika Gerak Lurus pada Siswa SMAN 6 Kota Bengkulu. Jurnal Ilmiah Pendidikan Fisika, 6(3), 591–600. https://doi.org/10.20527/jipf.v6i3.6730

Asriadi, M., & Hadi, S. (2021). Analysis of the Quality of the Formative Test Items for Physics Learning Using the Rasch Model in the 21st Century Learning. JIPF (Jurnal Ilmu Pendidikan Fisika), 6(2), 158–166. https://doi.org/10.26737/jipf.v6i2.2030

Badan Pusat Statistik Provinsi Jawa Timur. (2023, July 20). Jumlah Sekolah Menengah Atas (SMA) di Bawah Kementerian Pendidikan dan Kebudayaan Menurut Kabupaten/Kota di Provinsi Jawa Timur, 2021/2022 dan 2022/2023. Pendidikan.

Badan Pusat Statistik Provinsi Jawa Timur. (2024, February 21). Jumlah Sekolah, Guru, dan Murid Sekolah Menengah Atas (SMA) di Bawah Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi Menurut Kabupaten/Kota di Provinsi Jawa Timur, 2023/2024. Pendidikan - Tabel Statistik.

Baker, B. (2022). Critical Thinking in the Physics Curriculum. AIP Publishing LLC. https://doi.org/10.1063/9780735424234

Bintang, R. S., & Suprananto, S. (2024). The Impact of Sample Size, Test Length, and Person-Item Targeting on the Separation Reliability in Rasch Model: A Simulation Study. JP3I (Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia), 13(1), 1–13. https://doi.org/10.15408/jp3i.v13i1.27975

Boone, W. J., & Staver, J. R. (2020). Advances in Rasch Analyses in the Human Sciences. Springer International Publishing. https://doi.org/10.1007/978-3-030-43420-5

Brown, B., & Singh, C. (2021). Development and validation of a conceptual survey instrument to evaluate students’ understanding of thermodynamics. Physical Review Physics Education Research, 17(1), 010104. https://doi.org/10.1103/PhysRevPhysEducRes.17.010104

Budiarti, I. S., Suparmi, I., Cari, A., Viyanti, V., Winarti, C., & Handhika, J. (2017). Student’s understanding consistency of thermal conductivity concept. In A. G. Abdullah, I. Hamidah, S. Aisyah, A. A. Danuwijaya, G. Yuliani, & H. S. H. Munawaroh (Eds.), Ideas for 21st Century Education (1st Edition, p. 4). Routledge.

Choi, S. W., & Tran, D. H. D. (2016). Calculating sample size. Alpha, Beta, Mu and Sigma – it’s all Greek. Anaesthesia, 71(4), 462–464. https://doi.org/10.1111/anae.13369

Chu, H.-E., Treagust, D. F., Yeo, S., & Zadnik, M. (2012). Evaluation of Students’ Understanding of Thermal Concepts in Everyday Contexts. International Journal of Science Education, 34(10), 1509–1534. https://doi.org/10.1080/09500693.2012.657714

Clayson, D. E. (2018). Student evaluation of teaching and matters of reliability. Assessment & Evaluation in Higher Education, 43(4), 666–681. https://doi.org/10.1080/02602938.2017.1393495

Edwards, A., & Alcock, L. (2010). Using Rasch analysis to identify uncharacteristic responses to undergraduate assessments. Teaching Mathematics and Its Applications, 29(4), 165–175. https://doi.org/10.1093/teamat/hrq008

Fekken, G. C., Holden, R. R., & Cotton, D. H. G. (1999). Person reliability of psychiatric patients’ responses to a psychopathology inventory. Journal of Clinical Psychology, 55(10), 1299–1306. https://doi.org/10.1002/(SICI)1097-4679(199910)55:10<1299::AID-JCLP10>3.0.CO;2-Z

GÜLER, M., & ÖZKAYA, A. (2023). Content Analysis of Studies Conducted Between 2007- 2022 on Misconceptions about the Heat and Temperature. International Journal of Education Technology and Scientific Researches, 8(24), 2134–2151. https://doi.org/10.35826/ijetsar.666

Gunawan, G., Harjono, A., Hermansyah, H., & Herayanti, L. (2019). Guided Inquiry Model Through Virtual Laboratory to Enhance Students’ Science Process Skills on Heat Concept. Jurnal Cakrawala Pendidikan, 38(2), 259–268. https://doi.org/10.21831/cp.v38i2.23345

Hadžibegović, Z., & Sulejmanović, S. (2014). Fundamental thermal concepts understanding: the first-year chemistry student questionnaire results. Bulletin of the Chemists and Technologists of Bosnia and Herzegovina, 42, 21–30.

Hamdu, G., Hadiana, D., Sylvia, N., Apipatunnisa, I., & Yulianto, A. (2023). Measuring Changes of Students Conceptual Understanding of Literacy and Numeracy in Natural Science by Using Rasch Model. Jurnal Ilmiah Sekolah Dasar, 7(3), 489–497. https://doi.org/10.23887/jisd.v7i3.59943

Handayani, Y., Rahmawati, R., & Widiasih, W. (2023). Using Rasch Model to Analyze Reliability and Validity of Concept Mastery Test on Electricity and Magnetism Topic. JIPF (Jurnal Ilmu Pendidikan Fisika), 8(2), 226–239. https://doi.org/10.26737/jipf.v8i2.3877

Handoyo, E. A. (2007). The Interesting of Learning Thermodynamics Through Daily Life. Maranatha Teaching and Learning International Conference 2007 “Teaching and Learning in Higher Education for Developing Countries,” 151–158.

Hartig, J., Hölzel, B., & Moosbrugger, H. (2007). A Confirmatory Analysis of Item Reliability Trends (CAIRT): Differentiating True Score and Error Variance in the Analysis of Item Context Effects. Multivariate Behavioral Research, 42(1), 157–183. https://doi.org/10.1080/00273170701341266

Hayat, B. (2024). Meta-Analysis of Coefficient Alpha: Empirical Demonstration Using English Language Teaching Reflection Inventory. Journal of Curriculum and Teaching, 13(2), 231–243. https://doi.org/10.5430/jct.v13n2p231

Hermann-Abell, C. F., & DeBoer, G. E. (2016). Using Rasch Modeling and Option Probability Curves to Diagnose Students’ Misconceptions. American Association for the Advancement of Science (AAAS), 1–12.

Indratno, T. K., Sukarelawan, Moh. I., Puspitasari, A. D., & Soeharto, S. (2023). Students are Not Sure about Their Conceptual Understanding: A Comparative Study of the Level of Conceptual Understanding and the Level of Confidence Using Rasch Modeling. Indonesian Review of Physics, 6(2), 75–81. https://doi.org/10.12928/irip.v6i2.6901

Krishnan, S., & Idris, N. (2014). Investigating Reliability and Validity for the Construct of Inferential Statistics. International Journal of Learning, Teaching and Educational Research, 4(1), 51–60.

Kruatong, T., Sung-ong, S., Singh, P., & Jones, A. (2006). Thai High School Students’ Understanding of Heat and Thermodynamics. Kasetsart Journal of Social Sciences, 27(2), 321–330.

Latpate, R., Kshirsagar, J., Gupta, V. K., & Chandra, G. (2021). Simple Random Sampling. In R. Latpate, J. Kshirsagar, V. K. Gupta, & G. Chandra (Eds.), Advanced Sampling Methods (pp. 11–35). Springer Singapore. https://doi.org/10.1007/978-981-16-0622-9_2

Li, X. (2022). Field grand challenge for thermal engineering. Frontiers in Thermal Engineering, 2, 1–7. https://doi.org/10.3389/fther.2022.1045838

Linacre, J. M. (1994). Many-Facet Rasch Measurement (MFRM) (Second Edition). MESAPRESS.

Loverude, M. E. (2023). Student Understanding of Thermal Physics. In The International Handbook of Physics Education Research: Learning Physics (pp. 3-1-3–38). AIP Publishing LLCMelville, New York. https://doi.org/10.1063/9780735425477_003

Luera, G. R., Otto, C. A., & Zitzewitz, P. W. (2006). Use of the Thermal Concept Evaluation to Focus Instruction. The Physics Teacher, 44(3), 162–166. https://doi.org/10.1119/1.2173324

Maison, M., Safitri, I. C., & Wardana, R. W. (2020). Identification of Misconception of High School Students on Temperature and Calor Topic using Four-Tier Diagnostic Instrument. EDUSAINS, 11(2), 195–202. https://doi.org/10.15408/es.v11i2.11465

Majdina, N. I., Pratikno, B., & Tripena, A. (2024). Penentuan Ukuran Sampel Menggunakan Rumus Bernoulli dan Slovin: Konsep dan Aplikasinya. Jurnal Ilmiah Matematika Dan Pendidikan Matematika, 16(1), 73. https://doi.org/10.20884/1.jmp.2024.16.1.11230

Malapane, T. A., & Ndlovu, N. K. (2024). Assessing the Reliability of Likert Scale Statements in an E-Commerce Quantitative Study: A Cronbach Alpha Analysis Using SPSS Statistics. 2024 Systems and Information Engineering Design Symposium (SIEDS), 90–95. https://doi.org/10.1109/SIEDS61124.2024.10534753

Malik, A., Wandira, A., Kuntadi, D., & Nugraha, A. R. (2022). How can interactive multimedia direct instruction model improve student cognitive learning outcomes? Momentum: Physics Education Journal, 6(2), 104–118. https://doi.org/10.21067/mpej.v6i2.6686

Masrifah, M., & Amiroh, D. (2023). The multi-representational ability profile of physics students in the interactive multimedia assisted problem-based learning during the Covid-19 pandemic. Momentum: Physics Education Journal, 7(2), 188–200. https://doi.org/10.21067/mpej.v7i2.7501

McClure, F. D., & Lee, J. K. (2005). Sample Sizes Needed for Specified Margins of Relative Error in the Estimates of the Repeatability and Reproducibility Standard Deviations. Journal of AOAC INTERNATIONAL, 88(5), 1503–1510. https://doi.org/10.1093/jaoac/88.5.1503

McEwan, B. (2020). Sampling and validity. Annals of the International Communication Association, 44(3), 235–247. https://doi.org/10.1080/23808985.2020.1792793

Mikielewicz, J., & Mikielewicz, D. (2024). Influence of thermodynamics on the development of technology and science. Archives of Thermodynamics, 45(2), 51–61. https://doi.org/10.24425/ather.2024.150851

Msoma, A. (2020). Baseline, Cross-sectional Survey of Knowledge, Attitudes, and Practices Related to Efficient Use of Government Resources in the Health Sector in Malawi. Malawi Medical Journal, 32(3), 146–152. https://doi.org/10.4314/mmj.v32i3.7

Muthaharoh, S., & Sukarelawan, Moh. I. (2023). Improving high school students’ research skills through light diffraction experiments using the problem-based learning model. Jurnal Riset Dan Kajian Pendidikan Fisika, 10(2), 64–71. https://doi.org/10.12928/jrkpf.v10i2.566

Nopiah, Z. M., Jamalluddin, M. H., Othman, N. A. I. H., Asshaari, I. A., & Osman, M. H. (2012). Reliability Analisis of Examination Questions in a Mathematics Course Using Rasch Measurement Model. Sains Malaysiana , 41(9), 1171–1176.

Nottis, K. E. K., Prince, M. J., & Vigeant, M. A. (2017). Undergraduate Engineering Students’ Understanding of Heat, Temperature, and Energy: An Examination by Gender and Major. US-China Education Review A, 7(3). https://doi.org/10.17265/2161-623X/2017.03.001

Nugraheni, V. Y. S. T., & Mundilarto, M. (2022). Development of 2-D augmented reality integrated physics e-book to improve students’ problem-solving skills. Momentum: Physics Education Journal, 6(2), 171–180. https://doi.org/10.21067/mpej.v6i2.6623

Nuryantini, A. Y., Zakwandi, R., & Ariayuda, M. A. (2022). Smartphone for physics practicum in momentum and impulse. Momentum: Physics Education Journal, 7(1), 48–56. https://doi.org/10.21067/mpej.v7i1.6687

Nusir, S., Alsmadi, I., Al-Kabi, M., & Sharadgah, F. (2013). Studying the Impact of Using Multimedia Interactive Programs on Children’s Ability to Learn Basic Math Skills. E-Learning and Digital Media, 10(3), 305–319. https://doi.org/10.2304/elea.2013.10.3.305

O’Brien, T. C., Palmer, R., & Albarracin, D. (2021). Misplaced trust: When trust in science fosters belief in pseudoscience and the benefits of critical evaluation. Journal of Experimental Social Psychology, 96, 104184. https://doi.org/10.1016/j.jesp.2021.104184

Otoluwa, S. M., Uloli, R., Abdjul, T., Mursalin, Odja, A. H., & Ntobuo, N. E. (2024). The Influence of the PBL Model to Student Learning Outcomes on Heat and its Transfer Concepts. Jurnal Penelitian Pendidikan IPA, 10(7), 4357–4363. https://doi.org/10.29303/jppipa.v10i7.8003

Paek, I., Lee, J., Stankov, L., & Wilson, M. (2013). Rasch modeling of accuracy and confidence measures from cognitive tests. J Appl Meas, 14(3), 232–248.

Park, H.-J., Lee, D., & Park, H. (2023). Understanding students’ problem-solving patterns: Evidence from an allotted response time in a PISA 2012 item. Frontiers in Psychology, 13:1050435, 1–14. https://doi.org/10.3389/fpsyg.2022.1050435

Perdana, R., Asrial, & Maison. (2022). The Impact of Student Motivation on Students’ Science Process Skills. Journal of Education Research and Evaluation, 6(4), 729–738. https://doi.org/10.23887/jere.v6i4.52350

Pipia, E. (2014). Practical strategies for teachers to enhance the degree of reliability and validity in assessment. Journal of Education, 3(1), 47–52.

Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research, 15(2), 020111. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111

Rendón-Macías, M. E., & Villasís-Keever, M. Á. (2017). El protocolo de investigación V: el cálculo del tamaño de muestra. Revista Alergia México, 64(2), 220–227. https://doi.org/10.29262/ram.v64i2.267

Safarati, N., & Lubis, R. H. (2022). Students’ Conceptual Understanding and Critical Thinking Skills Through Online Learning Using a Virtual Laboratory. JIPF (Jurnal Ilmu Pendidikan Fisika), 7(1), 42–49. https://doi.org/10.26737/jipf.v7i1.2221

Salazar, L. M., Díaz, M. H. R., & Slisko, J. (2023). Critical thinking development in physics courses by PBL in virtual collaboration environments. International Journal of Innovation in Science and Mathematics Education, 31(4), 27–39. https://doi.org/10.30722/IJISME.31.04.003

Seibert, S. A. (2021). Problem-based learning: A strategy to foster generation Z’s critical thinking and perseverance. Teaching and Learning in Nursing, 16(1), 85–88. https://doi.org/10.1016/j.teln.2020.09.002

Sevilla, C. G., Ochave, J. A., Punsalan, T. G., Regala, B. P., & Uriarte, G. G. (1993). Pengantar Metode Penelitian: Vol. Cet. 1 (A. Tuwu, Ed.). UI Press.

Singh, S. (2003). Simple Random Sampling. In Advanced Sampling Theory with Applications: Vols. I–II (1st ed., pp. 71–136). Springer Netherlands. https://doi.org/10.1007/978-94-007-0789-4_2

Sofna, A., Zakwandi, R., & Desy Purwasih. (2024). In-depth Analysis of The Learning Process in Schools: Reviewing The Quality of Students’ Actual Mastery of Concepts on Temperature and Heat Material. International Journal of Education and Teaching Zone, 3(1), 82–93. https://doi.org/10.57092/ijetz.v3i1.193

Stylos, G., Christonasis, A., Georgopoulos, K., & Kotsis, K. T. (2023). The impact of an online physics lab on university students’ self-efficacy and understanding of thermal concepts during COVID-19 pandemic. Journal of Mathematics and Science Teacher, 3(2), em049. https://doi.org/10.29333/mathsciteacher/13701

Stylos, G., Sargioti, A., Mavridis, D., & Kotsis, K. T. (2021). Validation of the thermal concept evaluation test for Greek university students’ misconceptions of thermal concepts. International Journal of Science Education, 43(2), 247–273. https://doi.org/10.1080/09500693.2020.1865587

Sudirman, S., Maknun, J., & Hasanah, L. (2017). Penggunaan Model Problem Based Learning Berbantuan Media Kit Eksperimen Inkuiri Terhadap Peningkatan Penguasaan Konsep Siswa Kelas XI SMK Pada Materi Fluida Statis. JIPF (Jurnal Ilmu Pendidikan Fisika), 2(2), 38–41. https://doi.org/10.26737/jipf.v2i2.232

Sukarelawan, Moh. I., Jumadi, J., & Rahman, N. A. (2019). An Analysis of Graduate Students’ Conceptual Understanding in Heat and Temperature (H&T) Using Three-Tier Diagnostic Test. Indonesian Review of Physics, 2(1), 9. https://doi.org/10.12928/irip.v2i1.910

Sukarelawan, Moh. I., Sriyanto, Sa’adah, M., Jupri, J., Hikmah, F. N., & Eko Nursulistiyo. (2024). Is it True That My Students don’t Understand the Static Fluid Concepts? Rasch Modeling Perspective. Jurnal Pendidikan Dan Pengajaran, 57(1), 127–138. https://doi.org/10.23887/jpp.v57i1.57883

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan (1st ed.). Trim Komunikata Publishing House.

Tourangeau, R., Yan, T., & Sun, H. (2020). Who Can You Count On? Understanding The Determinants of Reliability. Journal of Survey Statistics and Methodology, 8(5), 903–931. https://doi.org/10.1093/jssam/smz034

Turgut, U., & Gurbuz, F. (2012). Effect of conceptual change text approach on removal of students’ misconceptions about heat and temperature. International Journal of Innovation and Learning, 11(4), 386. https://doi.org/10.1504/IJIL.2012.047139

Ummah, K., Mardhiya, J., & Mulyanti, S. (2022). Pengembangan Instrumen Tes Penguasaan Konsep Representasi Kimia pada Lima Indikator Asam Basa dari Alam: Analisis dengan Rasch Model. JURNAL TARBIYAH, 29(2), 212–225. https://doi.org/10.30829/tar.v29i2.1706

Villarino, G. N. B. (2023). Fundamental Thermal Concepts: An Assessment of University College Students’ Conceptual Understanding of Everyday Perspectives. Indonesian Journal of Science and Mathematics Education, 6(1), 96–108. https://doi.org/10.24042/ijsme.v6i1.11662

Wartono, Alfroni, Y. F., Batlolona, J. R., & Mahapoonyanont, N. (2019). Inquiry-Scaffolding Learning Model: Its Effect on Critical Thinking Skills and Conceptual Understanding. Jurnal Ilmiah Pendidikan Fisika Al-Biruni, 8(2), 245–255.

Wiyono, K., Sudirman, S., Sury, K., Saparini, S., & Ariska, M. (2021). An Overview of Students’ Conceptual Understanding in Kinematics Using Computer Based Test (CBT) Class XI SMA Negeri 19 Palembang. JIPF (Jurnal Ilmu Pendidikan Fisika), 6(2), 167–177. https://doi.org/10.26737/jipf.v6i2.2037

Yeo, S., & Zadnik, M. (2001). Introductory thermal concept evaluation: assessing students’ understanding. The Physics Teacher, 39(8), 496–504. https://doi.org/10.1119/1.1424603

Zou, T., & Bolt, D. M. (2023). Person Misfit and Person Reliability in Rating Scale Measures: The Role of Response Styles. Measurement: Interdisciplinary Research and Perspectives, 21(3), 167–180. https://doi.org/10.1080/15366367.2022.2114243

Zulrahayu, V., & Mufit, F. (2024). Correlation of Concept Understanding and Students’ Attitudes towards Learning Physics on the Material of Temperature and Heat in Class XI. JIPF (Jurnal Ilmu Pendidikan Fisika), 9(2), 181–191. https://doi.org/10.26737/jipf.v9i2.4654