Item analysis of a creative thinking skills test on dynamic fluids material

Brilliana Ghorbiy; Parno Parno; Ahmad Taufiq

doi:10.21067/mpej.v10i1.12277

Authors

Brilliana Ghorbiy Universitas Negeri Malang, Indonesia
Parno Parno Universitas Negeri Malang, Indonesia
Ahmad Taufiq Universitas Negeri Malang, Indonesia

DOI:

https://doi.org/10.21067/mpej.v10i1.12277

Keywords:

Creative thinking, Dynamic fluids, Item analysis, Test instrument

Abstract

Creative thinking skills are essential in physics learning because students are required not only to understand formulas, but also to generate ideas, solve contextual problems, and explain scientific phenomena creatively. However, most physics assessments still emphasize procedural calculations and have not comprehensively measured students’ creative thinking skills, particularly in dynamic fluid learning. Therefore, this study aims to examine the quality of essay test items developed to assess students’ creative thinking skills in the context of dynamic fluids. A descriptive quantitative approach was employed involving 120 students who had previously studied dynamic fluids. The developed instrument consisted of four contextual essay questions representing the indicators of fluency, flexibility, originality, and elaboration. Data analysis was conducted using SPSS version 30.0 through empirical validity testing, reliability analysis, item difficulty level, and discrimination index analysis. The results showed that all items had very high validity coefficients (r = 0.827–0.946; p < 0.001), indicating strong construct validity. The instrument also demonstrated very high reliability with a Cronbach’s Alpha coefficient of 0.908. Furthermore, all items were categorized as having moderate difficulty levels (0.476–0.526) and good to very good discrimination indices (0.694–0.899). These findings indicate that the developed instrument is effective for measuring students’ creative thinking skills in dynamic fluid learning. The novelty of this study lies in the development of a contextual essay-based assessment instrument specifically designed for dynamic fluid topics, where each item explicitly represents one indicator of creative thinking. This study contributes to the development of more meaningful creative thinking assessments in physics education.

Downloads

Download data is not yet available.

References

Akdemir-Beveridge, Z. G., Zaghi, A., & Syharat, C. (2025). Understanding and Evaluating Engineering Creativity: Development and Validation of the Engineering Creativity Assessment Tool (ECAT). arXiv preprint arXiv: https://doi.org/10.48550/arXiv.2504.12481

Anshari, M. I., Nasution, R., Irsyad, M., Alifa, A. Z., & Zuhriyah, I. A. (2024). Analisis Validitas dan Reliabilitas Butir Soal Sumatif Akhir Semester Ganjil Mata Pelajaran PAI. Edukatif: Jurnal Ilmu Pendidikan, 6(1), 964–975. https://doi.org/10.31004/edukatif.v6i1.5931

Ashraf, Z. A., & K., J. (2020). Classical and Modern Methods in Item Analysis of Test Tools Assistant Professor of Clinical Psychology, IMHANS, Kozhikode. International Journal of Research and Review (Ijrrjournal.Com), 7(5), 397–403.

Asriadi, M., & Istiyono, E. (2020). Exploration of Creative Thinking Skills of Students in Physics Learning. Journal of Educational Science and Technology (EST), 6, 151–158. https://doi.org/10.26858/est.v6i2.12737

Athiyyah, R., Feranie, S., & Ramalis, T. R. (2022). Development of Sceintific Process-Creative Skills (SP-CS) Test on Light Wave Concept: Content Validity and Rasch Model Analysis. Edusains, 14(2), 111–125. https://doi.org/10.15408/es.v13i2.28025

Bhakti, Y. B., Arthur, R., & Supriyati, Y. (2024). The Content Validity: Multiple Choices Complex Physics Instrument to Measure Critical Thinking Skills. JIPF (Jurnal Ilmu Pendidikan Fisika), 9(1), 56–64. https://doi.org/10.26737/jipf.v9i1.4765

Cahya, R., Rokhmat, J., & Gunada, I. W. (2022). Validity of Learning Tools Creative Problem Solving Models to Improve Students’ Physics Problem-Solving Ability. Jurnal Pendidikan Fisika, 10(1), 43–48. https://doi.org/10.24252/jpf.v10i1.27246

Dhanil, M., Putri, F. A., Desnita, D., & Usmeldi, U. (2024). Analysis of the Use of Dynamic Fluid Learning Media. Physics Education Research Journal, 6(1), 39–46. https://doi.org/10.21580/perj.2024.6.1.16364

Dorsah, P. (2026). The Use of Cronbach’s Alpha Reliability in Educational Research: A Systematic Review. European Journal of Contemporary Education and E-Learning, 4(2), 39–50. https://doi.org/10.59324/ejceel.2026.4(2).04

Doyan, A., Susilawati, S., Annam, S., Muliyadi, L., Megahati, R. R. P., Hutabarat, R. A., Ikhsan, M., Ardianti, N. R., & Hamidi, H. (2024). Trends Research Creative Thinking Skills in Students’ Physics Learning (2015-2024): A Systematic Review. Jurnal Penelitian Pendidikan IPA, 10(6), 333–342. https://doi.org/10.29303/jppipa.v10i6.7826

Fauzie, M., Pada, A. U. T., & Supriatno, S. (2021). Analysis of the Difficulty Index of Item Bnk According to Cognitive Aspects during the Covid-19 Pndemic. Jurnal Penelitian Dan Evaluasi Pendidikan, 25(2), 162–169. https://doi.org/10.21831/pep.v25i2.42603

Ghorbiy, B., Sutopo, S., & Purwaningsih, E. (2024). Systematic Literature Review: Analysis of Implementation Trends of STEM-Based Physics Learning on Dynamic Fluid Material. Jurnal Riset Dan Kajian Pendidikan Fisika, 11(2), 71–79. https://doi.org/10.12928/jrkpf.v11i2.809

Kholid, K., Hidayat, S., & Syafrizal, S. (2022). Pengembangan Instrumen Penilaian Kreativitas B. Eduscience: Jurnal Ilmu Pendidikan, 8(1). https://doi.org/10.47007/edu.v8i02.6907

Magara, E., Copriady, J., & Linda, R. (2021). Validity of Assessment Instruments for Students Creative Thinking Ability on Hydrocarbon Material. Al-Ishlah: Jurnal Pendidikan, 13(1), 49–60. https://doi.org/10.35445/alishlah.v13i1.264

Marie, S. M. J. A., & Edannur, S. (2015). Relevance of Item Analysis in Standardizing an Achievement Test in Teaching of Physical Science in B.Ed Syllabus. I-Manager’s Journal of Educational Technology, 12(3), 30–36. https://doi.org/10.26634/jet.12.3.3743

Misbah, M., Hamidah, I., Sriyati, S., & Samsudin, A. (2023). Research Trend of Dynamic Fluid in Learning: A Bibliometric Analysis. JPPPF (Jurnal Penelitian Dan Pengembangan Pendidikan Fisika), 9(2), 263–272. https://doi.org/10.21009/1

Nacion, R. H. (2024). Development and Validation of an Assessment Tool for Measuring Innovative Thinking in STEM Students. Applied Research and Innovation, 2(2), 1–12. https://doi.org/10.54536/ari.v2i2.3471

Newton, D. P., Nolan, S., & Rees, S. (2022). Creative thinking in physics. In Creative Thinking in University Physics Education (pp. 1-1-1–13). IOP Publishing. https://doi.org/10.1088/978-0-7503-4028-1ch1

Paskalin, G., & Susanti, M. M. I. (2020). Item Analysis of Force Material Problem in Elementary School. DIDAKTIKA: Jurnal Pendidikan Sekolah Dasar, 3(1), 23–32. https://doi.org/10.21831/didaktika.v3i1.31431

Peligro, V. C. (2023). The Role of Item Analysis in Detecting and Improving Faulty Multiple-Choice Test. Teaching and Teacher Education, (132). https://www.sciencedirect.com/journal/social-science-and-medicine

Permana, G. A., Parno, P., Hidayat, A., & Ali, M. (2021). Improving Creative Thinking Skill of Fluid Dynamic through IBL-STEM with Formative Assessment. AIP Conference Proceedings, 2330, 050016. https://doi.org/10.1063/5.0043128

Putra, Y. A., & Hufri, H. (2022). Validity of Physics Module Integrating Creative Thinking Ability in Momentum and Impulse Materials. Pillar of Physics Education, 15(3), 200–208. https://doi.org/10.24036/13515171074

Putri, R. M., Akmam, A., Mufit, F., Sari, S. Y., & Hidayat, R. (2022). Analysis of Student’s Creative Thinking Ability in Computation Physics Course. Gravity: Jurnal Ilmiah Penelitian Dan Pembelajaran Fisika, 8(2), 78–86. https://doi.org/10.30870/gravity.v8i2.13783

Ramly, S. N. F., Ahmad, N. J., & Yakob, N. (2022). Development, Validity, and Reliability of Chemistry Scientific Creativity Test for Pre-University Students. International Journal of Science Education, 44(14), 1–16. https://doi.org/10.1080/09500693.2022.2116298

Reynolds, C. R., Altmann, R. A., & Allen, D. N. (2021). Item Analysis: Methods for Fitting the Right Items to the Right Test. In C. R. Reynolds, R. A. Altmann, & D. N. Allen (Eds.), Mastering Modern Psychological Testing (pp. 263–289). Springer International Publishing. https://doi.org/10.1007/978-3-030-59455-8_7

Said, M. A., Ilham, I., & Kadir, M. F. A. (2024). Fostering Creativity to Enhance Physics Achievement: An Analysis of the Relationship Between Creative Thinking Ability and Student Learning Outcomes. Unnes Science Education Journal, 13(3), 180–188. https://doi.org/10.15294/usej.v13i3.14516

Sapulete, H., Wenno, I. H., Tuhurima, D., & Dulhasyim, A. B. P. (2023). Analysis of Creative Thinking Skills Based on Contextual Teaching and Learning in Physics Education Students. Jurnal Penelitian Pendidikan IPA, 9(7), 5492–5497. https://doi.org/10.29303/jppipa.v9i7.3691

Schmucker, R., & Moore, S. (2025). The Impact of Item-Writing Flaws on Difficulty and Discrimination in Item Response Theory. ArXiv. https://doi.org/https://doi.org/10.48550/arXiv.2503.10533

Suruchi, S., & Rana, S. S. (2014). Test Item Analysis and Relationship Between Difficulty Level and Discrimination Index of Test Items in an Achievement Test in Biology Education. Paripex - Indian Journal of Research, 3(6), 56–58.

Tanjung, Y. I., & Nasution, I. R. (2023). The Development of Creative Thinking Test Instruments with Torrance Indicators on Direct Current Electricity Materials. Jurnal Pendidikan Fisika Indonesia, 18(2), 134–143. https://doi.org/10.15294/jpfi.v18i2.32117

Tavakol, M., & Dennick, R. (2011). Making Sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd

Thorndike, R. M., & Thorndike-Christ, Tracy. (2014). Measurement and Evaluation in Psychology and Education (8th ed.). Pearson.

Utama, A. S., Rosidin, U., & Suyatna, A. (2021). Instrument of Creative Thinking Skills in Project Based Learning Physics. Indonesian Journal of Science and Mathematics Education, 4(1), 58–68. https://doi.org/10.24042/ijsme.v4i1.8572

Vaidya, A. (2020). Teaching and Learning of Fluid Mechanics. Fluids, 5(2), 49. https://doi.org/10.3390/fluids5020049

Viyanti, Herliani, D., & Rosidin, U. (2022). Strengthening Creative Thinking Ability: A Project-Based Physics Assessment Instrument. Impulse: Journal of Research and Innovation in Physics Education, 2(2), 107–118. https://doi.org/10.14421/impulse.2022.22.05

Wati, M., Lestari, D. M., & Mahtari, S. (2024). The Effect of Digital Worksheets on Dynamic Fluids with Authentic Learning in Training Problem-Solving Skills. Jurnal Ilmiah Pendidikan Fisika, 8(2), 266. https://doi.org/10.20527/jipf.v8i2.9245

Wörner, S., Becker, S., Küchemann, S., Scheiter, K., & Kuhn, J. (2022). Development and validation of the Converging Lenses Concept Inventory for Middle School Physics Education. ArXiv. https://doi.org/10.48550/arXiv.2205.09861

Zafrullah, Z., Kastara, R., Riantoro, E. S., & Bakti, A. A. (2024). Analisis Butir Soal dengan ITEMAN 4.0 pada Penilaian Akhir Semester Sekolah Dasar. Pendas: Jurnal Ilmiah Pendidikan Dasar, 9(1), 5813–5823. https://doi.org/10.23969/jp.v9i1.8777

Zain, A. Z., Ramalis, T. R., & Muslim, M. (2022). Karakterisasi Instrumen Tes Keterampilan Bepikir Kreatif Berdasarkan Analisis Partial Credit Model. Jurnal Ilmiah Pendidikan Fisika, 6(1), 176. https://doi.org/10.20527/jipf.v6i1.4806

Zakiyah, S., Suwarma, I. R., & Rusdiana, D. (2024). Constructing Assessment for Evaluating Critical Thinking and Creative Problem-Solving Skills in the Lesson on Soundwave. Jurnal Penelitian Pendidikan IPA, 10(8), 4614–4622. https://doi.org/10.29303/jppipa.v10i8.8332