Validity and reliability scientific literacy-based physics assessment instrument on atomic nucleus and radioactivity material

Ladika Zuhrotul Wardi; Mukhayyarotin Niswati Rodliyatul Jauhariyah

doi:10.21067/mpej.v9i1.10450

Authors

Ladika Zuhrotul Wardi Universitas Negeri Surabaya, Indonesia
Mukhayyarotin Niswati Rodliyatul Jauhariyah Universitas Negeri Surabaya, Indonesia

DOI:

https://doi.org/10.21067/mpej.v9i1.10450

Keywords:

Assessment instruments, scientific literacy, Atomic nucleus , radioactivity

Abstract

Indonesia has a low level of scientific literacy, so it is necessary to make efforts for teachers to develop appropriate assessments or assessment instruments. In this research, a physics assessment instrument will be developed based on scientific literacy on atomic nuclei and radioactivity with the aim that the resulting instruments are good and feasible to use. This research is a type of development research. The feasibility analysis of the assessment instruments in this study included validity, reliability, level of difficulty, and differentiability. The assessment instrument will be validated by three expert lecturers as validators. The test subjects in this study were 35 first-year students of the Physics Education Study Program, at Surabaya State University. Based on the results of data analysis, it can be concluded that the scientific literacy-based physics assessment instrument on atomic nuclei and radioactivity developed has a logical validity value for the content domain of 100% in the very valid category, the construction domain of 92.85% in the valid category, and the language by 85.71% with very valid category. As for the empirical validity value, 50% of the questions are in the valid category and 50% are in the invalid category. The reliability value is 0.492 which means reliable. Furthermore, for the difficulty level of the items, 20% of the questions were in the easy category, 65% of the questions in the moderate category, and 15% of the questions in the difficult category. As well as for the discriminating power of the items, 10% of the items were in the good category, 35% were in the sufficient category, and 55% were in the less category.

Downloads

Download data is not yet available.

References

Aina, J. K., Opeyemi, B. A., & Olu, A. M. (2020). Assessment of scientific literacy skills of college of education students in Nigeria. American Journal of Social Sciences and Humanities, 5(1), 207–220.

Anibo, Z., Gebeyehu, D., & Assefa, S. (2022). Assessing college students ’ factual , conceptual , and procedural knowledge of newton ’ s laws of motion. Momentum: Physics Education Journal, 6(2), 199–213.

Appiah-twumasi, E. (2024). Scaffolding as a cognitive load reduction strategy for teaching atomic and nuclear physics. Momentum: Physics Education Journal, 8(2), 194–209. https://doi.org/10.21067/mpej.v8i2.9580

Apriyani, Y., Supriyati, Y., & Margono, G. (2021). The Influence of Learning Models on Scientific Literacy in Physics Course: A Meta-Analysis Research. International Journal of Science and Society, 3(4), 44–51. https://doi.org/10.54783/ijsoc.v3i4.392

Arafah, K., Amin, B. D., Sari, S. S., & Hakim, A. (2021). The Development of Higher Order-Thinking Skills (HOTS) Instrument Assessment in Physics Study. Journal of Physics: Conference Series, 1899(1), 12140. https://doi.org/10.1088/1742-6596/1899/1/012140

Arikunto, S. (2012). Dasar-Dasar Evaluasi Pendidikan.

Astuty, E., & Angkejaya, O. W. (2022). Pelatihan Sterilisasi Alat Dan Bahan Medis Pada Anggota Tim Bantuan Medis Vertebrae Fakultas Kedokteran Universitas Pattimura. Society : Jurnal Pengabdian Masyarakat, 1(5), 284–290. https://doi.org/10.55824/jpm.v1i5.137

Azizahwati, A., Januarti, J., Sari, S. W., Sari, R. A., Ranti, L., & Septyowaty, R. (2023). Meta analysis of the effect of STEM application on higher order thinking skill in science learning. Momentum: Physics Education Journal, 7(1), 154–163. https://doi.org/10.21067/mpej.v7i1.7959

Borich, G. D. (1994). Observation Skill for Effective Teaching. Macmillan Publishing Company.

Cardoso, P. S. S., Nunes, M. C. S., Silva, G. P. S., Braghittoni, L. S., & Trindade, N. M. (2020). Conceptions of high school students on atomic models, radiation and radioactivity. Physics Education, 55(3), 35030. https://doi.org/10.1088/1361-6552/ab7fc6

Dakhi, O., Jama, J., Irfan, D., Ambiyar, & Ishak. (2020). BLENDED LEARNING: A 21ST CENTURY LEARNING MODEL AT COLLEGE. International Journal of Multi Science, 1(7), 50–65.

Danar, I., Irawan, A., & Kurniawan, B. R. (2025). Effect of isomorphic problems with feedback to reduce student misconceptions on simple harmonic motion. Momentum: Physics Education Journal, 9(5), 1–13. https://doi.org/10.21067/mpej.v9i1.10048

Deta, U. A., Ayun, S. K., Laila, L., Prahani, B. K., & Suprapto, N. (2023). PISA science framework 2018 vs 2025 and its impact in physics education:Literature review. Momentum: Physics Education Journal, 8(1), 95–107.

Dewi, C. A., Erna, M., Martini, M., Haris, I., & Kundera, I. N. (2021). The Effect of Contextual Collaborative Learning Based Ethnoscience to Increase Student ’ s Scientific Literacy Ability. Journal of Turkish Science Education, 18(3), 525–541.

Elisa, N., Kusairi, S., Sulur, S., & Suryadi, A. (2019). The Effect of Assessment for Learning Integration in Scientific Approach Towards Students ’ Conceptual Understanding on Work and Energy. Momentum: Physics Education Journal, 3(2), 103–110.

Erfianti, L., Istiyono, E., & Kuswanto, H. (2019). Developing Lup Instrument Test to Measure Higher Order Thinking Skills (HOTS) Bloomian for Senior High School Students. International Journal of Educational Research Review, 320–329. https://doi.org/10.24331/ijere.573863

Jacob, B., & Rothstein, J. (2016). The measurement of student ability in modern assessment systems. Journal of Economic Perspectives, 30(3), 85–107. https://doi.org/10.1257/jep.30.3.85

Ke, L., Sadler, T. D., Zangori, L., & Friedrichsen, P. J. (2021). Developing and Using Multiple Models to Promote Scientific Literacy in the Context of Socio ‑ Scientific Issues. Science and Education, 30, 589–607. https://doi.org/10.1007/s11191-021-00206-1

Kurniawan, E. S., Mundilarto, M., & Istiyono, E. (2020). Synectic HOTS oriented: Development of teaching materials for high school physics learning. Universal Journal of Educational Research, 8(11), 5547–5554. https://doi.org/10.13189/ujer.2020.081158

Lestari, T. P., Sarwi, S., & Sumarti, S. S. (2018). STEM-based Project Based Learning model to increase science process and creative thinking skills of 5th grade. Journal of Primary Education. https://journal.unnes.ac.id/sju/index.php/jpe/article/view/21382

Mulyana, V., & Desnita. (2023). Empirical Validity and Reliability of the Scientific Literacy Assessment Instrument Based on the Tornado Physics Enrichment Book. Jurnal Penelitian Pendidikan IPA, 9(5), 3961–3967. https://doi.org/10.29303/jppipa.v9i5.3290

Nurhayati, Y., Sopandi, W., & Riandi, R. (2023). Scientific Literacy Profile of Pre-Service Elementary School Teacher Students. Jurnal Penelitian Pendidikan IPA, 9(7), 5474–5480. https://doi.org/10.29303/jppipa.v9i7.3510

OECD. (2019). PISA 2018 Assessment and Analytical Framework, PISA. In OECD Publishing. https://doi.org/10.1787/b25efab8-en

OECD. (2023). Equity in education in PISA 2022. In PISA 2022 Results (Volume I): The State of Learning and Equity in education (Vol. 1). https://www.oecd-ilibrary.org/education/pisa-2022-results-volume-i_03c74bdd-en

Parcon, R. E. (2022). Task-Based Instruction in teaching 21st Century literature from the Philippines and the world: Learners’ views and reflections. ELT Forum: Journal of English Language Teaching, 11(1), 41–51. https://doi.org/10.15294/elt.v11i1.52493

Radzi, M., Bakar, A., Halim, L., & Mohamad, N. (2023). Factor Influencing Students ’ Scientific Literacy : An Exploratory Factor Analysis. International Journal of Academic Research in Business & Social Sciences, 13(12), 5056–5075. https://doi.org/10.6007/IJARBSS/v13-i12/20393

Rini, E. F. S., & Aldila, F. T. (2023). Practicum Activity : Analysis of Science Process Skills and Students ’ Critical Thinking Skills. Integrated Science Education Journal, 4(2), 54–61. https://doi.org/10.37251/isej.v4i2.322

Rizaldi, D. R., Fatimah, Z., Sciences, N., & Study, E. (2020). The Correlation of Digital Literation and STEM Integration to Improve Indonesian Students ’ Skills in 21st Century. International Journal of Asian Education, 01(2), 73–80.

Rosana, D., Widodo, E., Setyaningsih, W., & Warno, D. S. (2020). DEVELOPING ASSESSMENT INSTRUMENTS OF PISA MODEL TO MEASURE STUDENTS ’ PROBLEM -SOLVING SKILLS AND SCIENTIFIC LITERACY IN JUNIOR HIGH SCHOOLS. Jurnal Pendidikan Sains Indonesia, 8(2), 292–305. https://doi.org/10.24815/jpsi.v8i2.17468

Saputra, W. T., Rochintaniawati, D., & Agustin, R. R. (2024). The Role of Learning Models in Enhancing Scientific Literacy : A Critical Review Evaluation. Prisma Sains: Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA, 12(3), 462–476.

Shofiyah, N., Mauliana, M. I., Istiqomah, I., & Wulandari, R. (2021). STEM Approach: The Development of Optical Instruments Module to Foster Scientific Literacy Skill. Jurnal Penelitian Dan Pengkajian Ilmu Pendidikan: E-Saintika, 5(2), 92–103. https://doi.org/10.36312/esaintika.v5i2.388

Sholikah, L., & Pertiwi, F. N. (2021). Integrative Science Education and Teaching Activity Journal Analysis of Science Literacy Ability of Junior High School Students Based on Programme for International Student Assessement ( PISA ). Integrative Science Education and Teaching Activity Journal, 2(1), 95–104.

Sugiyono, S. (2015). Statistik Untuk Penelitian. Alfabeta.

Sumarni, W., Supardi, K. I., & Widiarti, N. (2018). Development of assessment instruments to measure critical thinking skills. IOP Conference Series: Materials Science and Engineering, 349(1). https://doi.org/10.1088/1757-899X/349/1/012066

Suprapto, E., Saryanto, Sumiharsono, R., & Ramadhan, S. (2020). The Analysis of Instrument Quality to Measure the Students ’ Higher Order Thinking Skill in Physics Learning. Journal of Turkish Science Education, 17(4), 520–527. https://doi.org/10.36681/tused.2020.42

Tyan, P. H., Rahman, F. A., & Sarvestani, M. S. (2020). Teachers’ readiness in implementing and facilitating 21st century learning. Universal Journal of Educational Research, 8(1 A), 24–29. https://doi.org/10.13189/ujer.2020.081304

Wahyu, Y., Suastra, I. W., Sadia, I. W., & Suarni, N. K. (2020). The Effectiveness of Mobile Augmented Reality Assisted STEM-Based Learning on Scientific Literacy and Students ’ Achievement. International Journal of Instruction, 13(3), 343–356.

Wulandari, S., Purdhiyah, P., & Annovasho, J. (2022). Studi Literatur : Penerapan E-Book Dalam Pembelajaran Fisika. Jurnal Pendidikan Fisika Dan Sains, 5(02), 7–17.

Zuhdi, M., Gunada, I. W., & Taufik, M. (2024). Uji Instrumen Penguasaan Konsep Fisika Pada Pokok Bahasan Elastisitas Dan Hukum Hooke. Kappa Journal, 8(1), 57–61.