Evaluation and Calibration of Computerized Attitude Toward Physics Test : A Factor Analysis and Item Response Theory

Innal Mafudi*, Heru Kuswanto, Jumadi Jumadi, Aris Kurniawan, Intan Fatmawati, Nur Inayah Syar

Abstract


Attitude towards physics is one of the key factors in determining the success of physics learning. The solution to ensure a positive attitude towards physics requires a good diagnostic instrument. This study aims to develop an instrument that can measure attitudes toward physics validly and reliably. This study was conducted by validating the instrument with 8 experts physics education. Validation data was analysed using the Vaiken formula a score of 0.90 was obtained, which means that all items are valid. After the validation stage, the instrument was tested on 423 respondents consisting of high school students from the provinces of East Java and Riau. The test data were analysed through four steps: 1) exploratory factor analysis, 2) confirmatory factor analysis, 3) Cronbach's alpha reliability, and 3) item response theory using the graded response model. The EFA results showed that from 16 question items, they resulted in groupings into 4 factors: Teacher and Physics as a Future Vocation, Physics learning, Physics as a Process, and Enthusiasm toward Physics. The reliability of the items based on cronbach's alpha score 0.94 category a very good reliability level. The performance of each item through the IRT GRM analysis shows that the item discrimination power is in the moderate to very high category, and the item support is in the easy to moderate category. The CATP test is feasible and reliable in measuring attitudes toward physics

Keywords


Attitude Toward Physics, Item Response Theory, Factor Analysis

Full Text:

PDF

References


Aiken, L.R. 1985. Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1):131–142. https://doi.org/10.1177/ 0013164485451012

Apino, E., Istiyono, E., Retnawati, H., Widihastuti, W., & Hidayati, K. 2024. Development and calibration of an instrument measuring attitudes toward statistics using classical and modern test theory. Journal of Pedagogical Research, 8(3):63–78. https://doi.org/10. 33902/JPR.202427097

Arlinwibowo, J., Retnawati, H., & Hadi, S. 2024. Aplikasi teori respon butir dengan R dan R studio. Andi Publisher, Yogyakarta.

Baker, F. 2021. The basics of item response theory. (C. Boston & L. Rudner, Eds.). ERIC Clearinghouse on Assessment and Evaluation.

Cahill, M.J., McDaniel, M.A., Frey, R.F., Hynes, K.M., Repice, M., Zhao, J., & Trousil, R. 2018. Understanding the relationship between student attitudes and student learning. Physical Review Physics Education Research, 14(1):1-16 https://doi.org/10.1103/PhysRevPhys EducRes.14.010107

Cermik, H., & Kara, I. 2020. Physics course attitudes scale for high school students: a validity and reliability study. International Journal of Assessment Tools in Education, 7(1):62–72. https://doi.org/10.21449/ijate.693211

Daphine, R., Sivakumar, P., & Selvakumar, S. 2020. A study on student’s attitude towards online computer adaptive test (CAT) in physics education through observation schedule. Journal of Xidian University, 14(5):4703-4708. https://doi.org/10.37896/jxu14.5/517

Dewi, N.P., Rahmi, Y.L., Alberida, H., & Darussyamsu, R. 2020. Validitas dan reliabilitas instrumen penilaian kemampuan berpikir tingkat tinggi ten-tang materi hereditas untuk peserta didik SMA/MA. Jurnal Eksakta Pendidikan (JEP), 4(2):138-146. https://doi.org/ 10.24036/jep/vol4-iss2/512

Djudin, T., & Hadari Nawawi, J.H. 2018. How to cultivate students’ interests in physics: a challenge for senior high school teachers. Jurnal Pendidikan Sains, 6(1):16–22. http://journal.um.ac.id/index.php/jps/

Gürler, S.A., & Baykara, O. 2020. Development of an attitude scale for physics courses and a review of student attitudes. Journal of Baltic Science Education, 19(1):6–24. https://doi.org/10.33225/jbse/20.19.06

Herbiadi, A., Sahala, S., & Arsyid, S.B. 2015. Hubungan antara sikap dengan hasil belajar siswa dalam mata pelajaran fisika di SMA. Jurnal Pendidikan dan Pembelajaran Khatulistiwa (JPPK), 4(5):1-10. https://doi.org/10.26418/jppk.v4i5.10207

Ince, E., Çağap, H., & Deneri, Y. 2020. Development and validation of motivation scale towards physics learning. International Journal of Physics & Chemistry Education, 12(4):61–74. https://doi.org/10.51724/ijpce.v12i4.129

Istiyono, E., Dwandaru, W.S.B., Erfianti, L., & Astuti, W. 2020. Applying CBT in physics learning to measure students’ higher order thinking skills. Journal of Physics: Conference Series, 1440(1):1-7. https://doi.org/10.1088/1742-6596/1440/1/012061

Istiyono, E., Mustakim, S.S., & Mukti, T.S. 2019. Measurement of physics problem-solving skills in female and male students by phystepross. Jurnal Pendidikan IPA Indonesia, 8(2):170–176. https://doi.org/10.15294/jpii.v8i2.17640

Istyono, E. 2020. Pengembangan instrumen penilaian dan analisis belajar fisika dengan teori klasik dan modern. UNY Press.

Jeong, H. 2014. A comparative study of scores on computer-based tests and paper-based tests. Behaviour & Information Technology, 33(4):410–422. https://doi.org/10.1080/0144929X. 2012.710647

Kaur, D., & Zhao, Y. 2017. Development of physics attitude scale (PAS): an instrument to measure students’ attitudes toward physics. Asia-Pacific Education Researcher, 26(5): 291–304. https://doi.org/10.1007/s40299-017-0349-y

Kontro, I., & Buschhüter, D. 2020. Validity of colorado learning attitudes about science survey for a high-achieving, finnish population. Physical Review Physics Education Research, 16(2):1-16. https://doi.org/10.1103/PhysRevPhysEducRes.16.020104

Kurniawan, B.R., Kusairi, S., Puspita, D.A., & Kusumaningrum, R.W. 2021. Development of computer based diagnostic assessment completed with simple harmonic movement material remedial program. Jurnal Pendidikan Fisika Indonesia, 17(1):1–12. https://doi. org/10.15294/jpfi.v17i1.18540

Legree, P.J., & Psotka, J. 2006. Refining situational judgment test methods. https://www. researchgate.net/publication/235012877

Lievens, F., Peeters, H., & Schollaert, E. 2008. Situational judgment tests: a review of recent research. In personnel review. Emerald Group Publishing Ltd. 37(4):426-441. https://doi.org/10.1108/00483480810877598

Liu, S., Xu, S., Li, Q., Xiao, H., & Zhou, S. 2023. Development and validation of an instrument to assess students’ science, technology, engineering, and mathematics identity. Physical Review Physics Education Research, 19(1):1-17. https://doi.org/10.1103/PhysRevPhys EducRes.19.010138

Mcdaniel, M., & Nguyen, N.T. 2001. Situational judgment tests: a review of practice and constructs assessed. International Journal of Selection and Assessment, 6(4):103–113. http://dx.doi.org/10.1111/1468-2389.00167

Muhammad, A.Y.K. 2022. Korelasi antara sikap siswa terhadap hasil belajar fisika pada siswa kelas x Sma Labschool Untad. Jurnal Pendidikan Fisika Tadulako, 9(3):98-102. https://doi.org/10.22487/jpft.v9i3.1652

Nisa, Y.F., Umar, J., Arista, P.D., Widaningrum, H., & Hayat, B. 2022. Development and validation of situational judgement test to measure continuous learning competency. Jurnal Pengukuran Psikologi dan Pendidikan Indonesia, 11(1):34–44. https://doi.org/10.15408/ jp3i.v11i1.25302

Rio, D., Astalini, & Kurniawan, D.A. 2018. Pengembangan instrumen sikap siswa sekolah menengah atas terhadap mata pelajaran fisika. Jurnal Pendidikan Fisika, 7(1):1-7. https://doi.org/10.26714/jps.7.1.2019.1-7

Tiffin, P.A., Paton, L.W., O’Mara, D., MacCann, C., Lang, J.W.B., & Lievens, F. 2020. Situational judgement tests for selection: Traditional vs construct-driven approaches. Medical Education, 54(2):105–115. https://doi.org/10.1111/medu.14011

Wangchuk, D., Wangdi, D., Tshomo, S., & Zangmo, J. 2023. Exploring students’ perceived difficulties of learning physics. Educational Innovation and Practice, 6(1):1-11. https://doi.org/10.17102/eip.6.2023.03

Watson, J.C. 2017. Establishing evidence for internal structure using exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 50(4):232–238. https://doi.org/10.1080/07481756.2017.1336931




DOI: https://doi.org/10.24815/jipi.v9i1.42738

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Jurnal IPA & Pembelajaran IPA


JIPI (Jurnal IPA dan Pembelajaran IPA)

ISSN 2614-0500  (print) | 2620-553X (online)
Organized by Universitas Syiah Kuala 
Published by Master of Science Education Study Program Graduate School Universitas Syiah Kuala, Banda Aceh, Indonesia
Website : http://jurnal.usk.ac.id/jipi
Email     : jipi@usk.ac.id

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.