Developing Assessment Instruments of PISA Model to Measure Students’ Problem-Solving Skills and Scientific Literacy in Junior High Schools

Dadan Rosana, Eko Widodo, Wita Setianingsih, Didik Setyawarno

Abstract


This study aims at producing an assessment instrument of the PISA model to measure students’ problem-solving skills and scientific literacy in junior high schools that are valid, practical, and having potential effects. This research employed the design of development studies. The analysis used the Item Response Theory (IRT) Rasch model based on the junior high school students' responses to the developed PISA assessment instrument on natural science subjects. The result of this study was a test set of PISA model for the material of Vibration, Wave, and Sound consisting of 40 items. The test was valid in terms of content, constructs, and language according to the expert assessment, and practical based on small group trials. It also had a potential effect based on the students’ answers and questionnaires results in the field test. The qualitative analysis showed that the developed test had several potential effects, i.e. the development of students' problem-solving skills and scientific literacy so that they gained a relatively high ability to solve a test with the PISA model. The results of quantitative analysis through field test trials showed that there was a significant effect from the application of the PISA model test to enhance students’ scientific literacy and problem-solving skills in the junior high school with the Sig. value of 0.000 which was less than the significance level of 0.05 (α = 5%).

Keywords


assessment instruments, PISA models, problem-solving skills, scientific literacy

Full Text:

PDF

References


Allen, M.J., & Yen, W.M. 1979. Introduction to measurement theory. California: Brooks/Cole Publishing Company Wardsworth, Inc.

Bakker, A. 2004. Design research in statistics education: On symbolizing and computer tools. California: Brooks/Cole Publishing Company Wardsworth, Inc.

Busyairi, A & Sinaga, P. 2015. Profil keterampilan pemecahan masalah secara kreatif siswa SMA pada pokok bahasan listrik dinamis. Prosiding Seminar Nasional Fisika (E-Journal) SNF2015. 4: 23-28.

Darwanti, A. 2013. Upaya Peningkatan Hasil Belajar IPA dengan Creative Approach pada Siswa Kelas V SDN 03 Karangsari Jatiyoso Tahun Pelajaran 2012/2013. Skripsi Tidak dterbitkan. Surakarta: UMS. Tersedia pada http://e prints.um.s.ac.id/23060/21/NAS KAH_PUBLIKASI.pdf (diakses tanggal 13 Mei 2018).

Diana, S., Rachmatulloh, A., & Rahmawati, E. S. 2015. Profil kemampuan literasi sains siswa SMA berdasarkan instrumen scientific literacy assesments (SLA). Prosiding Seminar Nasional XII Pendidikan Boilogi FKIP UNS 2015. Solo: Universitas Sebelas Maret.

Edelson, D. C. 2002. Design research: What we learn when we engage in design. The Journal of the Learning Sciences, 11(1), 105–121

Egan, K.L., Sireci, S.G., Swaminathan, H., & Sweeney, K.P. 1998. Effect of item bundling on the assessment of test dimentionality. Paper presented at the Annual Meeting of the National Council on Measurement in Education. San Diego, California.

Fernandes, H.J.X. 1984. Testing and measurement. Jakarta: National Education Planning, Evaluation, and Curriculum Development.

Field, A. 2009. Discovering statistics using SPSS (3rd Ed). London: Sage Publication Ltd

Hambleton, R.K., Swaminathan, H., & Rogers H.J. 1991. Fundamental of item response theory. London: Sage Publication.

Hambleton, R.K., & Swaminathan, H. 1985. Items response theory: principles and application. Boston: Kluwer-Nijjhoff Publish.

Hambleton, Ronald K.; Rovinelli, Richard J.. 1986. Assessing the dimensionality of a set of test items. Retrieved from the University of Minnesota Digital Conservancy, http://hdl.handle.net/11299/102792.

Hariawan, Kamaluddin, & Wahyono, U. 2014. Pengaruh Model Pembelajaran Creative Probem Solving Terhadap Kemampuan Pemecahan Masalah Fisika pada Siswa Kelas XI SMA Negeri 4 Palu. Jurnal Pendidikan Fisika Tadulako, 1(2), 48-54.

Jacoby, W.G. (Desember 2012). Multidimentional scaling: an introduction. Paper presented at the Workshop in Methods Indiana University. Bloomington, US.

Johar, R. 2012. Domain PISA untuk literasi sains. Jurnal Peluang, 1(1), 30–41.

Jonassen, D. H. 2011. Learning to Solve Problems: A Handbook for Designing Problem-Solving Learning Environments. New York and London: Roudledge.

Johnson, R.A., & Wichern, D.W. 2002. Applied multivariate statistical analysis. New Jersey: Prentice Hall.

Karisan, D. & Zeidler, D.L. 2017. Contectualization of Nature of Science withihn the Socioscientific Issue Framework: A Review of Research. International Journal of Education in Mathematics, Science, and Technology. 5(2), 139-152. https://doi.org/10.18404/ijemst.270186

Kartowagiran, B. 2012 . Penulisan butir soal. Makalah disajikan dalam Pelatihan penulisan dan analisis butir soal bagi Sumber daya PNS Dik-Rekinpeg, di Hotel Kawanua Aerotel, Jakarta.

Kohar, A. W. 2040a. Developing PISA like Mathematics Tasks to Promote Students ’ Mathematical Literacy. In Proceeding the 2nd SEA-DR (pp. 40– 26). Palembang.

Kohar, A. W. 2040b. Pengembangan Soal Sains Model PISA: Sebuah Alternatif Langkah Awal Memperbaiki Prestasi Literasi Sains Siswa Indonesia.

Linacre, J.M. 2012. A user’s guide to winsteps-ministeps rasch model computer program (program manual 3.75.0). ISBN 0-941938-03-4

Linacre, J.M. 2002. What do infit and outfit mean-square and standardized mean?. Rasch Measurement Transaction, 16, 878.

Linn, R.L. 1989. Education measurement (3th Ed). New York: MacMillan Publishing Company.

Mardapi, D. 2012. Pengukuran, penilaian, dan evaluasi pendidikan. Yogyakarta: Nuha Litera.

Memnun, D.S., et al. 2012. A Research on The Mathematical Problem Solving Belief of Mathematics, Science and Elementary Pre-Service Teacher in Turkey in Term 78 of Different Variable. International Journal of Humanities and Social Science, 24(2).

OECD. 2019. “OECD Technical Report on Progress on Structural Reform under the G20 Enhanced Structural Reform Agenda”, OECD Publishing, Paris, oe.cd/g20-esra-2019.

OECD. 2016, School Leadership for Learning: Insights from TALIS 2013, TALIS, OECD Publishing, Paris, http://dx.doi.org/10.1787/ 9789264258341-en.

Permatasari, N. Y., & Margana, A. 2014. Meningkatkan Kemampuan Siswa dalam Memecahkan Masalah Matematika dengan Model Pembelajaran Treffinger. Jurnal Pendidikan Matematika: “Mosharafa,” 3, 31–42.

Plomp. 2007 . “Educational Design Research : An Introduction”, dalam An Introduction to Educational Research. Enschede, Netherland : National Institute for Curriculum Development

Prasetya, C., Gani, A., & Sulastri. 2019. Pengembangan lembar kerja peserta didik berbasis inkuiri terbimbing pada materi hidrolisis garam untuk meningkatkan literasi sains. Jurnal Pendidikan Sains Indonesia (Indonesian Journal of Science Education), 7(1):34- 41.

Reckase, M.D. 1979. Unifactor latent trait models applied to multifactor tests: results and implications. Journal of Educational and Behavioral Statistics. 4 (3). 207-230.

Retnawati, H. 2014. Teori respon butir dan penerapannya (untuk peneliti, praktisi pengukuran, dan pengujian mahasiswa pascasarjana). Yogyakarta: Nuha Medika.

Reynolds, C.R., Livingston, R.B., & Wilson, V. 2009. Measurement and assessment in education (2nd Ed). New Jersey: Pearson Education Inc.

Salamon. 2007. Scientific Literacy in Higher Education. Tamarat Teaching Professorshing: University of Calgary.

Smits, N., Cuijpers, P., & Van Straten, A. 2011. Applying computerized adaptive testing to the CES-D scale: A simulation study. Psychiatry Research. 188. 147-155.

Smith, S. W. R. 2013. Controlling cheating in online courses: a primer. Pearson: New Jersey.

Stage, C. 2003. Classical test theory or item response theory: the swedish experience. Santiago: Centro de Estudios Publicos.

Sumintono, B., & Widhiarso, W. 2015. Aplikasi permodelan rasch pada assessment pendidikan. Cimahi: Trim Komunikata.

Tambunan Hardi. 2014. Strategi Heuristik Dalam Pemecahan Masalah Matematika Sekolah. Jurnal Saintech. Vol. 06 – No. 04-Desember 2014.

Tessmer, Martin. 1998. Planning and Conducting Formative Evaluation. London: Kogan Page.

Wiberg, M. 2004. Classical test theory vs item response theory. Sweden: Umea Universitet.

Williams, B., Brown, T., & Onsman, A. 2012. Exploratory factor analysis: a five-step guide for novices. Australasian Journal of Paramedicine. 8(3). 1-13.

Wilkinson, John. 1999. A Quantitative Analysis of Physics Textbooks for Scientific Literacy Themes. Journal of research in science teaching. 29, (3), 385-399.

Wu, Q., Zhang, Z., Song, Y., Zhang, Y., Zhang, Y., Zhang, F., … Miao, D. 2013. The development of mathematical test based on item response theory. International Journal of Advancements in Computing Technology, 5(10), 209–216.

Zeidler, D. L., Sadler, T. D., Simmons, M. L., & Howes, E. V. 2005. Beyond STS: A research-based framework for socioscientific issues education. Science Education, 89(3), 357-377 (17) (PDF) Socioscientific issues: Theory and practice. Available from: https://www.researchgate.net/publication/227201430_Socioscientific_issues_Theory_and_practice [accessed Jul 18 2020].

Zulaiha, R. 2008. Bagaimana menganalisis soal dengan program ITEMAN. Jakarta: Depdiknas-Balitbang-Puspendik.

Zulkardi. 2002. Developing a Learning Environment on Realistic Mathematics Education for Indonesian student teachers. Disertasi. (http://projects.edte.utwente.nl/cascade/imei/dissertation/disertasi.html. diakses tanggal 10 Desember 2007)




DOI: https://doi.org/10.24815/jpsi.v8i2.17468

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 Dadan Rosana


Jurnal Pendidikan Sains Indonesia (Indonesian Journal of Science Education)

ISSN 2338-4379  (print) | 2615-840X (online)
Organized by Universitas Syiah Kuala 
Published by Master of Science Education Study Program Graduate School Universitas Syiah Kuala, Banda Aceh, Indonesia
Website : http://jurnal.usk.ac.id/jpsi
Email     : jpsi@usk.ac.id

  

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.