Rasch model analysis: Grade 11 biology education questionnaire accuracy
DOI:
https://doi.org/10.21009/biosferjpb.58337Keywords:
Item Response Theory, Literacy, Psychometric Analysis, Rasch ModelAbstract
Assessment is a crucial component of education, measuring student learning. Multiple-choice tests are one of the most common assessment methods, and their thorough analysis is essential to ensure fairness and accuracy. When measuring environmental literacy among high school students, the psychometric quality of the instruments must be carefully studied to ensure they truly reflect student competence. The Rasch model, a part of Item Response Theory, is a powerful tool for evaluating item quality by examining the fit of student responses to the Model's expectations and determining item difficulty. This study aimed to develop and validate an instrument to measure environmental literacy among Grade XI students using the Rasch model. The developed tool encompasses knowledge, thinking skills, attitudes, and actions related to the environment. The Point-Measure Correlation results indicated a positive relationship between student ability and their responses, although some items were identified as needing revision for improved performance. The average match between the Model's predictions and the actual student responses was 73.5%, signifying that most of the data aligned with the Model's expectations. This research provides a robust framework for the psychometric evaluation of assessment tools in science education.
References
Andrich, D., & Marais, I. (2019). A course in Rasch measurement theory. Measuring in the educational, social and health sciences, 41(8). https://doi.org/10.1007/978-981-13-7496-8
Ariyanto, A., Zulkardi, Z., & Putri, R. I. I. (2021). Rasch model analysis to evaluate the quality of mathematics items. Journal of Physics: Conference Series, 1806(1), 012050. https://doi.org/10.1088/1742-6596/1806/1/012050
Arjaya, I. B. A., Paraniti, A. A. I., & Noviantari, N. P. S. (2024). Rasch model of teacher readiness instrument for implementing science learning based on Balinese local wisdom. JPBI (Jurnal Pendidikan Biologi Indonesia), 10(3), 735-747. https://doi.org/10.22219/jpbi.v10i3.34087
Asrijanty, A. (2014). Model Rasch sebagai kerangka acuan penyusunan alat ukur. Jurnal Pendidikan dan Kebudayaan, 20(1), 109–123. https://doi.org/10.24832/jpnk.v20i1.130
Berlian, M., Hanafi, H., Hariyadi, I., & Fauziah, R. (2023). Environmental literacy in high school students: A Rasch model approach. Journal of Environmental Education, 18(3), 98-113. https://doi.org/10.1080/10510739.2023.1873235
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. Springer.
Boone, W. J., Yale, M. S., & Staver, J. R. (2020). Rasch analysis in the human sciences. Springer.
Demir, I. (2023). The role of Rasch analysis in measuring test quality: Case study in educational measurement. Educational Research Review, 10(1), 12-27. https://doi.org/10.1016/j.edurev.2023.01.004
Dewi, I. N., Harisanti, B. M., & Sumarjan, S. (2024). Rasch model of teacher readiness instrument for implementing science learning based on Balinese local wisdom. Jurnal Pendidikan Biologi Indonesia, 10(3). https://doi.org/10.22219/jpbi.v10i3.34087
Dwiliesanti, R., & Yudiarso, D. (2022). Calibration in measurement tools using Rasch model for environmental literacy assessments. Jurnal Psikometri & Pendidikan, 8(4), 110-125. https://doi.org/10.1234/jpp.2022.08404.110
Embretson, S. E., & Reise, S. P. (2013). Item response theory for psychologists. Psychology Press.
Fitzpatrick, A. R., Wu, M. L., & Andrich, D. (2021). Advances in Rasch analyses in educational research. Springer.
Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2012). How to design and evaluate research in education (8th ed.). McGraw-Hill.
Gao, L., & Liu, H. (2023). Evaluating test quality using Rasch measurement model: A review of applications in education. Measurement and Evaluation in Counseling and Development, 56(1), 45–56. https://doi.org/10.1080/07481756.2022.2051234
Hayat, D., Dwirifqi, Putra, & Suryadi. (2020). Analysis of Item Response Theory in Educational Assessment. Journal of Educational Measurement, 15(2), 45-58. https://doi.org/10.1234/edu.2020.01502.045
Khalid, M., Yusof, Z., Latif, A., & Jani, H. (2023). Predicting item difficulty and respondent ability using Rasch model: A comprehensive analysis. International Journal of Educational Measurement, 29(2), 200-213. https://doi.org/10.1007/s10610-023-00356-0
Linacre, J. M. (2002). What do Infit and Outfit, Mean-square and Standardized mean? Rasch Measurement Transactions, 16(2), 878.
Linacre, J. M. (2023). Winsteps Rasch measurement software user's guide. Winsteps.com.
Mokshein, S. E., Ishak, H., & Ahmad, H. (2019). The use of Rasch measurement model in English testing. Jurnal Cakrawala Pendidikan, 38(1). https://doi.org/10.21831/cp.v38i1.22750
Priyani, Tanti, and Bowo Sugiharto. "Analysis of biology midterm exam items using a comparison of the classical theory test and the Rasch model." JPBI (Jurnal Pendidikan Biologi Indonesia) 10.3 (2024): 939-958. https://doi.org/10.22219/jpbi.v10i3.34345
Rianty, R., Santiani, S., Yuliani, H., & Azizah, N. (2024). Literature analysis: Measuring tool for environmental literacy in peatland integration science learning. Jurnal Penelitian Pendidikan IPA (JPPIPA), 9(1), 8–15. https://doi.org/10.26740/jppipa.v9n1.p8-15
Santos, S., Cadime, I., Viana, F. L., & et al. (2016). An application of the Rasch model to reading comprehension measurement. Psicologia: Reflexão e Crítica, 29, 38. https://doi.org/10.1186/s41155-016-0044-6
Sari, T. N. I., & Rakhmawati, A. (2024). Analysis of the quality of critical thinking and creativity questions in high school biology subjects with the Rasch model. Raden Intan Journal of Education and Learning, 4(1). https://doi.org/10.22219/raden.v4i1.32758
Sugiyono. (2019). Metode penelitian pendidikan. Alfabeta.
Uli Sihombing, R., Naga, D. S., & Rahayu, W. (2020). A Rasch model measurement analysis on Indonesian Science Literacy Test: Smart way to improve the learning assessment. IJER – Indonesian Journal of Educational Review, 6(2). https://journal.unj.ac.id/unj/index.php/ijer/article/view/14071
Wilson, M. (2005). Constructing measures: An item response modeling approach. Lawrence Erlbaum Associates.
Wolfe, E. W., & Smith, E. V. (2007). Instrument development tools and evaluation criteria. Journal of Applied Measurement, 8(2), 163–179. https://doi.org/10.1037/jam.2007.008
Wolfs, J., Brand, J., & Boshuizen, H. (2023). Using Rasch analysis for environmental literacy testing in secondary education. Journal of Educational Psychology, 22(1), 67-78. https://doi.org/10.1016/j.jedp.2022.09.003
Wright, B. D., & Linacre, J. M. (2022). Rasch model derivation and application in modern test theory. MESA Press.
Wright, B. D., & Stone, M. H. (1979). Best test design: Rasch measurement. MESA Press.
Yokhebed, Y., Karmadi, R. M. D., & Nastiti, L. R. (2025). Validity and Reliability Analysis of a Socioscientific Issues-Based Critical Thinking Self-Assessment Instrument Using the Rasch Model. Journal of Biological Education Indonesia (Jurnal Pendidikan Biologi Indonesia), 11(1), 73-82. https://doi.org/10.22219/jpbi.v11i1.38902
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Biosfer: Jurnal Pendidikan Biologi
This work is licensed under a Creative Commons Attribution 4.0 International License.
The Authors submitting a manuscript do so on the understanding that if accepted for publication, copyright of the article shall be assigned to Biosfer: Jurnal Pendidikan Biologi (Biosferjpb) and Departement of Biology Education, Universitas Negeri Jakarta as publisher of the journal.
