Analisis Karakteristik dan Kualitas Butir Soal Informatika Menggunakan Model Rasch pada Siswa SMP
DOI:
https://doi.org/10.21009/pinter.10.1.2Keywords:
rasch model, informatics assessment, jmetrixAbstract
This study aims to evaluate the quality of 20 multiple-choice Informatics test items administered to Grade VII students of SMP Negeri 2 Kedungwuni using the Rasch Model with JMETRIX 4.1.1. The research employs a quantitative approach to analyze item difficulty, item fit, reliability, and the alignment between students’ abilities and item difficulty levels. Responses from 33 students were analyzed using dichotomous Rasch modeling. The results show that most items meet the fit criteria, with INFIT and OUTFIT MNSQ values within the acceptable range of 0.5–1.5. Two items require revision due to indications of underfit and overfit, while difficulty estimates range from -1.99 to 2.05 logits, reflecting adequate variation across items. Item reliability (0.6454) and person reliability (0.3104) fall into the low category, suggesting that the instrument has limited stability in distinguishing item difficulty and student ability. The person–item map reveals a moderate alignment between the distribution of student abilities and item difficulty, although several items are positioned far above or below the students’ ability range. The correlation between raw scores and theta ability estimates is very strong (r = 0.9428), indicating that raw scores adequately represent student performance, although theta provides a more accurate measurement. Overall, the instrument is feasible for use but requires refinement in terms of misfit items and enhancement in terms of difficulty distribution. These results highlight the importance of Rasch-based evaluation in improving the quality and fairness of Informatics assessments at the junior high school level.
References
Adeleke, J. O., Balogun, H. A., & Ayanwale, M. A. (2025). Assessment of content and cognitive dimensions of learners’ mathematics performance. STEM Education, 5(3), 383–400. https://doi.org/10.3934/steme.2025019
Avinç, E., & Doğan, F. (2024). Digital literacy scale: Validity and reliability study with the rasch model. Education and Information Technologies, 29(17), 22895–22941. https://doi.org/10.1007/s10639-024-12662-7
Berbar, H., Lotfi, S., & Talbi, M. (2022). Approaches and tools for quality measurement scales validation in education: An initial systematic literature review collection. International Journal of Emerging Technologies in Learning (iJET), 17(16), 73–91. https://doi.org/10.3991/ijet.v17i16.31685
Chinnarasri, P., Wongpakaran, N., & Wongpakaran, T. (2021). Developing and validating the narcissistic personality scale (NPS) among older Thai adults using Rasch analysis. Healthcare, 9(12), 1717. https://doi.org/10.3390/healthcare9121717
Courtney, M. G. R., Chang, K. C. T., Mei, B., Meissel, K., Rowe, L. I., & Issayeva, L. B. (2021). Autopsych: An R shiny tool for the reproducible rasch analysis, differential item functioning, equating, and examination of group effects. PLOS ONE, 16(10), e0257682. https://doi.org/10.1371/journal.pone.0257682
Denovan, A., Dagnall, N., Peverell, M., Drinkwater, K. G., Escolà-Gascón, Á., & Carter, D. (2026). Evaluating the psychometric properties of the generic conspiracist beliefs scale: A rasch modelling approach. Frontiers in Psychology, 17. https://doi.org/10.3389/fpsyg.2026.1721668
Le, C., Guttersrud, Ø., Sørensen, K., & Finbråten, H. S. (2022). Developing the HLS19-YP12 for measuring health literacy in young people: A latent trait analysis using Rasch modelling and confirmatory factor analysis. BMC Health Services Research, 22(1). https://doi.org/10.1186/s12913-022-08831-4
Marji, M. S., Musta’amal, A. H., Che Derasid, N. A., & Ting Chee, L. (2026). Development and validation of visualisation ability test for technical drawing students using rasch models. Journal Of Technical Education And Training, 18(1). https://doi.org/10.30880/jtet.2026.18.01.015
Misra, A. (2026). Item analysis of multiple-choice questions in pharmacology for evaluation of undergraduate medical students: A cross sectional study. Indian Journal of Health Care Medical & Pharmacy Practice, 7(1), 234–241. https://doi.org/10.59551/ijhmp/25832069/2026.7.1.128
O’Neill, T. R., Gregg, J. L., & Peabody, M. R. (2020). Effect of sample size on common item equating using the dichotomous rasch model. Applied Measurement in Education, 33(1), 10–23. https://doi.org/10.1080/08957347.2019.1674309
Prativi, R., Ramli, M., & Rianto, Y. (2024). Frayer model-based assessment for detecting students’ conceptual understanding in evolution. International Journal of Evaluation and Research in Education (IJERE), 13(6), 3686–3686. https://doi.org/10.11591/ijere.v13i6.29423
Rafi, I., Retnawati, H., Apino, E., Hadiana, D., Lydiati, I., & Rosyada, M. N. (2023). What might be frequently overlooked is actually still beneficial: Learning from post national-standardized school examination. Pedagogical Research, 8(1), em0145. https://doi.org/10.29333/pr/12657
Rotar, O. (2023). Partnership models in online learning design and the barriers for successful collaboration. Research and Practice in Technology Enhanced Learning, 19, 010. https://doi.org/10.58459/rptel.2024.19010
Schmucker, R., & Moore, S. (2026). The impact of item-writing flaws on difficulty and discrimination in item response theory. Computers and Education: Artificial Intelligence, 11, 100632. https://doi.org/10.1016/j.caeai.2026.100632
Yu, C. H. (2020). Objective measurement: How rasch modeling can simplify and enhance your assessment. Rasch Measurement, 47–73. https://doi.org/10.1007/978-981-15-1800-3_4