Analysis items of the four-tier immune system multiple choice test instrument using rasch model

Authors

  • Feni Andriani Biology Education, Faculty of Teacher Training and Education, Universitas Sebelas Maret, Indonesia
  • Meti Indrowati Biology Education, Faculty of Teacher Training and Education, Universitas Sebelas Maret, Indonesia
  • Bowo Sugiharto Biology Education, Faculty of Teacher Training and Education, Universitas Sebelas Maret, Indonesia

DOI:

https://doi.org/10.21009/biosferjpb.18020

Keywords:

Four-tier, Instruments, Immune system, Misconceptions, Rasch analysis

Abstract

The purpose of this study was to analyze the feasibility of the items of the four-tier multiple-choice test immune system instrument that had been developed. The development of the instrument using the Treagust (1988) model, namely defining content, collecting student misconceptions information, and developing a diagnostic test. A total of 25 items have been developed. The results of the instrument development were tested on 142 students of grade XI from several high schools in Surakarta who were selected by simple random sampling. The data analysis technique was performed using Rasch analysis in the Winstep application. The results of the construct validity test showed items number 5, 7, and 9 did not fit the validity standards. The reliability test shows that the value of Cronbach Alpha reliability is bad (n = 0.51), the value of the reliability item is special (no = 0.97), the value of person reliability is sufficient (n = 0.68), the value of person separation is weak (n = 1.44), and the item separation value is special (n = 5.38). The person discrimination test showed student 056P31 has the highest ability and student 098P51 has the lowest ability. The item discrimination test shows item number 1 is the best item and the bad item is number 14. The item difficulty analysis showed less proportionality because there were too many items in the easy and difficult categories. An expansion of the sample is needed to see a more comprehensive and diverse range of responses to instruments.

References

Adeniyi, E. O. (1985). Misconceptions of selected ecological concepts held by some Nigerian students Misconceptions of selected ecological concepts held by some Nigerian students. Jurnal of Biology Education, 19(4), 311–316.

Akamca, G. Ö., Ellez, A. M., & Hamurcu, H. (2009). Effects of computer-aided concept cartoons on learning outcomes. Procedia-Social and Behavioral Sciences, 1(1), 296–301. https://doi.org/10.1016/j.sbspro.2009.01.054

Al-zoubi, S. M. (2015). Low Academic Achievement : Causes and Results. Theory and Practice Language Studies, 5(11), 2262–2268.

Allen, M. (2014). Misconceptions in Primary Science. Mc Graw Hill Education Open University Press. https://doi.org/10.1152/advances.2000.24.1.62

Anggrayni, S., & Ermawati, F. U. (2019). The validity of Four-Tier's s misconception diagnostic test for Work and Energy concepts The validity of Four- Tier's misconception diagnostic test for Work and Energy concepts. Journal of Physics: Conference Series, 1171(1), 0–13. https://doi.org/10.1088/1742-6596/1171/1/012037

Arifin, Z. (2012). Menganalisis Kualitas Tes. In Evaluasi Pembelajaran (pp. 311–367). Jakarta: Direktorat Jenderal Pendidikan Islam Kementerian Agama RI.

Assaraf, O. B., Dodick, J., & Tripto, J. (2013). High School Students ’ Understanding of the Human Body System. Research in Science Education, 43(1), 33–56. https://doi.org/10.1007/s11165-011-9245-2

Astutik, W. (2018). Pengembangan instrumen three-tier multiple choice diagnostic test untuk mengidentifikasi miskonsepsi siswa sma materi gerak melingkar beraturan. Universitas Islam Negeri Walisongo.

Boone, W. J. (2016). Rasch Analysis for Instrument Development : Why, When, and How ? CBL-Life Sciences Education, 15(4), 1–7. https://doi.org/10.1187/cbe.16-04-0148

Boone, W. J., Noltemeyer, A., Boone, W. J., & Noltemeyer, A. (2017). Rasch analysis : A primer for school psychology researchers and practitioners Rasch analysis : A primer for school psychology researchers and practitioners. Cogent Education, 1(4), 1–13. https://doi.org/10.1080/2331186X.2017.1416898

Caleon, I. S., & Subramaniam, R. (2010a). Do Students Know What They Know and What They Don't Know ? Using a Four-Tier Diagnostic Test to Assess the Nature of Students ' Alternative Conceptions. Research in Science Education, 40(3), 313–337. https://doi.org/10.1007/s11165-009-9122-4

Caleon, I. S., & Subramaniam, R. (2010b). Do Students Know What They Know and What They Don't Know ? Using a Four-Tier Diagnostic Test to Assess the Nature of Students ' Alternative Conceptions Do Students Know What They Know and What They Don't Know ? Using a Four-Tier Diagnostic Test to Ass. Research in Science Education, 40, 313–337. https://doi.org/10.1007/s11165-009-9122-4

Chandrasegeran, A. ., Treagust, D. F., & Mocerino, M. (2007). The development of a two-tier multiple-choice diagnostic instrument for evaluating secondary school students ' ability to describe and explain chemical reactions using multiple levels using multiple levels of representation. Chemistry Education Research and Practice, 8(3), 293–307. https://doi.org/10.1039/B7RP90006F

Chi, M. T. . (2013). Two Kinds and Fur Sub-Types of Misconceived Knowledge, Ways to Change it, and Learning Outcomes. In International Handbook of Research on Conceptual Change Routledge (pp. 49–70). https://doi.org/10.4324/9780203154472.ch3

Faggioni, T., Ferreira, N. C. da S., Lopes, R. M., Fidalgo-neto, A. A., Cotta-de-almeida, V., & Alves, L. A. (2019). Open educational resources in immunology education. Advances in Physiology Education, 43(2), 103–109. https://doi.org/10.1152/advan.00116.2018

Fisher, K. M. (1985). A Misconception In Biology : Amino Acids AND TRANSLATION. Journal Od Research In Science Teaching, 22(1), 53–62.

Fratiwi, N. J., Ramalis, T. R., & Samsudin, A. (2019). The Three-tier Diagnostic Instrument : Using Rasch Analysis to Develop and Assess K-10 Students ’ Alternative Conceptions on Force Concept. In RSU International Research Conference (pp. 654–663).

Gronlund, N. E. (1985). Stating objectives for classroom instruction. Macmillan Publishing Company.

Gurel, D. K., Eryılmaz, A., & Mcdermott, L. C. (2015). A Review and Comparison of Diagnostic Instruments to Identify Students ’ Misconceptions in Science. Eurasia Journal of Mathematics, Science & Technology Education, 11(5), 989–1008. https://doi.org/10.12973/eurasia.2015.1369a

Hammer, D. (1996). More than misconceptions : Multiple perspectives on student knowledge and reasoning, and an appropriate role for education research. American Journal Od Physics, 64, 1316–1325. https://doi.org/10.1119/1.18376

Hartati, N., & Yogi, H. P. S. (2019). Item Analysis for a Better Quality Test. English Language in Focus (ELIF), 2(1), 59. https://doi.org/10.24853/elif.2.1.59-70

Hasyim, W., Suwono, H., & Susilo, H. (2018). Three-tier Test to Identify Students’ Misconception of Human Reproduction System. Jurnal Pendidikan Sains, 6(2), 48–54.

Ismail, I. (2020). Analisis Tingkat Kesukaran Hasil Tes. In Asesmen dan Evaluasi Pembelajaran (pp. 144–145). Makasar: Cendekia.

Kaltacki, D. (2012). Development and application of a four-tier test to assess pre-service physics teachers" misconceptions about geometrical optics. Middle East Technical University.

Khine, M. S. (2020a). Rasch Measurement : Applications in Quantitive Educational Research. (M. S. Khine, Ed.). Jerman: Springer.

Khine, M. S. (2020b). Rasch Measurement Applications in Quantitative Educational. Singapore: Springer. https://doi.org/10.1007/978-981-15-1800-3

Kurt, H. (2013). Turkish student biology teachers’ conceptual structures and semantic attitudes towards microbes. Journal of Baltic Science Education, 12(5), 608–639.

Lazarowitz, R., & Penso, S. (1992). High school students’ difficulties in learning biology concepts. Journal of Biological Education, 26(3), 37–41.

Linacre, J. M. (1999). Understanding Rasch Measurement: Estimation Methods for Rasch Measures. Journal of Outcome Measurement, 3(4), 382–405.

Linacre, J. M. (2017). Rasch Measurement Transactions. Autmn, 31(2), 1629–1642.

Lukin, K. (2013). Exciting middle and high school students about immunology: An easy, inquiry-based lesson. Immunologic Research, 55(1–3), 201–209. https://doi.org/10.1007/s12026-012-8363-x

Maharani, L., Rahayu, D. I., Amaliah, E., Rahayu, R., & A, S. (2019). Diagnostic Test with Four-Tier in Physics Learning : Case of Misconception in Newton's Law Material Diagnostic Test with Four-Tier in Physics Learning : Case of Misconception in Newton's s Law Material. Journal of Physics: Conference Series, 115. https://doi.org/10.1088/1742-6596/1155/1/012022

Mamik. (2015). Metode Kualitatif. Sidoarjo: Zifatama.

Manzo, A. N., & Burke, J. M. (2012). Increasing Response Rate in Web-Based/Internet Surveys. New York: Springer. https://doi.org/10.1007/978-1-4614-3876-2

Matondang, Z., Djulia, E., Sriadhi, & Simarmata, J. (2019). Evaluasi Hasil Belajar. In Evaluasi Hasil Belajar (p. 59).

Milenkovic, D. D., Hrin, T. N., Segedinac, M. D., & Horvat, S. (2016). Development of a Three-Tier Test as a Valid Diagnostic Tool for Identi fi cation of Misconceptions Related to Carbohydrates. Journal of Chemical Education, 93(9), 1514–1520. https://doi.org/10.1021/acs.jchemed.6b00261

Musa, A., Shaheen, S., & Elmardi, A. (2018). Item difficulty & item discrimination as quality indicators of physiology MCQ examinations at the Faculty of Medicine Khartoum University Abstract : Khartoum Medical Journal, 11(2), 1477–1468.

National Research Council. (1997). Misconceptions as Barriers to Understanding Science. In Science Teaching Reconsidered : A Handbook (pp. 27–32). Washington DC: The National Academies Press. https://doi.org/10.17226/5287

Padayachee, K. (2016). Internet-mediated research : Challenges and issues. SACJ, 28(December), 25–45.

Patil, S. J., Chavan, R. L., & Khandagale, V. S. (2019). Identification of Misconceptions in Science: Tools, Techniques & Skills for Teachers. Aarhat Multidisciplinary International Education Research Journal (AMIERJ), 8(2), 466–472.

Pujyanto, Budiharti, R., Radiyono, Y., Rizky Amalia Nurani, N., Putri, H. V., Saputro, D. E., & Adhitama, E. (2018). Pengembangan Tes Diagnostik Miskonsepsi Empat Tahap Tentang Kinematika. Cakrawala Pendiidkan, 2, 237–249.

Quaigrain, K., & Arhin, A. K. (2017). Using reliability and item analysis to evaluate a teacher-developed test in educational measurement and evaluation. Cogent Education, 4(1). https://doi.org/10.1080/2331186X.2017.1301013

Rahman, A., Ahmar, A. S., Arifin, A. N. M., Upu, H., Mulbar, U., Alimuddin, … Ihsan, H. (2018). The Implementation of APIQ Creative Mathematics Game Method in the Subject Matter of Greatest Common Factor and Least Common Multiple in Elementary School. Journal of Physics: Conference Series, 954(1). https://doi.org/10.1088/1742-6596/954/1/012011

Riyantono, S., & Hatmawan, A. A. (2020). Metode Riset Penelitian Kuantitatif. In Metode Riset Penelitian Kuantitatif Penelitian Di Bidang Manajemen, Teknik, Pendidikan Dan Eksperimen (p. 63). Yogyakarta: Deepublish.

Sarimanah, E., Dewi, F. I., & Sabri, T. (2019). A Review Of Students ’ Common Misconceptions In Science And Their Diagnostic Assessment Tools. Jurnal Pendidikan IPA Indonesia, 8(2), 247–266. https://doi.org/10.15294/jpii.v8i2.18649

Senocak, E., Taskesenligil, Y., & Sozbilir, M. (2007). A Study on Teaching Gases to Prospective Primary Science Teachers Through Problem-Based Learning A Study on Teaching Gases to Prospective Primary Science Teachers Through Problem-Based Learning. Research in Science Education, 37(3), 279–290. https://doi.org/10.1007/s11165-006-9026-5

Septiantini, T., Samsudin, A., Aminudin, A. H., Rasmitadila, Rachmatullah, R., Costu, B., & Nurtanto, M. (2020). Static Fluid Four-Tier Instrument ( SFFTI ): Develop and Identify K-11 Brebes- Scholars ’ Alternative Conception with Rasch Analysis Static Fluid Four-Tier Instrument ( SFFTI ): Develop and Identify K-11 Brebes-Scholars ’ Alternative Conception with Rasch. International Journal of Advanced Science and Technology, 9(7), 3190–3199.

Sinclair, M., Toole, J. O., Malawaraarachchi, M., & Leder, K. (2012). Comparison of response rates and cost-effectiveness for a community-based survey : postal, internet and telephone modes with generic or personalised recruitment approaches. BMC Medical Research Methodology, 12(132), 1–8.

Singh, C. (2016). Effect of Misconception on Transfer in Problem Solving. In AIP Conference Proceedings, 951(1), 196–199.

Siqueira-batista, R., Gomes, A. P., Albuquerque, V. S., Madalon-fraga, R., Aleksandrowicz, A. M. C., & Geller, M. (2009). Lições de Akira Kurosawa. Revista Brasileira de Educação Médica, 33(2), 186–190.

Smiley, J. (2016). Classical test theory or Rasch : A personal account from a novice user. Shiken, 9(1), 16–29.

Stranford, S. A., Owen, J. A., Mercer, F., & Pollock, R. R. (2020). Active Learning and Technology Approaches for Teaching Immunology to Undergraduate Students. Frontiers in Public Health, 8(May), 1–17. https://doi.org/10.3389/fpubh.2020.00114

Stylos, G., Evangelaksis, G. A., & Kotsis, K. T. (2008). Misconceptions on classical mechanics by freshman university students : A case study in a Physics Department in Greece Misconceptions on classical mechanics by freshman university students : A case study in a Physics Department in Greece. Themes In Science And Technology Education, 1(2), 157–177.

Su, T., Cheng, M., & Lin, S. (2014). Investigating the Effectiveness of an Educational Card Game for Learning How Human Immunology Is Regulated. CBE—Life Sciences Education, 13(3), 504–515. https://doi.org/10.1187/cbe.13-10-0197

Subari, K. (2017). Improving Understanding and Reducing Matriculation Students’ Misconceptions in Immunity Using the Flipped Classroom Approach. In Overcoming Students’ Misconceptions in Science: Strategies and Perspectives from Malaysia (pp. 1–344). Springer Nature Singapore Pte Ltd. https://doi.org/10.1007/978-981-10-3437-4

Suliyanah, Putri, H., & Rohmawati, L. (2018). Identification student's misconception of heat and temperature using three-tier diagnostic test. Journal of Physics: Conference Series, 997(1), 1–10.

Sumintono, B., Widhiarso, W., & Mada, U. G. (2014). Aplikas Model Rasch untuk Penelitian Ilmu-Ilmu Sosial (edisi revisi). Cimahi: Trim Komunikata Publishing House.

Sumintono, B., & Widiharso, W. (2015). Aplikasi Permodelan Rasch Pada Assessment Pendidikan. Cimahi: Trim Komunikata Publishing House.

Tekkaya, C. (2002). Misconceptions As Barrier To Understanding Biology. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 23, 259–266.

Toka, Y., & Askar, P. (2002). The Effect Of Cognitive Conflict And Conceptual Change Text On Students’ Achievement Related To First Degree Equations With One Unknown. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 23(23), 211–217.

Treagust, D. F. (1988). Development and use of diagnostic tests to evaluate students ’ misconceptions in science. International Journal of Science Education, 10(2), 159–169. https://doi.org/10.1080/0950069880100204

Verkade, H., Mulhern, T. D., Lodge, J. M., Elliott, K., Cropper, S., Rubinstein, B. I. P., … Mulder, R. (2017). Misconceptions as a trigger for enhancing student learning in higher education. (T. U. of Melbourne, Ed.), The University of Melbourne. Melbourne.

Wu, J., Sun, H., & Tan, Y. (2013). Social Media Research : A review. Journal of Systems Science and Systems Engineering, 22(Sep), 257–282. https://doi.org/10.1007/s11518-013-5225-6

Zaini, M., & Rusmini. (2016). Pengembangan Perangkat Pembelajaran Konsep Klasifikasi Benda Terhadap Keterampilan Berpikir Kritis Siswa SMP Developing Learning Instrument Concept Of Classification Of Objects Of Critical Thinking Skills Smp Students. Biologi, Sains, Lingkungan Dan Pembelajarannya., 13(1), 102–111. Retrieved from https://jurnal.uns.ac.id/prosbi/article/view/5668

Downloads

Published

2021-04-30

How to Cite

Andriani, F., Indrowati, M., & Sugiharto, B. (2021). Analysis items of the four-tier immune system multiple choice test instrument using rasch model. Biosfer: Jurnal Pendidikan Biologi, 14(1), 99–119. https://doi.org/10.21009/biosferjpb.18020