Developing Instrument of Digital Age Literacy Inventory: Validity and Reliability Analysis Using Rasch Model

Authors

  • Afandi Afandi Faculty of Teacher Training and Education, Universitas Tanjungpura, Pontianak, Indonesia
  • Eko Sri Wahyuni Biology Education Program, Universitas Tanjungpura, Pontianak, Indonesia
  • Anik Roslina Rosyadi Faculty of Teacher Training and Education, Universitas Tanjungpura, Pontianak, Indonesia

DOI:

https://doi.org/10.21009/jtp.v27i3.58103

Keywords:

Digital age literacy, DALI, Validity and Reliability, RASCH model

Abstract

The development of a valid and reliable assessment instrument of digital-age literacy is truly required to determine the level of students' digital-age literacy competence. One major issue is the lack of standardized instruments that comprehensively measure all dimensions of digital-age literacy. This study aims to develop and analyze digital-age literacy inventory instruments (DALI) since there is no standardized instrument regarding digital-age literacy has been created. The development of the DALI is carried through three phases: research scale components identification, writing and developing the questionnaire items, and the analysis of its validity and reliability. A total of 40 statement items were developed based on the digital age literacy component. The sample of this study was 75 eleventh-graders of science State Senior High Schools in Pontianak. The data were analyzed using the Rasch Model with the help of the WINSTEP 3.73 application. The analysis results show that the total value of the Aikens V index is 0.96. DALI has obtained the value of person reliability of 0.71 (good enough), item reliability of 0.98 (excellent), and the value of Cronbach's alpha of 0.75 (good). On the whole, the statement items are declared valid based on the value of outfit MNSQ person and the item of 0,99 and the value of Outfit Z Standardized (ZSTD) in which the person analysis -0.2 and the item of -0,3. Of 40 items being analyzed, 6 items do not fit the Rasch Model, the final number of valid and usable instrument items is 34 items. The development of DALI shows that the quality of the instrument is good and can be used to measure the digital age literacy of senior high school students within the 8 components of the latter.

References

Afandi; Junanto, T., & Afriani, R. (2016). Implementasi Digital-Age Literacy Dalam Pendidikan Abad 21 Di Indonesia. Prosiding Seminar Nasional Pendidikan Sains. https://media.neliti.com/media/publications/173402-ID-none.pdf.

Afandi, Sajidan, Akhyar, M., Suryani, N., & Afriani, R. (2019). Exploring digital-age literacy among prospective science teachers in West Kalimantan, Indonesia. Journal of Physics: Conference Series, 1321(3). https://doi.org/10.1088/1742-6596/1321/3/032087

Akbar, M. F., & Anggaraeni, F. D. (2017). Teknologi Dalam Pendidikan : Literasi Digital Dan Self- Directed Learning Pada Mahasiswa Skripsi. Jurnal Indigenous, 2(1), 28–38. https://doi.org/10.23917/indigenous.v1i1.4458.

Alkharusi, H. (2017). Development and Validation of a Scale for Measuring Mathematics Teaching Self-Efficacy for Teachers in the Sultanate of Oman. International Journal of Instruction, 10(3), 143–158. https://doi.org/10.12973/iji.2017.10310a.

Amalia, N. F., & Susilaningsih, E. (2014). Pengembangan Instrumen Penilaian Keterampilan Berpikir Kritis Siswa Sma Pada Materi Asam Basa. BIOEDUKASI (Jurnal Pendidikan Biologi), 8(2), 1380–1389. https://doi.org/10.24127/bioedukasi.v10i1.2004.

Aminudin, A.H., Adimayuda, R., Kaniawati, I., Suhendi, E., Samsudin, A., & Coştu, B. (2019). Rasch Analysis of Multitier Open-ended Light-Wave Instrument ( MOLWI ): Developing and Assessing Second-Years Sundanese-Scholars Alternative Conceptions Rasch Analysis of Multitier Open-ended Light-Wave Instrument ( MOLWI ): Developing and Assessing Secon. Journal for the Education of Gifted Young Scientists, 7(3), 557–579. https://doi.org/10.17478/jegys.574524.

Ardiyanti, D. (2016). Aplikasi Model Rasch pada Pengembangan Skala Efikasi Diri dalam Pengambilan Keputusan Karier Siswa. Jurnal Psikologi, 43(3), 248–263. https://doi.org/10.22146/jpsi.17801.

Arsad, N. M., Osman, K., & Soh, T. M. T. (2011). Instrument development for 21st century skills in Biology. Procedia - Social and Behavioral Sciences, 15(2011). 1470–1474. https://doi.org/10.1016/j.sbspro.2011.03.312.

Asrizal, A., Amran, A., Ananda, A., & Festiyed, F. (2018a). Effectiveness of adaptive contextual learning model of integrated science by integrating digital age literacy on grade VIII students. IOP Conference Series: Materials Science and Engineering, 335, 012067. https://doi.org/10.1088/1757-899X/335/1/012067.

Asrizal, A., Amran, A., Ananda, A., Festiyed, F., & Khairani, S. (2018b). Effectiveness of integrated science instructional material on pressure in daily life theme to improve digital age literacy of students. Journal of Physics: Conference Series, 1006, 012031. https://doi.org/10.1088/1742-6596/1006/1/012031.

Azizah, & Wahyuningsih, S. (2020). Penggunaan Model Rasch Untuk Analisis Instrumen The Use Of Rasch Model For Analyzing Test. JUPITEK, 3(1), 45–50. https://doi.org/10.30598/jupitekvol3iss1ppx45-50.

Belshaw, D. A. J. (2011). What is : “Digital Literacy?”. Durham University: United Kingdom. https://clalliance.org/wp-content/uploads/files/doug-belshaw-edd-thesis-final.pdf.

Bond, T., Yan, Z., & Heene, M. (2020). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (4th ed.). Routledge. https://doi.org/10.4324/9780429030499

Chan, S. W., Ismail, Z., & Sumintono, B. (2014). A Rasch Model Analysis on Secondary Students’ Statistical Reasoning Ability in Descriptive Statistics. Procedia - Social and Behavioral Sciences, 129 (May), 133–139. https://doi.org/10.1016/j.sbspro.2014.03.658.

Cho, V & Littenberg-Tobias, J. (2016). Digital Devices and Teaching The Whole Student: Developing and Validating an Instrument to Measure Educators’ Attitudes and Beliefs. Education Tech Research Dev, 64(1), DOI 10.1007/s11423-016-9441-x

Cuervo Sánchez, S. L., Foronda Rojo, A., Rodríguez Martínez, A., & Medrano Samaniego, C. (2019). Media and information literacy: a measurement instrument for adolescents. Educational Review, 73(4), 487–502. https://doi.org/10.1080/00131911.2019.1646708

Dewi, P. C. P., & Sukadiyanto. (2015). Pengembangan Tes Keterampilan Olahraga Woodball Untuk PemulA. Jurnal Keolahragaan, 3(2), 228–240. https://doi.org/10.21831/jk.v3i2.6254.

Dianimdri, S., & Yuliani, W.D. (2018). Digital Age Literacy For Indonesian Elementary School Student. Social, Humanities, and Education Studies (SHEs): Conference Series. 1(1), 849-855.http://dx.doi.org/10.20961/shes.v1i1.23532.

Ferrari, A. (ed.) (2013) DIGCOMP: A Framework for Developing and Understanding Digital Competence in Europe. Publications Office of the European Union. DOI: 10.2788/52966.

Harjono, H. S. (2018). Prospek dan Implikasinya dalam Pembelajaran Bahasa. Jurnal Pedidikan Bahasa dan Sastra. 8(1), 1-7. https://doi.org/10.22437/pena.v8i1.6706.

Jang, Y, Choi, S., & Kim, H. (2022). Development and Validation of An Instrument to Measure Undergraduate Students’ Attitudes Toward The Ethics of Artificial Intelligence (AT-EAI) and Analysis of its Difference by Gender and Experience of AI Education. Educ Inf Technol. 27, 11635–11667. https://doi.org/10.1007/s10639-022-11086-5

Mujtahid, I.M., Berlian, M., Vabrianto, R., Thahir, M., & Irawan, D. (2021). The Development of Digital Age Literacy: A Case Study in Indonesia. Journal of Asian Finance, Economics and Business. 8(2), 1169–1179. https://doi.org/10.13106/jafeb.2021.

Ng, W. (2012). Can we teach digital natives digital literacy?. Computers & Education, 59(3), 1065–1078.https://doi.org/10.1016/j.compedu.2012.04.016

Nuraini, N. (2017). Profil Keterampilan Berpikir Kritis Mahasiswa Calon Guru Biologi Sebagai Upaya Mempersiapkan Generasi Abad 21 Critical Thinking Profile Of Students Of Biological Teacher Candidate As Efforts To Prepare 21 St Century Generation. Jurnal Pendidikan Biologi, 1(2), 89–96. http://jurnal. umpalembang.ac.id/index.php/dikbio.

Nuroh, E. Z., & Liansari, V. (2017). Digital Age Literacy in Elementary School. Proceedings of the 1st International Conference on Intellectuals' Global Responsibility (ICIGR 2017). https://doi.org/10.2991/icigr-17.2018.29.

Olaniyi, A. A. (2019). Application of Likert Scale's Type and Cronbach's Alpha Analysis in an Airport Perception Study. Scholar Journal of Applied Sciences and Research, 2(4), 1-5.

Osman, K., Soh, T. M., & Arsad, N. M. (2010). Development and validation of the Malaysian 21st century skills instrument (M-21CSI) for science students. Procedia - Social and Behavioral Sciences, 9(December), 599–603. https://doi.org/10.1016/j.sbspro.2010.12.204.

Panggabean, F. T. M., Pardede, P. O., Sitorus, R. M. D., Situmorang, Y. K., Naibaho, E. S., & Simanjuntak, J. S. (2019). Application of 21st Century Learning Skills Oriented Digital-Age Literacy to Improve Student Literacy HOTS in Science Learning in Class IX SMP. Jurnal Mantik, 5(3), 1992-1930.

Partnership for 21st Century Skills (P21). (2009). P21 Framework Definitions. Retrieved 24 August 2025, from http://www.battelleforkids.org/networks/p21

Phuapan, P., Viriyavejakul, C., & Pimdee, P. (2016). An analysis of digital literacy skills among thai university seniors. Ijet, 11(3), 24–31. http://dx.doi.org/10.3991/ijet.v11i03.5301.

Ramdani, R. (2021). Development and Validation of Indonesian Academic Resilience Scale Using Rasch Models. International Journal of Instruction, 14(1), 105–120. http://dx.doi.org/10.29333/iji.2021.1417a.

Retnawati, H. (2016). Analisis Kuantitatif Instrumen Penelitian: Panduan Peneliti, Mahapeserta didik, dan Psikometrian. Yogyakarta: Parama Publishing.

Sadhu, S., & Endang, L. (2018). Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium. International Journal of Instruction, 11(3), 557–572.http://dx.doi.org/10.12973/iji.2018.11338a.

Sugiyono. (2017). Metode Penelitian Pendidikan: Pendekatan Kuantitatif, Kualitatif dan R&D. Alfabeta: Bandung.

Sujana, A., & Rachmatin, D. (2019). Literasi digital abad 21 bagi mahasiswa didik PGSD: apa, mengapa, dan bagaimana. Current Research in Education: Conference Series Journal. 1(1), 1-7.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada assessment pendidikan. Cimahi: Trim Komunikata.

Summey, Dustin C. (2013). Developing Digital Literacies: A Framework for Professional Learning. Amerika Serikat: Corwin Press.

UNESCO. (2018). A Global Framework of Reference on Digital Literacy Skills for Indicator 4.4.2 (Information Paper No. 51, UIS/2018/ICT/IP/51). UNESCO Institute for Statistics.

Tersedia secara daring: http://uis.unesco.org/sites/default/files/documents/ip51-global-framework-reference-digital-literacy-skills-2018-en.pdf

Downloads

Published

2025-12-22

How to Cite

Afandi, A., Sri Wahyuni, E., & Rosyadi, A. R. (2025). Developing Instrument of Digital Age Literacy Inventory: Validity and Reliability Analysis Using Rasch Model. JTP - Jurnal Teknologi Pendidikan, 27(3), 784–798. https://doi.org/10.21009/jtp.v27i3.58103

Issue

Vol. 27 No. 3 (2025): Jurnal Teknologi Pendidikan

Section

Full Articles

License

Copyright (c) 2025 Afandi Afandi, Eko Sri Wahyuni, Anik Roslina Rosyadi

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Jurnal Teknologi Pendidikan is an Open Access Journal. The authors who publish the manuscript in Jurnal Teknologi Pendidikan agree to the following terms.

Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)

  • Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

  • ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.

  • No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

Notices:

 

  • You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
  • No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.