Many-Facet Rasch Model (MFRM) for Digital Citizenship Measurement Analysis in Islamic Schools: A Bibliometric Review
DOI:
https://doi.org/10.69552/mumtaz.v5i3.3632Keywords:
Bibliometric Review, Digital Citizenship, Islamic School, Many-Facet Rasch Model, Measurement AnalysisAbstract
The increasing need for Digital Citizenship competencies in education requires the availability of assessment instruments that are objective, valid, and in line with the challenges of digital ethics in the modern era. This study aims to map the global development of the use of the Many-Facet Rasch Model (MFRM) in the analysis of Digital Citizenship (DC) instruments and identify the implications of its application for the development of assessments in Islamic schools. Using the Scopus and ERIC data-based bibliometric analysis design, this study processed 143 publications through the bibliometrix device at R-Studio, including publication trend analysis, scientific collaboration, thematic structure, and citation network. The results of the study show that the integration of MFRM in digital citizenship assessment provides a strong methodological foundation to overcome the issue of rater bias and strengthen the objectivity of performative evaluation, especially in the context of Islamic Schools which require digital character assessments based on moral values, morals, and ethical responsibility in accordance with Islamic education principles. This study concludes that MFRM is a strategic approach to improve the quality of DC assessments in a fair and value-based manner, as well as open up opportunities for innovation of digital character evaluation instruments in Islamic schools. Further studies are recommended to test the empirical implementation of MFRM-based instruments and Differential Facet Functioning (DFF) analysis in madrasah and cross-cultural contexts.
References
Alafthoni, F. Z. (2024). Evaluation of Islamic Religious Education and Character Learning Using the Countenance Stake Model. Edukasi Islami: Jurnal Pendidikan Islam, 13(01), 59–72. https://doi.org/10.30868/ei.v13i01.6115
Arifiyanti, F., Soeharto, S., Amukune, S., Nguyen, S. Van, Aburezeq, K., Hidayatullah, A., & Sarimanah, E. (2023). Heliyon Investigating rater – student interaction , gender bias , and major bias in the assessment of research seminar presentation. Heliyon, 9(6), e16548. https://doi.org/10.1016/j.heliyon.2023.e16548
Aslanoglu, A. E., Karakaya, I., & Sata, M. (2020). Evaluation of University Students’ Rating Behaviors in Self and Peer Rating Process via Many Facet Rasch Model. Eurasian Journal of Educational Research, 89, 25–46. https://doi.org/10.14689/ejer.2020.89.2
Bahrouni, F. (2016). Using Multi-Facet Rasch Model (MFRM) in Rater-Mediated Assessment. The Journal of Teaching English for Specific and Academic Purpose, 4(53 5), 195–212.
Brennan, R. L. (2011). Applied Measurement in Education Generalizability Theory and Classical Test Theory. Applied Measurement in Education, August 2013, 37–41. https://doi.org/10.1080/08957347.2011.532417
Chen, L. L., Mirpuri, S., Rao, N., & Law, N. (2021). Conceptualization and measurement of digital citizenship across disciplines. Educational Research Review, 33(January), 100379. https://doi.org/10.1016/j.edurev.2021.100379
Choi, M., Glassman, M., & Cristol, D. (2017). Computers & Education What it means to be a citizen in the internet age : Development of a reliable and valid digital citizenship scale. Computers & Education, 107, 100–112. https://doi.org/10.1016/j.compedu.2017.01.002
Clayson, P. E., Carbine, K. A., Baldwin, S. A., Olsen, J. A., & Larson, M. J. (2021). Using generalizability theory and the ERP Reliability Analysis ( ERA ) Toolbox for assessing test-retest reliability of ERP scores part 1 : Algorithms , framework , and implementation. International Journal of Psychophysiology, January. https://doi.org/10.1016/j.ijpsycho.2021.01.006
Connolly, R., & Miller, J. (2022). Evaluating and Revising the Digital Citizenship Scale. Informatics, 1–13.
Dass, M. A., & Kumar, M. P. M. P. (2025). Critical Digital Citizenship: a Scale Development and Validation Study. International Journal of Technology and Design Education, 1493–1513.
Dogan, C. D., & Uluman, M. (2017). A Comparison of Rubrics and Graded Category Rating Scales with Various Methods Regarding Raters ’ Reliability. Educational Sciences: Theory and Practice, 631–651. https://doi.org/10.12738/estp.2017.2.0321
Donohue, C. (1972). A Bibliometric Analysis of Certain Information Science Literature. Journal of the American Society for Information Science.
Effendi, M., Bin, E., & Matore, M. (2020). Rating Performance among Raters of Different Experience Through Multi-Facet Rasch Measurement ( MFRM ) Model. Journal of Measurement and Evaluation in Education and Psychology, 11(2), 147–162. https://doi.org/10.21031/epod.662964
Fadlillah, N., & Kusaeri. (2024). Optimizing Assessment for Learning in Islamic Education through Authentic and Diagnostic Assessment : A Systematic Literature Review. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran Dan Pembelajaran, 10(2), 654–667.
Feriandi, Y. A., Budimansyah, D., & Komalasari, K. (2022). Developing measurement instrument of students ’ citizenship ecological behavior on citizenship education course in middle school. Journal of Human Behavior in the Social Environment, 00(00), 1–13. https://doi.org/10.1080/10911359.2022.2120590
Fitriani, E., & Hilmy, M. (2023). Evaluation of Islamic Religious Education : Optimal Approach to Increase Tolerance. Edukasia : Jurnal Penelitian Pendidikan Islam, 18(2), 293–312. https://doi.org/10.21043/edukasia.v18i2.26618
Goodwin, S. (2016). Assessing Writing A Many-Facet Rasch analysis comparing essay rater behavior on an academic English reading / writing test used for two purposes. Assessing Writing. https://doi.org/10.1016/j.asw.2016.07.004
Guler, N. (2014). Analysis of Open-Ended Statistics Questions with Many Facet Rasch Model. Eurasian Journal of Educational Research, 55, 73–90.
He, L., & Li, L. (2025). Future trends and challenges for citizenship ’ s digital literacy research : a bibliometric analysis. Discover Education.
Heru, W., Indah, B., Sa, H., Banu, N., Naidu, M., & Prasetyo, E. (2022). Using Rasch model analysis for assessing psychometric properties of digital citizenship in Indonesian students. Journal of E-Learning and Knowledge Society, 18(3), 96–110.
Ho, P. (2019). A new approach to measuring Overall Liking with the Many-Facet Rasch Model. Food Quality and Preference, 74(January), 100–111. https://doi.org/10.1016/j.foodqual.2019.01.015
Huang, C., Yang, C., Wang, S., Wu, W., Su, J., & Liang, C. (2019). Evolution of topics in education research : a systematic review using bibliometric analysis. Educational Review, 00(00), 1–17. https://doi.org/10.1080/00131911.2019.1566212
Iskandar, R., Maksum, A., & Marini, A. (2025). Social Sciences & Humanities Open Digital citizenship literacy in Indonesia : The role of privacy awareness and social campaigns. Social Sciences & Humanities Open, 12(June), 101697. https://doi.org/10.1016/j.ssaho.2025.101697
John, M., & Linacre, J. M. (1993). Generalizability Theory and Many-facet Rasch Measurement. Annual Meeting of the American Educational Research Association.
Jones, L. M., & Mitchell, K. J. (2015). Defining and Measuring Youth Digital Citizenship. New Media & Society. https://doi.org/10.1177/1461444815577797
Laura-de-la-cruz, K. M., Pérez-postigo, G., & Diaz-zavala, R. (2024). Digital Skills and Digital Citizenship Education: An Analysis Based on Structural Equation Modeling. Journal of Technology and Science Education, 14(3), 738–755.
Ma, H., & Ismail, L. (2025). Bibliometric analysis and systematic review of digital competence in education. Humanities and Social Sciences Communications, 2025, 1–17. https://doi.org/10.1057/s41599-025-04401-1
Maimunah, S., Hidayati, Z., & Mulyana, S. I. (2025). Comparison of GRM and GPCM in the Development of Higher Education Practice Assessment Instruments. Scaffolding: Jurnal Pendidikan Islam Dan Multikulturalisme, 7(2), 286–303. https://doi.org/10.37680/scaffolding.v7i2.7281
Mannan, A., Suparto, & Kusaeri. (2025). Practices and Challenges of the Validity of Exploratory Factor Analysis ( EFA ) -Based Assessment Instruments : A Systematic Literature Review. EDUKASIA: Jurnal Pendidikan Dan Pembelajaran, 6(1), 611–626. https://doi.org/10.62775/edukasia.v6i1.1463
Mclaughlin, J. E., Angelo, T. A., White, P. J., Peeters, M., & Green, K. E. (2023). Validating criteria for identifying core concepts using many-facet rasch measurement. Frontiers in Education, April, 1–8. https://doi.org/10.3389/feduc.2023.1150781
Morales-álvarez, A., Valdés-cuervo, A. A., Parra-pérez, L. G., García-vázquez, F. I., & Durón-ramos, M. F. (2025). Adolescents’ appraisal and disclosure mediate the links between parental practices and adolescents’ digital citizenship behaviors. Humanities and Social Sciences Communications, 2025, 1–9. https://doi.org/10.1057/s41599-025-04485-9
Myford, C. M., & Wolfe, E. W. (2004). Detecting and Measuring Rater Effects Using Many-Facet Rasch Measurement : Part II. Journal of Applied Measurement, 5(2), 189–227.
Naeem, K., & Mushibwe, C. P. (2025). Navigating digital worlds : a scoping review of skills and strategies for enhancing digital resilience among higher education students on social media platforms. Discover Education. https://doi.org/10.1007/s44217-025-00432-7
Nordin, M. S., Badariah, T., Ahmad, T., Zubairi, A. M., Ahmad, N., & Ismail, H. (2016). Psychometric Properties of a Digital Citizenship Questionnaire. International Education Studies, 9(3), 71–80. https://doi.org/10.5539/ies.v9n3p71
Özüdog, G. (2025). Conceptualizing pre-service teachers’ artificial intelligence readiness and examining its relationship with various variables: The role of artificial intelligence literacy, digital citizenship, artificial intelligence-enhanced innovation and perceived thr. Information Development, 41(3). https://doi.org/10.1177/02666669251335657
Pangrazio, L., & Sefton-Green, J. (2021). Digital Rights , Digital Citizenship and Digital Literacy : What ’ s the Difference ? Journal of New Approaches in Educational Research (NAER Journal), 10, 15–27. https://doi.org/10.7821/naer.2021.1.616
Reilly, M. O., Levine, D., Batchelor, R., Adams, S., Reilly, M. O., Levine, D., Batchelor, R., & Adams, S. (2024). Digital ethics of care and digital citizenship in UK primary schools : Children as interviewers Digital ethics of care and digital citizenship in UK primary ABSTRACT. Journal of Children and Media, 18(4), 585–604. https://doi.org/10.1080/17482798.2024.2394932
Sata, M., & Karakaya, I. (2020). Investigation of the Use of Electronic Portfolios in the Determination of Student Achievement in Higher Education Using the Many-Facet Rasch Measurement Model. Educational Policy Analysis and Strategic Research, 15(1), 9. https://doi.org/10.29329/epasr.2020.236.1
Sebasti, J., & Lozano-d, A. (2021). Measuring Digital Citizenship : A Comparative Analysis. Informatics, 1–13.
Valentine, N., Durning, S. J., Shanahan, E. M., Der, C. Van, Schuwirth, L., Valentine, N., Durning, S. J., Shanahan, E. M., & Der, C. Van. (2022). The pursuit of fairness in assessment : Looking beyond the objective. Medical Teacher, 44(4), 353–359. https://doi.org/10.1080/0142159X.2022.2031943
Veenhoven, R. (2012). Cross-national differences in happiness : Cultural measurement bias or effect of culture ? International Journal of Wellbeing, 2, 333–353. https://doi.org/10.5502/ijw.v2.i4.4
Webster, J. (2025). Sociotechnical Imaginaries in a Postdigital World : Teachers ’ Perceptions of Digital Citizenship Education. Postdigital Science and Education, 7(3), 770–787. https://doi.org/10.1007/s42438-025-00557-w
Wolfe, E. W. (2015). Detecting and Measuring Rater Effects Using Many-Facet Rasch Detecting and Measuring Rater Effects Using Many-Facet Rasch Measurement : Part I. Journal of Applied Measurement, February 2003, 386–422.
Yuanyuan, P., Alias, B. S., Mansor, A. N., Rashid, M., & Hamid, A. (2025). Development and validation of the principals ’ digital leadership instrument using Rasch measurement model. International Journal of Evaluation and Research in Education (IJERE), 14(3). https://doi.org/10.11591/ijere.v14i3.32214
Zlatkin-troitschanskaia, O., Schlax, J., Jitomirski, J., & Happ, R. (2019). Ethics and Fairness in Assessing Learning Outcomes in Higher Education. Higher Education Policy. https://doi.org/10.1057/s41307-019-00149-x
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Vita Fitriatul Ulya, Fikiy Afriyanto, Suparto, Kusaeri, Vacharee Dedduang
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
