Analisis Psikometrika Properti dan Latent Sub Kelas dengan Mixture Rasch Model Pada Skala Organizational Commitment Questionnaire (OCQ) versi Indonesia

Fransiscus Widodo Setya Budi; Alexander Bhirowo Putra Kurniawan; Ananta Yudiarso

doi:10.21009/JPPP.141.05

Authors

Fransiscus Widodo Setya Budi Fakultas Psikologi, Universitas Surabaya, Surabaya, 60293, Indonesia
Alexander Bhirowo Putra Kurniawan Fakultas Psikologi, Universitas Surabaya, Surabaya, 60293, Indonesia
Ananta Yudiarso Fakultas Psikologi, Universitas Surabaya, Surabaya, 60293, Indonesia

DOI:

https://doi.org/10.21009/JPPP.141.05

Keywords:

Organizational Commitment Questionnaire, Rasch Model, validitas, reliabilitas

Abstract

This study evaluates the psychometric properties of the Indonesian version of the Organizational Commitment Questionnaire (OCQ) using the Rasch Model and Mixture Rasch Model. A quantitative approach was used to analyze data from 253 participants obtained through a survey using a convenience sampling technique. The points analyzed are related to validity, reliability, and unidimensionality and heterogeneity of response patterns. Results indicate that the affective, continuance, and normative subscales exhibit adequate evidence of unidimensionality, with raw variance explained ranging from 44% to 46%. Reliability testing revealed high item reliability (0.97–0.98) but moderate to low person reliability (0.58–0.66), suggesting limited sensitivity of the instrument to individual variations. Differential Item Functioning (DIF) analysis identified significant bias in several items of the affective and continuance subscales based on gender and education, while the normative subscale was neutral to these demographic variables. The Mixture Rasch Model analysis revealed heterogeneity in response patterns, with the two-class latent model showing lower AIC, BIC, and CAIC values compared to the one-class model, indicating a better fit. This study demonstrates that the Indonesian version of the OCQ can be utilized to measure organizational commitment but requires item adjustments to improve measurement sensitivity and fairness

References

Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52(3), 317–332. https://doi.org/10.1007/BF02294359

Allen, N. J., & Meyer, J. P. (1990). The measurement and antecedents of affective, continuance, and normative commitment to the organization. Journal of Occupational Psychology, 63(1), 1–18. https://doi.org/10.1111/j.2044-8325.1990.tb00506.x

Astuti, R., Nugroho, A., & Setiawan, D. (2020). Adaptasi budaya pada skala komitmen organisasi: Pendekatan CFA. Jurnal Psikologi Indonesia, 36(2), 215–230. https://doi.org/10.22146/jpsi.2020.12345

Aziz, A., Noor, N., & Rosli, R. (2017). A comparative study of reliability measures: Cronbach’s Alpha versus composite reliability. Journal of Advanced Research in Social Sciences, 11(4), 45–53.

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014

Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). New York, NY: Routledge.

Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. New York, NY: Springer.

Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY:Guilford Press.

Burnham, K. P., & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). New York, NY: Springer.

Byrne, B. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum Associates.

Chen, Z. X., & Francesco, A. M. (2000). Employee demography, organizational commitment, and turnover intentions in China: Do cultural differences matter? Human Relations, 53(6), 869–887. https://doi.org/10.1177/0018726700536005

Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Boston,MA: Pearson.

Elsmore, B. (2008). Organizational psychology: A guide to better performance. London: Routledge.

Finch, W. H., & French, B. F. (2015). Latent variable modeling with R. New York, NY: Routledge.

Hair, J. F., Hult, G. T. M., & Ringle, C. M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM). Thousand Oaks, CA: SAGE Publications.

Holster, T., & Lake, J. (2016). Evaluating psychometric properties of measurement tools using Rasch analysis. Journal of Applied Psychology, 10(3), 25–35.

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Ismail, N. (2011). Differential item functioning: A comparison of methods. International Journal of Educational Research, 56(2), 105–115. https://doi.org/10.1016/j.ijer.2011.04.007

Jonathan, R. (2020). Adaptation and validation of the organizational commitment questionnaire in Tanzania. African Journal of Organizational Studies, 12(3), 45–63.

Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151. https://doi.org/10.1177/001316446002000116

Kanning, U. P., & Hill, A. (2013). Cross-cultural adaptations of the organizational commitment questionnaire: Challenges and outcomes. International Journal of Cross-Cultural Management, 13(1), 53–71.

Kaur, R., & Sharma, S. (2015). Validation of the organizational commitment questionnaire in Indian context. Asian Journal of Management Research, 6(1), 102–109.

Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(4), 328. Retrieved from https://www.rasch.org/rmt/rmt74m.htm

Linacre, J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16(2), 878. Retrieved from https://www.rasch.org/rmt/rmt162f.htm

Linacre, J. M. (2009). A user’s guide to Winsteps Ministep: Rasch-model computer programs (Version 3.68). Beaverton, OR: Winsteps.com.

Linacre, J. M. (2011). Investigating dimensionality using Rasch principal component analysis of residuals. Journal of Applied Measurement, 12(3), 321–338.

Mathieu, J. E., & Zajac, D. M. (1990). A review and meta-analysis of the antecedents, correlates, and consequences of organizational commitment. Psychological Bulletin, 108(2), 171–194. https://doi.org/10.1037/0033-2909.108.2.171

Meyer, J. P., & Allen, N. J. (1991). A three-component conceptualization of organizational commitment. Human Resource Management Review, 1(1), 61–89. https://doi.org/10.1016/1053-4822(91)90011-Z

Meyer, J. P., Allen, N. J., & Smith, C. A. (1993). Commitment to organizations and occupations: Extension and test of a three-component conceptualization. Journal of Applied Psychology, 78(4), 538–551. https://doi.org/10.1037/0021-9010.78.4.538

Meyer, J. P., Stanley, D. J., Herscovitch, L., & Topolnytsky, L. (2002). Affective, continuance, and normative commitment to the organization: A meta-analysis of antecedents, correlates, and consequences. Journal of Vocational Behavior, 61(1), 20–52. https://doi.org/10.1006/jvbe.2001.1842

Morgeson, F. P., Reider, M. H., & Campion, M. A. (2005). Selecting individuals in team settings: The importance of social skills, personality characteristics, and teamwork knowledge. Personnel Psychology, 58(3), 583–611. https://doi.org/10.1111/j.1744-6570.2005.655.x

Mowday, R. T., Steers, R. M., & Porter, L. W. (1979). The measurement of organizational commitment. Journal of Vocational Behavior, 14(2), 224–247. https://doi.org/10.1016/0001-8791(79)90072-1

Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4(3), 207–230. https://doi.org/10.2307/1164671

Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437

Rost, J. (1990). Rasch models in latent classes: An integration of two approaches to item analysis. New York, NY: Springer.

Schaufeli, W. B. (2017). Applying the Job Demands-Resources model: A 'how to' guide to measuring and tackling work engagement and burnout. Organizational Dynamics, 46(2), 120–132. https://doi.org/10.1016/j.orgdyn.2017.04.008

Siregar, S. (2018). Statistik parametrik untuk penelitian kuantitatif: Dilengkapi perhitungan manual dan aplikasi SPSS versi 17. Jakarta: Bumi Aksara.

Smith, R. M. (2002). Understanding Rasch measurement: Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3(2), 205–231.

Sudaryono. (2012). Metodologi penelitian: Proses dan penerapan. Bandung: PT Refika Aditama.

Sulistiawan, A., Sari, E. Y. D., & Situmorang, N. Z. (2021). Validitas dan reliabilitas konstruk komitmen organisasi dengan pendekatan Confirmatory Factor Analysis (CFA). Psikostudia, Vol 10, no 1. Hal. 61-68.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi model Rasch untuk penelitian ilmu-ilmu sosial. Bandung: Trim Komunikata Publishing House.

Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002

von Davier, M., & Yamamoto, K. (2004). Mixture models in item response theory. Annals of the Institute of Statistical Mathematics, 56(1), 165–183. https://doi.org/10.1007/BF02530318

von Davier, M., & Rost, J. (2007). Mixture distribution Rasch models. In Handbook of Modern Item Response Theory (pp. 251–266). New York, NY: Springer

Wang, Y. D., & Hsieh, H. H. (2010). Commitment to employees: Does it help or hinder organizational performance? Human Resource Management Journal, 20(3), 305–319. https://doi.org/10.1111/j.1748-8583.2010.00135.x

Wiener, Y. (1982). Commitment in organizations: A normative view. Academy of Management Review, 7(3), 418–428. https://doi.org/10.5465/amr.1982.4285349

Wu, M. L., & Adams, R. J. (2007). Applying the Rasch model to psychometric assessment. Mahwah, NJ: Lawrence Erlbaum Associates.

Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Ottawa: Directorate of Human Resources Research and Evaluation, Department of National Defense.