Examination of Motivation Scales: Is the Purpose Academic Promotion or the Need to Measure Psychological Constructs?
DOI:
https://doi.org/10.52963/PERR_Biruni_V11.N3.19Keywords:
Scale development, Motivation scales, Standard test development stages, Usage of scalesAbstract
The importance of measurement tools in education and psychology is indisputable. It is necessary to measure the affective characteristics of individuals in a valid and reliable manner. Numerous measurement tools have been developed to measure many psychological variables concerning humans. The aim of this research is to examine scale development studies in a technical sense and to determine the usage frequency of the reviewed studies. In line with the determined purpose, 43 motivation scales developed to measure motivation in various fields from the Turkey Index of Measurement Tools database were examined. In this study, which was designed as document analysis, one of the qualitative research designs, the data were examined through the forms developed by the researchers. According to the results, it was determined that there were serious technical errors in the development of measurement tools. It was determined that these errors are mainly in the concepts of test tryout and pilot application, exploratory factor analysis, and confirmatory factor analysis, which seriously affect the psychometric properties of the scales. In addition, when the usage frequencies of the scales were examined, more than half of the scales remained as just development work. Only 19 of the tools examined for motivation were used in other research studies. It is recommended that researchers work in accordance with the standard test development steps in developing scales. Before starting to develop a scale, it is recommended that researchers determine if the scale is really needed with a rigorous literature review.
Downloads
References
Acar Güvendir, M., & Özer Özkan, Y. (2015). Türkiye’deki eğitim alanında yayımlanan bilimsel dergilerde ölçek geliştirme ve uyarlama konulu makalelerin incelenmesi. Elektronik Sosyal Bilimler Dergisi, 52, 23-33. https://doi.org/10.17755/esosder.54872
Anastasi, A. (1988). Psychological testing. (6th Ed. ). New York: MacMillan Publishing Co. Inc.
Anderson, T. W., & Rubin, H. (1956). Statistical inference in factor analysis. In J. Neyman (Eds.), Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability (Vol. 5, pp. 111–150). California University Press.
American Educational Research Association. (2014). Standards for educational and psychological testing. American Educational Research Association American Psychological Association National Council on Measurement in Education.
Barış Pekmezci, F., & Ayan C. (2020). Confusion of scale development: Investigation of self-efficacy scales. Pamukkale Üniversitesi Eğitim Fakültesi Dergisi, 48, 130-151. https://doi.org/10.9779/pauefd.529986
Baron, R. A. (1983). Behavior in organizations. New York: Allyn and Bacon, Inc.
Baykul, Y. (2000). Eğitimde ve psikolojide ölçme: Klasik test teorisi ve uygulaması. Ankara: ÖSYM Yayınları.
Cohen, R. J., & Swerdlik, M. (2009). Psychological assessment: An introduction to tests and measurements. (7th Ed.). McGraw−Hill Primis.
Conway, M. J. (2006). How to collect data: Measurement and evaluation. American Society for Training and Development Press.
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. USA: Rinehart and Winston Inc.
Cronbach, L. J. (1990). Essentials of psychological testing. (5th Ed.). New York: Harper Collins Publishers.
Çüm, S., & Koç, N. (2013). Türkiye’de psikoloji ve eğitim bilimleri dergilerinde yayımlanan ölçek geliştirme ve uyarlama çalışmalarının incelenmesi, Eğitim Bilimleri ve Uygulama, 12(24), 115-135. Retrieved from https://www.idealonline.com.tr/IdealOnline/pdfViewer/index.xhtml?uId=5928&ioM=Paper&preview=true&isViewer=true#pagemode=bookmarks
Delice, A., & Ergene, Ö. (2015). Ölçek geliştirme ve uyarlama çalışmalarının incelenmesi: Matematik eğitimi makaleleri örneği. Karaelmas Eğitim Bilimleri Dergisi, 3(1), 60-75. Retrieved from https://dergipark.org.tr/tr/pub/kebd/issue/67216/1049114
DeVellis, R. F. (2016). Scale development: Theory and applications (Vol. 26). Sage publications.
Doğan, E. M. (2009). Türkiye’deki psikolojik çalışmalarda kullanılan testlerin psikometrik özelliklerinin incelenmesi: Kültürel açıdan test uyarlama çalışmalar. [Yayımlanmamış yüksek lisans tezi], Muğla Üniversitesi Sosyal Bilimler Fakültesi, Muğla.
Dörnyei, Z. (2000). Motivation in action: Towards a process‐oriented conceptualization of student motivation. British Journal of Educational Psychology, 70(4), 519-538. https://doi.org/10.1348/000709900158281
Erkuş, A. (2007). Ölçek geliştirme ve uyarlama çalışmalarında karşılaşılan sorunlar. Türk Psikoloji Bülteni, 13(40), 17-25. https://bursa.psikolog.org.tr/tr/yayinlar/dergiler/1031828/tpb134004.pdf
Erkuş, A. (2012). Psikolojide ölçme ve ölçek geliştirme-1: Temel kavramlar ve işlemler. Ankara: Pegem Akademi.
Field, A. (2009). Discovering statistics using IBM SPSS statistics. (4th ed.). Sage Publication: London.
Finch, W. H. (2020). Using fit statistic differences to determine the optimal number of factors to retain in an exploratory factor analysis. Educational and Psychological Measurement, 80(2), 217-241. https://doi.org/10.1177/0013164419865769
Gagné, M., Forest, J., Vansteenkiste, M., Crevier-Braud, L., Van den Broeck, A., Aspeli, A. K., ... & Westbye, C. (2015). The multidimensional work motivation scale: Validation evidence in seven languages and nine countries. European Journal of Work and Organizational Psychology, 24(2), 178-196. https://doi.org/10.1080/1359432X.2013.877892
Gudergan, S., Mathies, C., Kyngdon, A., & Kozicki, S. (2004, December). Negotiation style measurement scale development and testing. Paper presented at the Australian and New Zealand Marketing Academy Conference, Wellington. https://opus.lib.uts.edu.au/handle/10453/3133
Gül Ş., & Sözbilir, M. (2015). Fen ve matematik eğitimi alanında gerçekleştirilen ölçek geliştirme araştırmalarına yönelik tematik içerik analizi. Eğitim ve Bilim, 40(178), 85-102. http://dx.doi.org/10.15390/EB.2015.4070
Güler, G., & Ayan, C. (2020). Review of attitude scales developed in Turkey between 2002-2018 regarding the scale development process. Journal of Faculty of Educational Sciences, 53(3), 839-864. https://doi.org/10.30964/auebfd.658488
Hair, J. F., Black, C. W., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis. (8th Ed.). Annabel Ainscow: United Kingdom.
Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66(3), 393-416. https://doi.org/10.1177/0013164405282485
Hinkin, T. R. (1995). A review of scale development practices in the study in organizations. Journal of Management, 21(5), 967-988. https://doi.org/10.1177/014920639502100509
Howard, M. C. (2016). A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve? International Journal of Human-Computer Interaction, 32(1), 51-62. https://doi.org/10.1080/10447318.2015.1087664
Kaya Uyanık, G., Güler, N., Taşdelen Teker, G., & Demir, S. (2017). Türkiye’de eğitim alanında yayımlanan ölçek geliştirme çalışmalarının uygunluğunun çok yüzeyli Rasch modeli ile incelenmesi. Journal of Measurement and Evaluation in Education and Psychology, 8(2), 183-199. https://doi.org/10.21031/epod.291367
Lumsden, L. (1999). Student motivation: Cultivating a love of learning. ERIC Clearinghouse on Educational Management, 5207 University of Oregon, Eugene, OR 97403-5207
Maxwell, J. A. (1996). Qualitative research design: An interpretive approach. Thousand Oaks, CA: Sage.
McDonald R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: LEA Publisher.
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. California: SAGE Publications.
Özgüven, İ. E. (2011). Psikolojik testler. Ankara: Pegem Yayınları.
Patton, M. Q. (1990). Qualitative evaluation and research methods. (2th Ed.). Newbury Park, CA: Sage.
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. http://dx.doi.org/10.1080/00273171.2012.715555
Rindskopf, D. (1984). Using phantom and imaginary latent variables to parameterize constraints in linear structural models. Psychometrika, 49(1), 37-47. https://link.springer.com/content/pdf/10.1007/BF02294204.pdf
Ryan, R. M., & Deci, E. L. (2000). When rewards compete with nature: The undermining of intrinsic motivation and self-regulation. In C. Sansone and J. M. Harackiewicz (Eds.), Intrinsic and extrinsic motivation: The search foroptimal motivation and performance (pp. 13–54). New York: Academic.
Slavec, A., & Drnovsek, M. (2012). A perspective on scale development in entrepreneurship research. Economic and Business Review, 14(1), 39-62. http://ojs.ebrjournal.net/ojs/index.php/ebr/article/view/69/pdf
Tabachnick, B. G., & Fidell, L. S. (2014). Using multivariate statistics (6th ed.). Pearson: United States of America.
Tavşancıl, E., & Aslan, E. (2001). Sözel, yazılı ve diğer materyaller için içerik analizi ve uygulama örnekleri. İstanbul: Epsilon Yayın.
Tavşancıl, E., Güler, G., & Ayan, C. (2014). 2002-2012 yılları arasında Türkiye’de geliştirilen bazı tutum ölçeği geliştirme çalışmalarının ölçek geliştirme sureci acısından incelenmesi. IV. Ulusal Eğitimde ve Psikolojide Ölçme ve Değerlendirme Kongresi (Uluslararası Katılımlı) 9-13 Haziran, Hacettepe Üniversitesi, Ankara.
Toland, M. D., Sulis, I., Giambona, F., Porcu, M., & Campbell, J. M. (2017). Introduction to bifactor polytomous item response theory analysis. Journal of School Psychology, 60, 41-63. https://doi.org/10.1016/j.jsp.2016.11.001
Tosun, C., & Taşkesenligil, Y. (2015). The instruments used in science education in Turkey: A descriptive content analysis. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 15(2), 364- 383. Retrieved from https://dergipark.org.tr/tr/download/article-file/17460
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806-838. https://doi.org/10.1177/0011000006288127
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Psycho-Educational Research Reviews
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
