A CEFR Based Evaluation of B1+ Level Preparatory Program at A Turkish State University: The Application of the Foreign Language Skills Scale
DOI:
https://doi.org/10.52963/PERR_Biruni_V10.N3.27Keywords:
Common European Framework, Foreign Language Skills Scale, Language Program EvaluationAbstract
Despite the centrality of the Common European Framework of Reference for Languages (CEFR) in language teaching and assessment, studies investigating its learning outcomes in language program evaluations are quite scarce. This paper aims to evaluate the effectiveness of a modular English preparatory school program through the Foreign Language Skills Scale. The research sample consists of 357 preparatory school students having attained B1+ level of proficiency in the program. The results revealed that while the language program designed to be in line with the CEFR guidelines, in general, serves for the needs of the students, there are still some discrepancies between the learning outcomes of B1+ and opinions of students about their competencies, especially in listening sub-skills.Downloads
References
Arslan, Recep Ş. “The Development of a Scale to Evaluate Foreign Language Skills at Preparatory Schools”. International Journal of Assessment Tools in Education, 2020, 7 (2) (2020): 223-235.
Cohen, Jacob. (1988). Statistical Power Analysis for the Behavioral Sciences. New York, NY: Routledge Academic.
Coşkun, Abdullah. “An investigation of the effectiveness of the modular general English language teaching preparatory program at a Turkish university”. South African Journal of Education, 33 (3) (2013): 1-18.
Council of Europe (CoE). Common European framework of reference for languages: Learning, teaching, assessment. Strasbourg, France: Council of Europe. Cambridge University Press, 2001. Retrieved from https://www.coe.int/en/web/common-european-frame work reference-languages.
Creswell, John W. Educational research: Planning, conducting, and evaluating quantitative and qualitative research (5th ed.). Boston, MA: Pearson, 2015.
Ekşi, Gonca Y. “Designing curriculum for second and foreign language studies”. In A. Sarıçoban (Ed.), ELT methodology. Ankara: Anı Yayıncılık, 2017.
Erdem, Hikmet E. “Evaluating the English language Curriculum at a Private School in Ankara: A Case Study” Yayınlamamış Doktora Tezi. Middle East Technical University, Ankara, 1999.
Fulcher Glenn. “Criteria for evaluating language quality”. In E. Shohamy (Ed.), Language testing and assessment. Encyclopedia of language and education, (pp. 157-176), 7. Amsterdam: Springer, 2008.
George, Darren and Mallery, Paul. (2010). SPSS for Windows Step by Step: A Simple Guide and Reference, 17.0 update (10a ed.) Boston: Pearson.
Gerede, Derya. “A Curriculum Evaluation Through Needs Analysis: Perceptions of Intensive English Programme Graduates at Anadolu University” Yayınlanmamış Yüksek Lisans tezi. Anadolu University, Eskisehir, 2005.
Gökdemir, Cem V. “Üniversitelerimizde Verilen Yabancı Dil Öğretimindeki Başarı Durumumuz (Our Success in Foreign Language Teaching in Our Universities)”. Atatürk Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 6 (2) (2010): 251‒264. Retrieved from http://dergipark.gov.tr/ataunisosbil/issue /2816/37912
Güllü, Seda. A. “An evaluation of English programme at Kozan Vocational School of Çukurova University: Students’ point of view” Yayınlanmamış Yüksek Lisans Tezi. Çukurova Universitesi, Adana, 2007.
Hopkins, David. Evaluation for school development. Milton Keynes: Open University Press, 1989.
Jones, Neil and Saville, Nick. (2009). “European language policy: Assessment, learning, and the CEFR”. Annual Review of Applied Linguistics, 29 (2009): 51–63.
Karataş, Hakan. “Yıldız Teknik Üniversitesi Modern Diller Bölümü İngilizce 2. Dersi Öğretim Programının Öğretmen ve Öğrenci Görüşlerine Göre Bağlam, Girdi, Süreç ve Ürün (CIPP) Modeli ile Değerlendirilmesi” Yayınlanmamış Yüksek Lisans Tezi. Yıldız Teknik Üniversitesi, İstanbul, 2007.
Kınsız, Mustafa and Aydın, Hüseyin. “Yükseköğretimde yabancı dil öğrenim ve öğretim sorununun değerlendirilmesi ve yabancı dil politikası üzerine düşünceler (Evaluating the problem of foreign language learning and teaching in higher education and reflecting on foreign language policy)”. Yabancı dil Bölümleri ve Yüksekokullarının Yabancı Dil Öğretimindeki Sorunları Kurultayı (Problems of Foreign Languages Departments and Schools in Foreign Language Teaching) (pp. 71-82). Muğla University, 7-9 May, 2008.
Kırkgöz, Yasemin. “Motivation and student perception of studying in an English-medium university”. Journal of Language and Linguistic Studies, 1 (1) (2005): 101–123.
North, Brian. The development of a common framework scale of language proficiency. New York: Peter Lang, 2000.
North, Brian. The CEFR common reference levels: Validated reference points and local strategies. In Language Policy Forum Report (pp. 19‒29). Strasbourg: Cambridge University Press, 2007.
North, Brian and Schneider, Günther. “Scaling descriptors for language proficiency scales”. Language Testing, 15 (1998): 217-262.
Özkanal, Ümit and Hakan, Ayhan G. “Effectiveness of University English Preparatory Programs: Eskişehir Osmangazi University Foreign Languages Department English Preparatory Program”. Journal of Language Teaching and Research, 1 (3) (2010): 295-305.
Peaci, Davut. “A Class of Cultures: European and Turkish Goals in Language Education versus University Academic Requirements”. Anthropologist, 22 (2) (2015): 355‒361.
Scriven, Michael. Evaluation Thesaurus (4th ed.). Newbury Park, CA: Sage, 1991.
Seçer, İ. (2015). Psikolojik test geliştirme ve uyarlama süreci. Ankara: Anı Yayıncılık.
Stufflebeam, Daniel L. “The relevance of the CIPP evaluation model for educational accountability”. Journal of Research and Development in Education, 5 (1971): 19-25.
Tekin, Mustafa. “Evaluation of a Preparatory School Program at a Public University in Turkey”. The Journal of International Social Research, 8 (36) (2015): 718-733.
Topçu, Tansu. “An investigation of the Effectiveness of Theme-Based Curriculum in the 2003-2004 Academic Year at the Department of Basic English at Middle East Technical University” Yayınlanmamış Yüksek Lisans Tezi. Middle Est technical University, Ankara, 2005.
Üstünlüoğlu, Evrim, Zazaoğlu, Kısmet F., Keskin, Michelle N., Sarayköylü, Beril & Akdoğan, Gülfem. “Developing a CEF based curriculum: a case study”. International Journal of Instruction, 5 (1) (2012): 115-128.
Worthen, Blaine. “Program evaluation”. In H. Walberg & G. Haertel (Eds.), The international encyclopedia of educational evaluation (pp. 42-47). Toronto, ON: Pergammon Press, 1990.
Additional Files
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.