Developing AI-Integrated Speaking Assessment via Yoodli for Vocational Tourism Students: A Borg and Gall Study
Abstract
This study addressed the lack of contextualized, efficient, and objective speaking assessments oriented toward sustainable tourism. At SMK Negeri 1 Medan, speaking activities were not sufficiently oriented toward sustainable tourism, while conventional teacher-led assessment was constrained by limited time, potential scoring subjectivity, and delayed individualized feedback. Therefore, this study aimed to develop and evaluate an AI-integrated speaking assessment using the Yoodli platform for vocational tourism students in Medan. Employing a Research and Development design adapted from the Borg and Gall model, the study involved needs analysis, product development, expert validation, and limited implementation with two English teachers and 60 Grade X–XI students. Data were collected through interviews, questionnaires, and validation instruments. Needs analysis revealed students’ difficulties in vocabulary, grammar, pronunciation, fluency, and confidence, while teachers reported time-consuming assessment and limited feedback. The developed assessment incorporated sustainable tourism tasks supported by Yoodli’s automated feedback. Expert validation yielded an overall score of 93.33% (highly valid), with content validity 95.25%, construct validity 95.00%, and practicality 90.25%. Student perceptions were highly positive (mean = 4.4/5). The findings indicate that the assessment is valid, usable, and contextually relevant for supporting speaking practice, immediate feedback, and independent learning in vocational tourism education.
Keywords
Full Text:
PDFReferences
Borg, W. R., Gall, M. D., & Gall, J. P. (2007). Educational research: An introduction.
Brown, H. D. (2004). Language assessment: Principles and classroom practices. In Pearson Education https://doi.org/10.1017/cbo9781139524834.005
Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom practices. In Pearson Education https://doi.org/10.65528/9780807779590-004
Chapelle, C. A. (2020). Artificial intelligence in language learning https://doi.org/10.1016/j.artint.2019.103181
Harmer, J. (2007). How to teach English (2nd ed.). Pearson Longman https://doi.org/10.35771/engdoi.2007.20.1.009
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education. Center for Curriculum Redesign https://doi.org/10.1007/978-981-13-6175-3_1
Inc., Y. (2023). Yoodli: AI-powered speech coaching platform. https://www.yoodli.ai
Indonesia, K. P. dan E. K. R. (2021). Pedoman pengembangan pariwisata berkelanjutan https://doi.org/10.24843/jumpa.2021.v08.i01.p08
Luoma, S. (2004). Assessing speaking https://doi.org/10.1017/cbo9780511733017.005
Organization, U. N. W. T. (2018). Tourism and the sustainable development goals: Journey to 2030 https://doi.org/10.4324/9780429490507-4
Prachanant, N. (2012). The development of English speaking skills for tourism students. Journal of Language and Education, 2(1), 1–12 https://doi.org/10.2466/10.24.27.pms.114.2.433-445
Richards, G., & Wilson, J. (2007). Tourism development trajectories: From culture to creativity?
Richards, J. C. (2006). Communicative language teaching today. In Cambridge University Press.
Saragih, R. D. B. (2022). Speaking needs of vocational tourism students in Medan. Journal of English Language Teaching and Linguistics, 7(2), 245–260.
Thongphut, S., & Kaur, M. (2023). English communication skills for tourism professionals. International Journal of Tourism and Hospitality Education, 37(1), 45–62.
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2020). The current landscape of learning analytics in education. Computers in Human Behavior, 109. https://doi.org/106538
DOI: https://doi.org/10.31004/jele.v11i5.3172
Refbacks
- There are currently no refbacks.
Copyright (c) 2026 Asrita Sari, Ricky Drimarcha Barus, Nurur Risky Aulia
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
