Utilizing Technology to Assess English Learning Outcomes of Students Based on a Competency-based Approach
DOI:
https://doi.org/10.54855/ictep.2455Keywords:
Competency-Based Assessment, Adaptive Learning, English Language ProficiencyAbstract
This study addresses the research gap in the integration of technology in evaluating English language learning outcomes, aiming to improve efficiency, accuracy, and flexibility in competency-based assessments. The research employs a mixed-methods approach, using quantitative data from online assessments. Participants included educators and learners engaged in English language programs across various educational institutions. The findings indicate that adaptive learning technologies significantly enhance accessibility, scalability, and student engagement in English language assessments. However, challenges such as technological limitations, data privacy issues, and the need for comprehensive teacher training are highlighted. This research underscores the potential of technology to transform competency-based English language proficiency examinations while offering practical insights for educational institutions, policymakers, and ed-tech companies to optimize these advancements effectively.
References
Alam, A. (2021, November). Possibilities and apprehensions in the landscape of artificial intelligence in education. In 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA) (pp. 1-8). IEEE.
Alamer, A., & Al Khateeb, A. (2023). Effects of using the WhatsApp application on language learners motivation: a controlled investigation using structural equation modelling. Computer Assisted Language Learning, 36(1-2), 149-175. https://doi.org/10.1080/09588221.2021.1903042
Alavi, S. M., Dashtestani, R., & Mellati, M. (2022). Crisis and changes in learning behaviors: Technology-enhanced assessment in language learning contexts. Journal of Further and Higher Education, 46(4), 461-474.
Alturki, U., & Aldraiweesh, A. (2021). Application of learning management system (LMS) during the covid-19 pandemic: A sustainable acceptance model of the expansion technology approach. Sustainability, 13(19), 10991. https://doi.org/10.3390/su131910991
Anderson, S. E., & Putman, R. S. (2020). Special education teachers’ experience, confidence, beliefs, and knowledge about integrating technology. Journal of Special Education Technology, 35(1), 37-50.
Bathmaker, A. M. (2021). Social class and mobility: Student narratives of class location in English higher education. Discourse: Studies in the Cultural Politics of Education, 42(1), 75-86.
Bereczki, E. O., & Kárpáti, A. (2021). Technology-enhanced creativity: A multiple case study of digital technology-integration expert teachers’ beliefs and practices. Thinking Skills and Creativity, 39, 100791. https://doi.org/10.1016/j.tsc.2021.100791
Boudadi, N. A., & Gutiérrez-Colón, M. (2020). Effect of Gamification on students’ motivation and learning achievement in Second Language Acquisition within higher education: a literature review 2011-2019. The EuroCALL Review, 28(1), 57-69. https://doi.org/10.4995/eurocall.2020.12974
Burns, R. (2020). Adult learner at work: The challenges of lifelong education in the new millennium.
Chang, Y. C., Li, J. W., & Huang, D. Y. (2022). A personalized learning service compatible with Moodle e-learning management system. Applied Sciences, 12(7), 3562. https://doi.org/10.3390/app12073562
Chirikov, I., Semenova, T., Maloshonok, N., Bettinger, E., & Kizilcec, R. F. (2020). Online education platforms scale college STEM instruction with equivalent learning outcomes at lower cost. Science Advances, 6(15), eaay5324.
Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J. (2021). A review of automated feedback systems for learners: Classification framework, challenges and opportunities. Computers & Education, 162, 104094. https://doi.org/10.1016/j.compedu.2020.104094
Durrant, P., Brenchley, M., & McCallum, L. (2021). Understanding development and proficiency in writing: Quantitative corpus linguistic approaches. Cambridge University Press.
Farrell, T. S., & Jacobs, G. M. (2020). Essentials for successful English language teaching. Bloomsbury Publishing.
Gallardo, A. (2020). Constructive alignment in language education. Language Teaching Review, 15(2), 78-91.
Gallardo, K. (2020). Competency-based assessment and the use of performance-based evaluation rubrics in higher education: Challenges towards the next decade. Problems of Education in the 21st Century, 78(1), 61-79.
Godwin-Jones, R. (2021). Evolving technologies for language learning. Hawaii University.
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied sciences, 11(12), 5467. https://doi.org/10.3390/app11125467
Greene, D. (2021). The promise of access: Technology, inequality, and the political economy of hope. mit press.
Hasal, M., Nowaková, J., Ahmed Saghair, K., Abdulla, H., Snášel, V., & Ogiela, L. (2021). Chatbots: Security, privacy, data protection, and social aspects. Concurrency and Computation: Practice and Experience, 33(19), e6426.
Hirumi, A., Horger, L., Harris, D. M., Berry, A., Daroowalla, F., Gillum, S., ... & Cendán, J. C. (2022). Exploring students’ [pre-pandemic] use and the impact of commercial-off-the-shelf learning platforms on students’ national licensing exam performance: A focused review–BEME Guide No. 72. Medical Teacher, 44(7), 707-719.
Ho, L. T. P., Doan, N. A. H., & Dinh, T. L. (2023). An investigation into the online assessment and the autonomy of non-English majored students in Vinh Long Province. ICTE Conference Proceedings, 3, 41–51. https://doi.org/10.54855/ictep.2334
Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022). Artificial intelligence for assessment and feedback to enhance student success in higher education. Mathematical Problems in Engineering, 2022(1), 5215722.
Huang, J., Saleh, S., & Liu, Y. (2021). A review on artificial intelligence in education. Academic Journal of Interdisciplinary Studies, 10(3). 206-217. https://doi.org/10.36941/ajis-2021-0077
Jannah, M., Prasojo, L. D., & Jerusalem, M. A. (2020). Elementary school teachers' perceptions of digital technology-based learning in the 21st century: Promoting digital technology as the proponent learning tools. Al Ibtida: Jurnal Pendidikan Guru MI, 7(1), 1-18.
Kotkin, J. (2023). The coming of neo-feudalism: A warning to the global middle class. Encounter Books.
Kwik, J. (2023). Limitless Expanded Edition: Upgrade Your Brain, Learn Anything Faster, and Unlock Your Exceptional Life. Hay House, Inc.
Landsman, J., & Lewis, C. W. (Eds.). (2023). White teachers/diverse classrooms: Creating inclusive schools, building on students’ diversity, and providing true educational equity. Taylor & Francis.
Lawrence, G., Ahmed, F., Cole, C., & Johnston, K. P. (2020). Not more technology but more effective technology: Examining the state of technology integration in EAP programmes. Relc Journal, 51(1), 101-116. https://doi.org/10.1177/0033688220907199
Le, T. N., Allen, B., & Johnson, N. F. (2022). Blended learning: Barriers and drawbacks for English language lecturers at Vietnamese universities. E-learning and Digital Media, 19(2), 225-239. https://doi.org/10.1177/20427530211048235
Lee, S., Kuo, L. J., Xu, Z., & Hu, X. (2022). The effects of technology-integrated classroom instruction on K-12 English language learners’ literacy development: A meta-analysis. Computer Assisted Language Learning, 35(5-6), 1106-1137. https://doi.org/10.1080/09588221.2020.1774612
Li, F., & Wang, C. (2023). Artificial intelligence and edge computing for teaching quality evaluation based on 5G-enabled wireless communication technology. Journal of Cloud Computing, 12(1), 45. https://doi.org/10.1186/s13677-023-00418-6
Liu, Z. Y., Lomovtseva, N., & Korobeynikova, E. (2020). Online learning platforms: Reconstructing modern higher education. International Journal of Emerging Technologies in Learning (iJET), 15(13), 4-21.
Loewen, S., Isbell, D. R., & Sporn, Z. (2020). The effectiveness of app‐based language instruction for developing receptive linguistic knowledge and oral communicative ability. Foreign Language Annals, 53(2), 209-233. https://doi.org/10.1111/flan.12454
Mattsson, T., & Pastorek Gripson, M. (2023). Dancing with digital tools: Discourses on teaching and learning in school-age education in Sweden. In The 8th IAFOR International Conference on Education, Honolulu, USA, 5-8/1 2023 (pp. 491-503).
Mirza, C., Teymoori, H., & Mirza, H. (2023). Teachers’ perspectives on the competency-based approach: Assessing readiness for a new educational reform. International Journal of Learning, Teaching and Educational Research, 22(9), 241-260.
Mirza, N., et al. (2023). Shifting assessment paradigms: Evaluating skills and attitudes. International Journal of Language Studies, 18(1), 55-74.
Musa, S. Z. B. S. (2024). Digital Renaissance: Reinventing Tertiary Language Teaching and Learning Strategies in Evolving Digital Landscape. Education towards a Global Citizen Generation, 202.
Polizzi, G. (2020). Digital literacy and the national curriculum for England: Learning from how the experts engage with and evaluate online content. Computers & Education, 152, 103859. https://doi.org/10.1016/j.compedu.2020.103859
Rafiola, R., Setyosari, P., Radjah, C., & Ramli, M. (2020). The effect of learning motivation, self-efficacy, and blended learning on students’ achievement in the industrial revolution 4.0. International Journal of Emerging Technologies in Learning (iJET), 15(8), 71-82.
Reich, J. (2020). Failure to disrupt: Why technology alone can’t transform education. Harvard University Press.
Sailer, M., Stadler, M., Schultz-Pernice, F., Franke, U., Schöffmann, C., Paniotova, V., ... & Fischer, F. (2021). Technology-related teaching skills and attitudes: Validation of a scenario-based self-assessment instrument for teachers. Computers in Human Behavior, 115, 106625. https://doi.org/10.1016/j.chb.2020.106625
Sanger, C. S. (2020). Inclusive pedagogy and universal design approaches for diverse learning environments. In Diversity and inclusion in global higher education: Lessons from across Asia (pp. 31-71).
Saubern, R., Urbach, D., Koehler, M., & Phillips, M. (2020). Describing increasing proficiency in teachers’ knowledge of the effective use of digital technology. Computers & Education, 147, 103784. https://doi.org/10.1016/j.compedu.2019.103784
Schmitt, N., Nation, P., & Kremmel, B. (2020). Moving the field of vocabulary assessment forward: The need for more rigorous test development and validation. Language Teaching, 53(1), 109-120. https://doi.org/10.1017/S0261444819000326
Shadiev, R., & Yang, M. (2020). Review of studies on technology-enhanced language learning and teaching. Sustainability, 12(2), 524. https://doi.org/10.3390/su12020524
Shi, J., & Fan, L. (2021). Investigating teachers’ and students’ perceptions of online English learning in a maritime context in China. Sage Open, 11(3), 21582440211040800. https://doi.org/10.1177/21582440211040800
Sinaga, R. R. F., & Oktaviani, L. (2020). The implementation of fun fishing to teach speaking for elementary school students. Journal of English Language Teaching and Learning, 1(1), 1-6.
Van, D. T. H., & Thı, H. H. Q. (2021). Student barriers to prospects of online learning in Vietnam in the context of COVID-19 pandemic. Turkish Online Journal of Distance Education, 22(3), 110-123. https://doi.org/10.17718/tojde.961824
Villegas-Ch, W., Roman-Cañizares, M., Jaramillo-Alcázar, A., & Palacios-Pacheco, X. (2020). Data analysis as a tool for the application of adaptive learning in a university environment. Applied Sciences, 10(20), 7016.
Vitchenko, A., Vitchenko, A., Zamotaieva, N., Khrystiuk, S., & Nikolayenko, V. (2022). Designing integral learning outcomes in higher education within the frameworks of the competency-based approach. Journal of Higher Education Theory and Practice, 22(6), 1-13.
Vo, T., Truong, D., & Nguyen, P. (2023). The impact of digital technology on content and language integrated learning in higher education: A systematic review of literature. ICTE Conference Proceedings, 3, 137–147. https://doi.org/10.54855/ictep.23311
Voithofer, R., & Nelson, M. J. (2021). Teacher educator technology integration preparation practices around TPACK in the United States. Journal of teacher education, 72(3), 314-328. https://doi.org/10.1177/0022487120949842
Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers & Education, 163, 104097. https://doi.org/10.1016/j.compedu.2020.104097
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Duong Thi Thu Huyen
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright and grant the picte the right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the proceedings' published version of the work (e.g., post it to an institutional repository, in a journal, or publish it in a book), with an acknowledgment of its initial publication in this proceedings.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process.
