Utilizing Technology to Assess English Learning Outcomes of Students Based on a Competency-based Approach

Authors

DOI:

https://doi.org/10.54855/ictep.2455

Keywords:

Competency-Based Assessment, Adaptive Learning, English Language Proficiency

Abstract

This study addresses the research gap in the integration of technology in evaluating English language learning outcomes, aiming to improve efficiency, accuracy, and flexibility in competency-based assessments. The research employs a mixed-methods approach, using quantitative data from online assessments. Participants included educators and learners engaged in English language programs across various educational institutions. The findings indicate that adaptive learning technologies significantly enhance accessibility, scalability, and student engagement in English language assessments. However, challenges such as technological limitations, data privacy issues, and the need for comprehensive teacher training are highlighted. This research underscores the potential of technology to transform competency-based English language proficiency examinations while offering practical insights for educational institutions, policymakers, and ed-tech companies to optimize these advancements effectively.

Author Biography

Duong Thi Thu Huyen, Vietnam National University, International School, Ha Noi, Vietnam

Duong Thi Thu Huyen, a Ph.D. candidate, focuses on language education, assessment, and educational management. Specializing in applied linguistics, she delves into English language pedagogy, assessment methodologies, and educational administration. Committed to teaching English and enhancing language skills, she also ensures fair language assessments. Huyen's research interests include academic English proficiency, cultural intersections in language education, and effective educational management. Through her work, she aims to enrich language teaching practices, advance assessment strategies, and contribute to educational management, fostering a holistic approach to language education and assessment.

References

Alam, A. (2021, November). Possibilities and apprehensions in the landscape of artificial intelligence in education. In 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA) (pp. 1-8). IEEE.

Alamer, A., & Al Khateeb, A. (2023). Effects of using the WhatsApp application on language learners motivation: a controlled investigation using structural equation modelling. Computer Assisted Language Learning, 36(1-2), 149-175. https://doi.org/10.1080/09588221.2021.1903042

Alavi, S. M., Dashtestani, R., & Mellati, M. (2022). Crisis and changes in learning behaviors: Technology-enhanced assessment in language learning contexts. Journal of Further and Higher Education, 46(4), 461-474.

Alturki, U., & Aldraiweesh, A. (2021). Application of learning management system (LMS) during the covid-19 pandemic: A sustainable acceptance model of the expansion technology approach. Sustainability, 13(19), 10991. https://doi.org/10.3390/su131910991

Anderson, S. E., & Putman, R. S. (2020). Special education teachers’ experience, confidence, beliefs, and knowledge about integrating technology. Journal of Special Education Technology, 35(1), 37-50.

Bathmaker, A. M. (2021). Social class and mobility: Student narratives of class location in English higher education. Discourse: Studies in the Cultural Politics of Education, 42(1), 75-86.

Bereczki, E. O., & Kárpáti, A. (2021). Technology-enhanced creativity: A multiple case study of digital technology-integration expert teachers’ beliefs and practices. Thinking Skills and Creativity, 39, 100791. https://doi.org/10.1016/j.tsc.2021.100791

Boudadi, N. A., & Gutiérrez-Colón, M. (2020). Effect of Gamification on students’ motivation and learning achievement in Second Language Acquisition within higher education: a literature review 2011-2019. The EuroCALL Review, 28(1), 57-69. https://doi.org/10.4995/eurocall.2020.12974

Burns, R. (2020). Adult learner at work: The challenges of lifelong education in the new millennium.

Chang, Y. C., Li, J. W., & Huang, D. Y. (2022). A personalized learning service compatible with Moodle e-learning management system. Applied Sciences, 12(7), 3562. https://doi.org/10.3390/app12073562

Chirikov, I., Semenova, T., Maloshonok, N., Bettinger, E., & Kizilcec, R. F. (2020). Online education platforms scale college STEM instruction with equivalent learning outcomes at lower cost. Science Advances, 6(15), eaay5324.

Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J. (2021). A review of automated feedback systems for learners: Classification framework, challenges and opportunities. Computers & Education, 162, 104094. https://doi.org/10.1016/j.compedu.2020.104094

Durrant, P., Brenchley, M., & McCallum, L. (2021). Understanding development and proficiency in writing: Quantitative corpus linguistic approaches. Cambridge University Press.

Farrell, T. S., & Jacobs, G. M. (2020). Essentials for successful English language teaching. Bloomsbury Publishing.

Gallardo, A. (2020). Constructive alignment in language education. Language Teaching Review, 15(2), 78-91.

Gallardo, K. (2020). Competency-based assessment and the use of performance-based evaluation rubrics in higher education: Challenges towards the next decade. Problems of Education in the 21st Century, 78(1), 61-79.

Godwin-Jones, R. (2021). Evolving technologies for language learning. Hawaii University.

González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied sciences, 11(12), 5467. https://doi.org/10.3390/app11125467

Greene, D. (2021). The promise of access: Technology, inequality, and the political economy of hope. mit press.

Hasal, M., Nowaková, J., Ahmed Saghair, K., Abdulla, H., Snášel, V., & Ogiela, L. (2021). Chatbots: Security, privacy, data protection, and social aspects. Concurrency and Computation: Practice and Experience, 33(19), e6426.

Hirumi, A., Horger, L., Harris, D. M., Berry, A., Daroowalla, F., Gillum, S., ... & Cendán, J. C. (2022). Exploring students’ [pre-pandemic] use and the impact of commercial-off-the-shelf learning platforms on students’ national licensing exam performance: A focused review–BEME Guide No. 72. Medical Teacher, 44(7), 707-719.

Ho, L. T. P., Doan, N. A. H., & Dinh, T. L. (2023). An investigation into the online assessment and the autonomy of non-English majored students in Vinh Long Province. ICTE Conference Proceedings, 3, 41–51. https://doi.org/10.54855/ictep.2334

Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022). Artificial intelligence for assessment and feedback to enhance student success in higher education. Mathematical Problems in Engineering, 2022(1), 5215722.

Huang, J., Saleh, S., & Liu, Y. (2021). A review on artificial intelligence in education. Academic Journal of Interdisciplinary Studies, 10(3). 206-217. https://doi.org/10.36941/ajis-2021-0077

Jannah, M., Prasojo, L. D., & Jerusalem, M. A. (2020). Elementary school teachers' perceptions of digital technology-based learning in the 21st century: Promoting digital technology as the proponent learning tools. Al Ibtida: Jurnal Pendidikan Guru MI, 7(1), 1-18.

Kotkin, J. (2023). The coming of neo-feudalism: A warning to the global middle class. Encounter Books.

Kwik, J. (2023). Limitless Expanded Edition: Upgrade Your Brain, Learn Anything Faster, and Unlock Your Exceptional Life. Hay House, Inc.

Landsman, J., & Lewis, C. W. (Eds.). (2023). White teachers/diverse classrooms: Creating inclusive schools, building on students’ diversity, and providing true educational equity. Taylor & Francis.

Lawrence, G., Ahmed, F., Cole, C., & Johnston, K. P. (2020). Not more technology but more effective technology: Examining the state of technology integration in EAP programmes. Relc Journal, 51(1), 101-116. https://doi.org/10.1177/0033688220907199

Le, T. N., Allen, B., & Johnson, N. F. (2022). Blended learning: Barriers and drawbacks for English language lecturers at Vietnamese universities. E-learning and Digital Media, 19(2), 225-239. https://doi.org/10.1177/20427530211048235

Lee, S., Kuo, L. J., Xu, Z., & Hu, X. (2022). The effects of technology-integrated classroom instruction on K-12 English language learners’ literacy development: A meta-analysis. Computer Assisted Language Learning, 35(5-6), 1106-1137. https://doi.org/10.1080/09588221.2020.1774612

Li, F., & Wang, C. (2023). Artificial intelligence and edge computing for teaching quality evaluation based on 5G-enabled wireless communication technology. Journal of Cloud Computing, 12(1), 45. https://doi.org/10.1186/s13677-023-00418-6

Liu, Z. Y., Lomovtseva, N., & Korobeynikova, E. (2020). Online learning platforms: Reconstructing modern higher education. International Journal of Emerging Technologies in Learning (iJET), 15(13), 4-21.

Loewen, S., Isbell, D. R., & Sporn, Z. (2020). The effectiveness of app‐based language instruction for developing receptive linguistic knowledge and oral communicative ability. Foreign Language Annals, 53(2), 209-233. https://doi.org/10.1111/flan.12454

Mattsson, T., & Pastorek Gripson, M. (2023). Dancing with digital tools: Discourses on teaching and learning in school-age education in Sweden. In The 8th IAFOR International Conference on Education, Honolulu, USA, 5-8/1 2023 (pp. 491-503).

Mirza, C., Teymoori, H., & Mirza, H. (2023). Teachers’ perspectives on the competency-based approach: Assessing readiness for a new educational reform. International Journal of Learning, Teaching and Educational Research, 22(9), 241-260.

Mirza, N., et al. (2023). Shifting assessment paradigms: Evaluating skills and attitudes. International Journal of Language Studies, 18(1), 55-74.

Musa, S. Z. B. S. (2024). Digital Renaissance: Reinventing Tertiary Language Teaching and Learning Strategies in Evolving Digital Landscape. Education towards a Global Citizen Generation, 202.

Polizzi, G. (2020). Digital literacy and the national curriculum for England: Learning from how the experts engage with and evaluate online content. Computers & Education, 152, 103859. https://doi.org/10.1016/j.compedu.2020.103859

Rafiola, R., Setyosari, P., Radjah, C., & Ramli, M. (2020). The effect of learning motivation, self-efficacy, and blended learning on students’ achievement in the industrial revolution 4.0. International Journal of Emerging Technologies in Learning (iJET), 15(8), 71-82.

Reich, J. (2020). Failure to disrupt: Why technology alone can’t transform education. Harvard University Press.

Sailer, M., Stadler, M., Schultz-Pernice, F., Franke, U., Schöffmann, C., Paniotova, V., ... & Fischer, F. (2021). Technology-related teaching skills and attitudes: Validation of a scenario-based self-assessment instrument for teachers. Computers in Human Behavior, 115, 106625. https://doi.org/10.1016/j.chb.2020.106625

Sanger, C. S. (2020). Inclusive pedagogy and universal design approaches for diverse learning environments. In Diversity and inclusion in global higher education: Lessons from across Asia (pp. 31-71).

Saubern, R., Urbach, D., Koehler, M., & Phillips, M. (2020). Describing increasing proficiency in teachers’ knowledge of the effective use of digital technology. Computers & Education, 147, 103784. https://doi.org/10.1016/j.compedu.2019.103784

Schmitt, N., Nation, P., & Kremmel, B. (2020). Moving the field of vocabulary assessment forward: The need for more rigorous test development and validation. Language Teaching, 53(1), 109-120. https://doi.org/10.1017/S0261444819000326

Shadiev, R., & Yang, M. (2020). Review of studies on technology-enhanced language learning and teaching. Sustainability, 12(2), 524. https://doi.org/10.3390/su12020524

Shi, J., & Fan, L. (2021). Investigating teachers’ and students’ perceptions of online English learning in a maritime context in China. Sage Open, 11(3), 21582440211040800. https://doi.org/10.1177/21582440211040800

Sinaga, R. R. F., & Oktaviani, L. (2020). The implementation of fun fishing to teach speaking for elementary school students. Journal of English Language Teaching and Learning, 1(1), 1-6.

Van, D. T. H., & Thı, H. H. Q. (2021). Student barriers to prospects of online learning in Vietnam in the context of COVID-19 pandemic. Turkish Online Journal of Distance Education, 22(3), 110-123. https://doi.org/10.17718/tojde.961824

Villegas-Ch, W., Roman-Cañizares, M., Jaramillo-Alcázar, A., & Palacios-Pacheco, X. (2020). Data analysis as a tool for the application of adaptive learning in a university environment. Applied Sciences, 10(20), 7016.

Vitchenko, A., Vitchenko, A., Zamotaieva, N., Khrystiuk, S., & Nikolayenko, V. (2022). Designing integral learning outcomes in higher education within the frameworks of the competency-based approach. Journal of Higher Education Theory and Practice, 22(6), 1-13.

Vo, T., Truong, D., & Nguyen, P. (2023). The impact of digital technology on content and language integrated learning in higher education: A systematic review of literature. ICTE Conference Proceedings, 3, 137–147. https://doi.org/10.54855/ictep.23311

Voithofer, R., & Nelson, M. J. (2021). Teacher educator technology integration preparation practices around TPACK in the United States. Journal of teacher education, 72(3), 314-328. https://doi.org/10.1177/0022487120949842

Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers & Education, 163, 104097. https://doi.org/10.1016/j.compedu.2020.104097

Downloads

Published

20-08-2024

How to Cite

Duong, T. T. H. (2024). Utilizing Technology to Assess English Learning Outcomes of Students Based on a Competency-based Approach . ICTE Conference Proceedings, 5, 49–63. https://doi.org/10.54855/ictep.2455