Improvement of automatic speech recognition skills of linguistics students through using ukrainian-english and ukrainian-german subtitles in publicistic movies

Keywords: English as a foreign language, EFL, higher education, video and audio corpus, subtitling, automatic speech recognition.

Abstract

The increased world's attention to foreign language studies facilitates the development and improvement of its study system in higher education institutions. Such a system takes into account and promptly responds to the demands of today's multicultural society. All should start with the transformation and modernization of the higher education system. This system includes the introduction of innovative technologies in the study of English and German, which should be focused on the modern demands of the world labor market. All this has determined the relevance of the research. This article aims to establish ways for students to gain automatic recognition skills through subtitling Ukrainian-English and Ukrainian-German publicistic movies and series. The first assessment of new language audio and video corpus was developed at the Admiral Makarov National University of Shipbuilding, using an automatic subtitling mechanism to improve linguistics students' recognition and understanding of oral speech. The skills and abilities that improved during the work with the educational movie corpus have been identified.

Downloads

Download data is not yet available.

Author Biographies

Olena Shcherbak, Admiral Makarov National University of Shipbuilding, Ukraine.

Senior Lecturer at the Department of Applied Linguistics at the NUOS, Candidate of Philological Science, Hum Institute, Department of Applied Linguistics, Admiral Makarov National University of Shipbuilding, Ukraine.

Nataliya Shamanova, Admiral Makarov National University of Shipbuilding, Ukraine.

Senior Lecturer at the Department of Applied Linguistics at the NUOS, Hum Institute, Department of Applied Linguistics, Admiral Makarov National University of Shipbuilding, Ukraine.

Svitlana Kaleniuk, V.O. Sukhomlynskyi National University of Mykolaiv, Ukraine.

Associate Professor of Department of General and Applied Linguistics at MNU, Candidate of Philological Science, Faculty of Philology, V.O. Sukhomlynskyi National University of Mykolaiv, Ukraine.

Arkadii Proskurin, Admiral Makarov National University of Shipbuilding, Ukraine.

Associate Professor of Department of Internal Combustion Engines at the NUOS, Candidate of Technical Science, Engineering Institute, Admiral Makarov National University of Shipbuilding, Ukraine.

Larisa Yeganova, Admiral Makarov National University of Shipbuilding, Ukraine.

Senior Lecturer at the Department of Applied Linguistics at the NUOS, Hum Institute, Department of Applied Linguistics, Admiral Makarov National University of Shipbuilding, Ukraine.

References

Al Zoubi, S., & Khamaiseh, A. (2019). A Critical Study of William Shakespeare’s King Lear: Plot and Structure. International Journal of English Language and Literature Studies, 8, 14-18. https://doi.org/10.18488/journal.23.2019.81.14.18.

Anis, A. (2017). Role of Teacher in Student's Personality Development. Psychology Behavioral Science International Journal, 2(2), https://doi.org/10.19080/PBSIJ.2017.02.555581

Aydın, A., and Zhu, Ch. (2017). Investigating variables predicting Turkish pre-service teachers’ integration of ICT into teaching practices. British Journal of Educational Technology, 48(2), 552-570. https://doi.org/10.1111/bjet.12437

Banks, F., & Barlex, D. (2014). Teaching STEM in the Secondary School
Helping Teachers Meet The Challenge. London: Routledge, 304. URL: https://www.amazon.co.uk/Teaching-STEM-Secondary-School-Challenge/dp/0367330458

Batliner, A., Blomberg, M., D'Arcy, S., Elenius, D., Giuliani, D., Gerosa, M., Hacker, C., Russell, M., Steidl, S., & Wong, M. (2005). The PF_STAR children's speech corpus. In Ninth European Conference on Speech Communication and Technology – INTERSPEECH, 2005, 3761-3764.

Beelders, T.R., & Blignaut, P.J. (2011). The usability of speech and eye gaze as a multimodal interface for a word processor. INTECH Open Access Publisher. https://doi.org/10.5772/16604

Boghian, I. (2018). Methodological Guidelines for Elaborating the Curriculum of Intercultural Education with a Focus on the Values of Tolerance. Romanian Journal for Multidimensional Education [Revista Romaneasca pentru Educatie Multidimensionala], 10(4), 249-264. https://doi.org/10.18662/rrem/86

Dweck, C. S. (2017). From needs to goals and representations: Foundations for a unified theory of motivation, personality, and development. Psychological review, 124(6), 689-719. https://doi.org/10.1037/rev0000082

Gerosa, M., Giuliani, D., Narayanan, S., & Potamianos, A. (2009). A review of ASR technologies for children's speech. Proceedings of the 2nd Workshop on Child, Computer and Interaction, ACM, 7.

Hudson, P., English, L., Dawes, L., King, D., & Baker, S. (2015). Exploring Links between Pedagogical Knowledge Practices and Student Outcomes in STEM Education for Primary Schools. Australian Journal of Teacher Education, 40(6), 134-151. https://ro.ecu.edu.au/ajte/vol40/iss6/8/

Interspeech 2019 Special Session (2019). Spoken Language Processing for Children's Speech, Interspeech. Special session proposal. Retrieved from URL https://sites.google.com/view/wocci/home/interspeech-2019-special-session.

Ivanova, I., Mosenkis, I., & Strokal, O. (2020). Modern media pedagogy: Ways of forming public journalism in Ukraine. Asia Life Sciences, 22(2), 357-370.

Kazemzadeh, A., You, H., Iseli, M., Jones, B., Cui, X., Heritage, M., Price, P., Anderson, E., Narayanan, S., & Alwan, A. (2005). TBALL data collection: the making of a young children’s speech corpus. In Ninth European Conference on Speech Communication and Technology – INTERSPEECH, 2005, 1581-1584.

Kelley, T.R, & Knowles, J.G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), 1-11. https://doi.org/10.1186/s40594-016-0046-z

National Academy of Engineering and National Research Council. (2014). STEM Integration in K–12 Education: Status, Prospects, and an Agenda for Research. Washington, DC: The National Academies Press. Available: https://www.nap.edu/catalog/18612/stem-integration-in-k-12-education-status-prospects-and-an.

National Academies of Sciences, Engineering, and Medicine (2020). NASA's Science Activation Program: Achievements and Opportunities. Washington, DC: The National Academies Press. https://doi.org/10.17226/25569.

Partnership (2020). Website. URL: https://partnership2020.org/

Pleva, M., Ondas, S., Hládek, D., Juhar, J., Liao, Y.-F., & Staš, J. (2019) Building of children speech corpus for improving automatic subtitling services, The 2019 Conference on Computational Linguistics and Speech Processing ROCLING, 325-333.

Salgur, S. A. (2013). The importance of the teacher in intercultural education. International Journal of Global Education, 2(1), 1-5. Retrieved from URL http://ijge.net/index.php/ijge/article/view/41

Selin, C., Campbell, K., Ridder-Vignone, K., Sadowski, J., Allende, C., Altamirano, G., Davies, S., & Guston, D. (2016). Experiments in engagement: Designing public engagement with science and technology for capacity building. Public Understanding of Science, 6, 634–649. https://doi.org/10.1177/0963662515620970

Sidgi, L., & Shaari, A. (2017). Тhe Usefulness of Automatic Speech Recognition (ASR) EyeSpeak Software in Improving Iraqi EFL Students’ Pronunciation Advances in Language and Literary Studiesdvances. Language and Literary Studie, 8(1), 221-226 https://doi.org/10.7575/aiac.alls.v.8n.1p.221

Shulman, R. D. (2018). 10 Ways Educators Can Make Classrooms More Innovative. Forbes, No 19. Retrieved from URL https://www.forbes.com/sites/robynshulman/2018/11/19/10-ways-educators-can-make-classrooms-more-innovative/?s

Tyurina, S. (2019). Development of communicative potential of personality by means of foreign media discourse in digital environment. Media Education, 59(2), 328–336. https://doi.org/10.13187/me.2019.2.328

Wang, J., Ng, S. I., Tao, D., Ng, W. Y., & Lee, T. (2018). A study on acoustic modeling for child speech based on multi-task learning. In: 11th International Symposium on Chinese Spoken Language Processing (ISCSLP). Taipei, IEEE, 389-393

Wang, et al. (2019) The role of chlorine in global tropospheric chemistry Atmos. Chem. Phys., 19(6), pp. 3981-4003

Xiangjun, D., & Yip, V. (2018). A multimedia corpus of child Mandarin: The Tong corpus. Journal of Chinese Linguistics, 46(1), 69-92. Retrieved from URL https://www.jstor.org/stable/26538063

Zhernova, A. (2018). Information and Communication Technologies in Higher Education: Toward the Preparedness of the Subjects of Education for Innovation. Scientific Research in Social and Political Psychology, 33, 172-179.
Published
2022-07-04
How to Cite
Shcherbak, O., Shamanova, N., Kaleniuk, S., Proskurin, A., & Yeganova, L. (2022). Improvement of automatic speech recognition skills of linguistics students through using ukrainian-english and ukrainian-german subtitles in publicistic movies. Amazonia Investiga, 11(53), 26-33. https://doi.org/10.34069/AI/2022.53.05.3
Section
Articles