Improvement of automatic speech recognition skills of linguistics students through using ukrainian-english and ukrainian-german subtitles in publicistic movies
Keywords:
English as a foreign language, EFL, higher education, video and audio corpus, subtitling, automatic speech recognition.
Abstract
The increased world's attention to foreign language studies facilitates the development and improvement of its study system in higher education institutions. Such a system takes into account and promptly responds to the demands of today's multicultural society. All should start with the transformation and modernization of the higher education system. This system includes the introduction of innovative technologies in the study of English and German, which should be focused on the modern demands of the world labor market. All this has determined the relevance of the research. This article aims to establish ways for students to gain automatic recognition skills through subtitling Ukrainian-English and Ukrainian-German publicistic movies and series. The first assessment of new language audio and video corpus was developed at the Admiral Makarov National University of Shipbuilding, using an automatic subtitling mechanism to improve linguistics students' recognition and understanding of oral speech. The skills and abilities that improved during the work with the educational movie corpus have been identified.
Downloads
Download data is not yet available.
References
Al Zoubi, S., & Khamaiseh, A. (2019). A Critical Study of William Shakespeare’s King Lear: Plot and Structure. International Journal of English Language and Literature Studies, 8, 14-18. https://doi.org/10.18488/journal.23.2019.81.14.18.
Anis, A. (2017). Role of Teacher in Student's Personality Development. Psychology Behavioral Science International Journal, 2(2), https://doi.org/10.19080/PBSIJ.2017.02.555581
Aydın, A., and Zhu, Ch. (2017). Investigating variables predicting Turkish pre-service teachers’ integration of ICT into teaching practices. British Journal of Educational Technology, 48(2), 552-570. https://doi.org/10.1111/bjet.12437
Banks, F., & Barlex, D. (2014). Teaching STEM in the Secondary School
Helping Teachers Meet The Challenge. London: Routledge, 304. URL: https://www.amazon.co.uk/Teaching-STEM-Secondary-School-Challenge/dp/0367330458
Batliner, A., Blomberg, M., D'Arcy, S., Elenius, D., Giuliani, D., Gerosa, M., Hacker, C., Russell, M., Steidl, S., & Wong, M. (2005). The PF_STAR children's speech corpus. In Ninth European Conference on Speech Communication and Technology – INTERSPEECH, 2005, 3761-3764.
Beelders, T.R., & Blignaut, P.J. (2011). The usability of speech and eye gaze as a multimodal interface for a word processor. INTECH Open Access Publisher. https://doi.org/10.5772/16604
Boghian, I. (2018). Methodological Guidelines for Elaborating the Curriculum of Intercultural Education with a Focus on the Values of Tolerance. Romanian Journal for Multidimensional Education [Revista Romaneasca pentru Educatie Multidimensionala], 10(4), 249-264. https://doi.org/10.18662/rrem/86
Dweck, C. S. (2017). From needs to goals and representations: Foundations for a unified theory of motivation, personality, and development. Psychological review, 124(6), 689-719. https://doi.org/10.1037/rev0000082
Gerosa, M., Giuliani, D., Narayanan, S., & Potamianos, A. (2009). A review of ASR technologies for children's speech. Proceedings of the 2nd Workshop on Child, Computer and Interaction, ACM, 7.
Hudson, P., English, L., Dawes, L., King, D., & Baker, S. (2015). Exploring Links between Pedagogical Knowledge Practices and Student Outcomes in STEM Education for Primary Schools. Australian Journal of Teacher Education, 40(6), 134-151. https://ro.ecu.edu.au/ajte/vol40/iss6/8/
Interspeech 2019 Special Session (2019). Spoken Language Processing for Children's Speech, Interspeech. Special session proposal. Retrieved from URL https://sites.google.com/view/wocci/home/interspeech-2019-special-session.
Ivanova, I., Mosenkis, I., & Strokal, O. (2020). Modern media pedagogy: Ways of forming public journalism in Ukraine. Asia Life Sciences, 22(2), 357-370.
Kazemzadeh, A., You, H., Iseli, M., Jones, B., Cui, X., Heritage, M., Price, P., Anderson, E., Narayanan, S., & Alwan, A. (2005). TBALL data collection: the making of a young children’s speech corpus. In Ninth European Conference on Speech Communication and Technology – INTERSPEECH, 2005, 1581-1584.
Kelley, T.R, & Knowles, J.G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), 1-11. https://doi.org/10.1186/s40594-016-0046-z
National Academy of Engineering and National Research Council. (2014). STEM Integration in K–12 Education: Status, Prospects, and an Agenda for Research. Washington, DC: The National Academies Press. Available: https://www.nap.edu/catalog/18612/stem-integration-in-k-12-education-status-prospects-and-an.
National Academies of Sciences, Engineering, and Medicine (2020). NASA's Science Activation Program: Achievements and Opportunities. Washington, DC: The National Academies Press. https://doi.org/10.17226/25569.
Partnership (2020). Website. URL: https://partnership2020.org/
Pleva, M., Ondas, S., Hládek, D., Juhar, J., Liao, Y.-F., & Staš, J. (2019) Building of children speech corpus for improving automatic subtitling services, The 2019 Conference on Computational Linguistics and Speech Processing ROCLING, 325-333.
Salgur, S. A. (2013). The importance of the teacher in intercultural education. International Journal of Global Education, 2(1), 1-5. Retrieved from URL http://ijge.net/index.php/ijge/article/view/41
Selin, C., Campbell, K., Ridder-Vignone, K., Sadowski, J., Allende, C., Altamirano, G., Davies, S., & Guston, D. (2016). Experiments in engagement: Designing public engagement with science and technology for capacity building. Public Understanding of Science, 6, 634–649. https://doi.org/10.1177/0963662515620970
Sidgi, L., & Shaari, A. (2017). Тhe Usefulness of Automatic Speech Recognition (ASR) EyeSpeak Software in Improving Iraqi EFL Students’ Pronunciation Advances in Language and Literary Studiesdvances. Language and Literary Studie, 8(1), 221-226 https://doi.org/10.7575/aiac.alls.v.8n.1p.221
Shulman, R. D. (2018). 10 Ways Educators Can Make Classrooms More Innovative. Forbes, No 19. Retrieved from URL https://www.forbes.com/sites/robynshulman/2018/11/19/10-ways-educators-can-make-classrooms-more-innovative/?s
Tyurina, S. (2019). Development of communicative potential of personality by means of foreign media discourse in digital environment. Media Education, 59(2), 328–336. https://doi.org/10.13187/me.2019.2.328
Wang, J., Ng, S. I., Tao, D., Ng, W. Y., & Lee, T. (2018). A study on acoustic modeling for child speech based on multi-task learning. In: 11th International Symposium on Chinese Spoken Language Processing (ISCSLP). Taipei, IEEE, 389-393
Wang, et al. (2019) The role of chlorine in global tropospheric chemistry Atmos. Chem. Phys., 19(6), pp. 3981-4003
Xiangjun, D., & Yip, V. (2018). A multimedia corpus of child Mandarin: The Tong corpus. Journal of Chinese Linguistics, 46(1), 69-92. Retrieved from URL https://www.jstor.org/stable/26538063
Zhernova, A. (2018). Information and Communication Technologies in Higher Education: Toward the Preparedness of the Subjects of Education for Innovation. Scientific Research in Social and Political Psychology, 33, 172-179.
Anis, A. (2017). Role of Teacher in Student's Personality Development. Psychology Behavioral Science International Journal, 2(2), https://doi.org/10.19080/PBSIJ.2017.02.555581
Aydın, A., and Zhu, Ch. (2017). Investigating variables predicting Turkish pre-service teachers’ integration of ICT into teaching practices. British Journal of Educational Technology, 48(2), 552-570. https://doi.org/10.1111/bjet.12437
Banks, F., & Barlex, D. (2014). Teaching STEM in the Secondary School
Helping Teachers Meet The Challenge. London: Routledge, 304. URL: https://www.amazon.co.uk/Teaching-STEM-Secondary-School-Challenge/dp/0367330458
Batliner, A., Blomberg, M., D'Arcy, S., Elenius, D., Giuliani, D., Gerosa, M., Hacker, C., Russell, M., Steidl, S., & Wong, M. (2005). The PF_STAR children's speech corpus. In Ninth European Conference on Speech Communication and Technology – INTERSPEECH, 2005, 3761-3764.
Beelders, T.R., & Blignaut, P.J. (2011). The usability of speech and eye gaze as a multimodal interface for a word processor. INTECH Open Access Publisher. https://doi.org/10.5772/16604
Boghian, I. (2018). Methodological Guidelines for Elaborating the Curriculum of Intercultural Education with a Focus on the Values of Tolerance. Romanian Journal for Multidimensional Education [Revista Romaneasca pentru Educatie Multidimensionala], 10(4), 249-264. https://doi.org/10.18662/rrem/86
Dweck, C. S. (2017). From needs to goals and representations: Foundations for a unified theory of motivation, personality, and development. Psychological review, 124(6), 689-719. https://doi.org/10.1037/rev0000082
Gerosa, M., Giuliani, D., Narayanan, S., & Potamianos, A. (2009). A review of ASR technologies for children's speech. Proceedings of the 2nd Workshop on Child, Computer and Interaction, ACM, 7.
Hudson, P., English, L., Dawes, L., King, D., & Baker, S. (2015). Exploring Links between Pedagogical Knowledge Practices and Student Outcomes in STEM Education for Primary Schools. Australian Journal of Teacher Education, 40(6), 134-151. https://ro.ecu.edu.au/ajte/vol40/iss6/8/
Interspeech 2019 Special Session (2019). Spoken Language Processing for Children's Speech, Interspeech. Special session proposal. Retrieved from URL https://sites.google.com/view/wocci/home/interspeech-2019-special-session.
Ivanova, I., Mosenkis, I., & Strokal, O. (2020). Modern media pedagogy: Ways of forming public journalism in Ukraine. Asia Life Sciences, 22(2), 357-370.
Kazemzadeh, A., You, H., Iseli, M., Jones, B., Cui, X., Heritage, M., Price, P., Anderson, E., Narayanan, S., & Alwan, A. (2005). TBALL data collection: the making of a young children’s speech corpus. In Ninth European Conference on Speech Communication and Technology – INTERSPEECH, 2005, 1581-1584.
Kelley, T.R, & Knowles, J.G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), 1-11. https://doi.org/10.1186/s40594-016-0046-z
National Academy of Engineering and National Research Council. (2014). STEM Integration in K–12 Education: Status, Prospects, and an Agenda for Research. Washington, DC: The National Academies Press. Available: https://www.nap.edu/catalog/18612/stem-integration-in-k-12-education-status-prospects-and-an.
National Academies of Sciences, Engineering, and Medicine (2020). NASA's Science Activation Program: Achievements and Opportunities. Washington, DC: The National Academies Press. https://doi.org/10.17226/25569.
Partnership (2020). Website. URL: https://partnership2020.org/
Pleva, M., Ondas, S., Hládek, D., Juhar, J., Liao, Y.-F., & Staš, J. (2019) Building of children speech corpus for improving automatic subtitling services, The 2019 Conference on Computational Linguistics and Speech Processing ROCLING, 325-333.
Salgur, S. A. (2013). The importance of the teacher in intercultural education. International Journal of Global Education, 2(1), 1-5. Retrieved from URL http://ijge.net/index.php/ijge/article/view/41
Selin, C., Campbell, K., Ridder-Vignone, K., Sadowski, J., Allende, C., Altamirano, G., Davies, S., & Guston, D. (2016). Experiments in engagement: Designing public engagement with science and technology for capacity building. Public Understanding of Science, 6, 634–649. https://doi.org/10.1177/0963662515620970
Sidgi, L., & Shaari, A. (2017). Тhe Usefulness of Automatic Speech Recognition (ASR) EyeSpeak Software in Improving Iraqi EFL Students’ Pronunciation Advances in Language and Literary Studiesdvances. Language and Literary Studie, 8(1), 221-226 https://doi.org/10.7575/aiac.alls.v.8n.1p.221
Shulman, R. D. (2018). 10 Ways Educators Can Make Classrooms More Innovative. Forbes, No 19. Retrieved from URL https://www.forbes.com/sites/robynshulman/2018/11/19/10-ways-educators-can-make-classrooms-more-innovative/?s
Tyurina, S. (2019). Development of communicative potential of personality by means of foreign media discourse in digital environment. Media Education, 59(2), 328–336. https://doi.org/10.13187/me.2019.2.328
Wang, J., Ng, S. I., Tao, D., Ng, W. Y., & Lee, T. (2018). A study on acoustic modeling for child speech based on multi-task learning. In: 11th International Symposium on Chinese Spoken Language Processing (ISCSLP). Taipei, IEEE, 389-393
Wang, et al. (2019) The role of chlorine in global tropospheric chemistry Atmos. Chem. Phys., 19(6), pp. 3981-4003
Xiangjun, D., & Yip, V. (2018). A multimedia corpus of child Mandarin: The Tong corpus. Journal of Chinese Linguistics, 46(1), 69-92. Retrieved from URL https://www.jstor.org/stable/26538063
Zhernova, A. (2018). Information and Communication Technologies in Higher Education: Toward the Preparedness of the Subjects of Education for Innovation. Scientific Research in Social and Political Psychology, 33, 172-179.
Published
2022-07-04
How to Cite
Shcherbak, O., Shamanova, N., Kaleniuk, S., Proskurin, A., & Yeganova, L. (2022). Improvement of automatic speech recognition skills of linguistics students through using ukrainian-english and ukrainian-german subtitles in publicistic movies. Amazonia Investiga, 11(53), 26-33. https://doi.org/10.34069/AI/2022.53.05.3
Issue
Section
Articles
.gif)
