{"id":2826,"date":"2023-06-12T23:42:36","date_gmt":"2023-06-12T22:42:36","guid":{"rendered":"https:\/\/archive.belbi.bg.ac.rs\/2023\/?post_type=abstract&#038;p=2826"},"modified":"2023-06-14T18:37:24","modified_gmt":"2023-06-14T17:37:24","slug":"development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study","status":"publish","type":"abstract","link":"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/","title":{"rendered":"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study"},"content":{"rendered":"\n<p>Prof. Themis Exarchos<sup>1<\/sup><\/p>\n\n\n\n<p class=\"affiliation-para\"><sup>1<\/sup>Department of Informatics, Ionian University, Ioannou Theotoki 72, Corfu, Greece<\/p>\n\n\n\n<p>themis.exarchos [at] gmail.com<\/p>\n\n\n\n<p><strong>Abstract<\/strong><\/p>\n\n\n\n<p class=\"abstract-para\">The ability of a machine or program to recognize words spoken aloud and translate them into legible text is known as speech recognition and has gained a lot of attention in the last decade especially in healthcare to promote the quality of care. The problem of speech recognition in patients with tracheostomy has not yet been investigated in the literature. In this work, we propose a hybrid and highly scalable deep learning workflow which utilizes both CNN and RNN architectures across video recordings to identify speech. Dropout rates were also used to avoid overfitting effects. Hyperparameter optimization was applied using the GridSearch method to fine tune the DL workflow on each patient. A case study was applied, where video records were collected from 25 patients in Greece who read specific texts from Greek language, selected by logotherapy experts. A fully automated data processing pipeline was initially applied to extract the video frames based on the provided annotations by the experts (start time, end time per word). Then, we handled the speech recognition problem as a multiclass classification problem, where each word represents a class. Two different types of models were developed; 25 personalized models, which were trained and tested across each individual patient, and a generalized model which was trained and tested on randomly selected instances from all patients. Our results highlight the increased accuracy in terms of reduced word error rate in both the personalized and the generalized hybrid DL models against the conventional DL models.<\/p>\n\n\n\n<p class=\"abstract-para\"><strong>Keywords:<\/strong> deep learning, speech recognition, tracheostomy<\/p>\n\n\n\n<p class=\"abstract-para\"><strong>Acknowledgement:<\/strong> This work is supported by the European Union&rsquo;s Horizon 2020 research and innovation program under grant agreement No 952603 (SGABU). This article reflects only the author&rsquo;s view. The Commission is not responsible for any use that may be made of the information it contains.<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"<p>Prof. Themis Exarchos<sup>1<\/sup><\/p>\n<p class=\"affiliation-para\"><sup>1<\/sup>Department of Informatics, Ionian University, Ioannou Theotoki 72, Corfu, Greece<\/p>\n<p> <a class=\"continue-reading-link\" href=\"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/\"><span>Continue reading<\/span><i class=\"crycon-right-dir\"><\/i><\/a> <\/p>\n","protected":false},"author":162,"featured_media":0,"template":"","categories":[17],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study - BelBi 2023<\/title>\n<meta name=\"robots\" content=\"noindex, follow\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study - BelBi 2023\" \/>\n<meta property=\"og:description\" content=\"Prof. Themis Exarchos11Department of Informatics, Ionian University, Ioannou Theotoki 72, Corfu, Greece Continue reading\" \/>\n<meta property=\"og:url\" content=\"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/\" \/>\n<meta property=\"og:site_name\" content=\"BelBi 2023\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-14T17:37:24+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/\",\"url\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/\",\"name\":\"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study - BelBi 2023\",\"isPartOf\":{\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/#website\"},\"datePublished\":\"2023-06-12T22:42:36+00:00\",\"dateModified\":\"2023-06-14T17:37:24+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/#website\",\"url\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/\",\"name\":\"BelBi 2023\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/#organization\",\"name\":\"Belgrade Bioinformatics Conference\",\"url\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-content\/uploads\/2023\/02\/145_97_171.png\",\"contentUrl\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-content\/uploads\/2023\/02\/145_97_171.png\",\"width\":278,\"height\":500,\"caption\":\"Belgrade Bioinformatics Conference\"},\"image\":{\"@id\":\"https:\/\/archive.belbi.bg.ac.rs\/2023\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study - BelBi 2023","robots":{"index":"noindex","follow":"follow"},"og_locale":"en_US","og_type":"article","og_title":"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study - BelBi 2023","og_description":"Prof. Themis Exarchos11Department of Informatics, Ionian University, Ioannou Theotoki 72, Corfu, Greece Continue reading","og_url":"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/","og_site_name":"BelBi 2023","article_modified_time":"2023-06-14T17:37:24+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/","url":"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/","name":"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study - BelBi 2023","isPartOf":{"@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/#website"},"datePublished":"2023-06-12T22:42:36+00:00","dateModified":"2023-06-14T17:37:24+00:00","breadcrumb":{"@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/abstract\/development-of-hybrid-and-optimized-deep-learning-classifiers-for-speech-recognition-in-tracheostomy-patients-a-case-study\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/archive.belbi.bg.ac.rs\/2023\/"},{"@type":"ListItem","position":2,"name":"Development of hybrid and optimized deep learning classifiers for speech recognition in tracheostomy patients: a case study"}]},{"@type":"WebSite","@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/#website","url":"https:\/\/archive.belbi.bg.ac.rs\/2023\/","name":"BelBi 2023","description":"","publisher":{"@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/archive.belbi.bg.ac.rs\/2023\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/#organization","name":"Belgrade Bioinformatics Conference","url":"https:\/\/archive.belbi.bg.ac.rs\/2023\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/#\/schema\/logo\/image\/","url":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-content\/uploads\/2023\/02\/145_97_171.png","contentUrl":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-content\/uploads\/2023\/02\/145_97_171.png","width":278,"height":500,"caption":"Belgrade Bioinformatics Conference"},"image":{"@id":"https:\/\/archive.belbi.bg.ac.rs\/2023\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-json\/wp\/v2\/abstract\/2826"}],"collection":[{"href":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-json\/wp\/v2\/abstract"}],"about":[{"href":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-json\/wp\/v2\/types\/abstract"}],"author":[{"embeddable":true,"href":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-json\/wp\/v2\/users\/162"}],"wp:attachment":[{"href":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-json\/wp\/v2\/media?parent=2826"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-json\/wp\/v2\/categories?post=2826"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/archive.belbi.bg.ac.rs\/2023\/wp-json\/wp\/v2\/tags?post=2826"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}