| 2/2023 - 4 |
A Novel Approach on Converting Eye Blink Signals in EEG to Speech with Cross Correlation TechniqueIKIZLER, N.   , EKIM, G. , ATASOY, A. |
Extra paper information in    |
| Click to see author's profile in SCOPUS, IEEE Xplore, Web of Science |
Download PDF  (1,358 KB) | Citation | Downloads: 649 | Views: 1,499 |
Author keywords
assistive technology, biomedical communication, biomedical signal processing, electroencephalography, cross correlation
References keywords
interface(16), communication(16), brain(15), system(11), tracking(8), technology(7), systems(7), blink(7), time(6), information(6)
Blue keywords are present in both the references section and the paper title.
About this article
Date of Publication: 2023-05-31
Volume 23, Issue 2, Year 2023, On page(s): 29 - 38
ISSN: 1582-7445, e-ISSN: 1844-7600
Digital Object Identifier: 10.4316/AECE.2023.02004
Web of Science Accession Number: 001009953400004
SCOPUS ID: 85164324896
Abstract
Today, there are many patients with Amyotrophic Lateral Sclerosis or paralysis who are unable to perform any body movements other than eye movements. A system has been developed to facilitate communication between patients and their surroundings. This system utilizes binary coded expressions obtained through single and double eye blinks performed by the patients, which are then vocalized. The locations of the eye blinks are determined by analyzing the signals obtained from the patient using a wireless NeuroSky MindWave single-channel EEG device. The windowing process is performed at predetermined intervals to determine whether the blink within these windows was a single or double blink, by using the Cross Correlation method. The system is completed by converting the expressions corresponding to the binary codes to speech and has provided results with a very high degree of accuracy. |
| References | | | Cited By «-- Click to see who has cited this paper |
| [1] A. Juhong, T. Treebupachatsakul, C. Pintavirooj, "Smart eye-tracking system," In 2018 International Workshop on Advanced Image Technology (IWAIT), 1-4, 2018. [CrossRef] [SCOPUS Times Cited 20] [2] A. I. Al-Btoush, M. A. Abbadi, A. B. Hassanat, A. S. Tarawneh, A. Hasanat, V. S. Prasath, "New features for eye-tracking systems: Preliminary results," In 2019 10th International Conference on Information and Communication Systems (ICICS), 179-184, 2019, IEEE. [CrossRef] [Web of Science Times Cited 9] [SCOPUS Times Cited 12] [3] H. O. Edughele, Y. Zhang, F. Muhammad-Sukki, Q. T. Vien, H. Morris-Cafiero, M. O. Agyeman, "Eye-tracking assistive technologies for individuals with amyotrophic lateral sclerosis," IEEE Access, 10, 41952-41972, 2022. [CrossRef] [Web of Science Times Cited 11] [SCOPUS Times Cited 14] [4] D. V. Jeevithashree, P. Jain, A. Mukhopadhyay, K. P. S. Saluja, P. Biswas, "Eye gaze controlled adaptive virtual keyboard for users with SSMI," Technology and Disability, 33(4), 319-338, 2021. [CrossRef] [Web of Science Times Cited 2] [SCOPUS Times Cited 3] [5] E. H. Montenegro-Couto, K. A. Hernandez-Ossa, A. L. C. Bissoli, M. Sime, T. F. Bastos-Filho, "Towards an assistive interface to command robotic wheelchairs and interact with environment through eye gaze," In Proceedings of the V Congresso Brasileiro de Eletromiografia e Cinesiologia e X Simposio de Engenharia Biomedica, Even3, Uberlandia, MG, Brazil, 23-26, 2017. [CrossRef] [6] S. Soman, B. K. Murthy, "Using brain computer interface for synthesized speech communication for the physically disabled," Procedia Computer Science, 46, 292-298, 2015. [CrossRef] [Web of Science Times Cited 17] [SCOPUS Times Cited 27] [7] C. Verbaarschot, D. Tump, A. Lutu, M. Borhanazad, J. Thielen, P. van den Broek, P. Desain, "A visual brain-computer interface as communication aid for patients with amyotrophic lateral sclerosis," Clinical Neurophysiology, 132(10), 2404-2415, 2021. [CrossRef] [Web of Science Times Cited 21] [SCOPUS Times Cited 23] [8] W. Chareonsuk, S. Kanhaun, K. Khawkam, D. Wongsawang, "Face and Eyes mouse for ALS Patients," In 2016 Fifth ICT international student project conference (ICT-ISPC), 77-80, IEEE, 2016. [CrossRef] [SCOPUS Times Cited 8] [9] M. Rashid, N. Sulaiman, M. Mustafa, B. S. Bari, M. G. Sadeque, M. J. Hasan, "Wink based facial expression classification using machine learning approach," SN Applied Sciences, 2, 1-9, 2020. [CrossRef] [Web of Science Times Cited 4] [SCOPUS Times Cited 10] [10] P. A. de Lima Medeiros, G. V. S. da Silva, F. R. dos Santos Fernandes, I. Sanchez-Gendriz, H. W. C. Lins, D. M. da Silva Barros, R. A. de Medeiros Valentim, "Efficient machine learning approach for volunteer eye-blink detection in real-time using webcam," Expert Systems with Applications, 188, 116073, 2022. [CrossRef] [Web of Science Times Cited 18] [SCOPUS Times Cited 24] [11] A. Krolak, P. Strumilo, "Eye-blink detection system for humanccomputer interaction," Universal Access in the Information Society, 11, 409-419, 2012. [CrossRef] [Web of Science Times Cited 143] [SCOPUS Times Cited 182] [12] J. Wang, S. Xu, Y. Dai, S. Gao, "An eye tracking and brain-computer interface based human-environment interactive system for amyotrophic lateral sclerosis patients," IEEE Sensors Journal, 2022. [CrossRef] [Web of Science Times Cited 6] [SCOPUS Times Cited 8] [13] P. Cipresso, P. Meriggi, L. Carelli, F. Solca, D. Meazzi, B. Poletti, V. Silani, "The combined use of brain computer interface and eye-tracking technology for cognitive assessment in amyotrophic lateral sclerosis," In 2011 5th International conference on pervasive computing technologies for healthcare (Pervasive Health) and workshops, 320-324, IEEE, 2011. [CrossRef] [SCOPUS Times Cited 20] [14] X. Ma, Z. Yao, Y. Wang, W. Pei, H. Chen, "Combining brain-computer interface and eye tracking for high-speed text entry in virtual reality," In 23rd international conference on intelligent user interfaces, 263-267, 2018. [CrossRef] [Web of Science Times Cited 37] [SCOPUS Times Cited 44] [15] S. Rihana, P. Damien, T. Moujaess, "EEG-eye blink detection system for brain computer interface," In Converging Clinical and Engineering Research on Neurorehabilitation, Springer Berlin Heidelberg, 603-608, 2013. [CrossRef] [SCOPUS Times Cited 16] [16] H. Tamura, M. Yan, K. Sakurai, K. Tanno, "EOG-sEMG human interface for communication," Computational Intelligence and Neuroscience, 2016. [CrossRef] [Web of Science Times Cited 7] [SCOPUS Times Cited 13] [17] A. Kaur, "Wheelchair control for disabled patients using EMG/EOG based human machine interface: a review," Journal of medical engineering & technology, 45(1), 61-74, 2021. [CrossRef] [SCOPUS Times Cited 52] [18] K. Mukherjee, D. Chatterjee, "Augmentative and alternative communication device based on eye-blink detection and conversion to Morse-code to aid paralyzed individuals," In 2015 International Conference on Communication, Information & Computing Technology, 1-5, IEEE, 2015. [CrossRef] [SCOPUS Times Cited 37] [19] J. Singh, R. Miglani, C. Goel, "Encrypted morse communication using eye blinks and light bulb," In Proceedings of the International Conference on Innovative Computing & Communication (ICICC), 2021. [CrossRef] [20] G. Ekim, N. Ikizler, A. Atasoy, "A study on eye-blink detection-based communication system by using k-nearest neighbors' classifier," AECE Advances in Electrical and Computer Engineering, 23(1), 71-78, 2023. [CrossRef] [Full Text] [Web of Science Times Cited 2] [SCOPUS Times Cited 4] [21] O. A. Rusanu, I. C. Rosca, "A LabVIEW based brain-computer interface training environment by controlling yoda holograms using eye-blinks according to an interactive game framework," In Learning in the Age of Digital and Green Transition: Proceedings of the 25th International Conference on Interactive Collaborative Learning (ICL2022), 2, 1056-1068, Cham: Springer International Publishing, 2023. [CrossRef] [SCOPUS Times Cited 1] [22] M. A. Awais, M. Z. Yusoff, N. Yahya, S. Z. Ahmed, M. U. Qamar, "Brain controlled wheelchair: a smart prototype," In Journal of Physics: Conference Series, 1529(4), 042075, IOP Publishing, 2020. [CrossRef] [SCOPUS Times Cited 11] [23] D. H. Krishna, I. A. Pasha, T. S. Savithri, "Classification of EEG motor imagery multi class signals based on cross correlation," Procedia Computer Science, 85, 490-495, 2016. [CrossRef] [Web of Science Times Cited 24] [SCOPUS Times Cited 34] [24] B. Podobnik, H. E. Stanley, "Detrended cross-correlation analysis: a new method for analyzing two nonstationary time series," Physical review letters, 100(8), 084102, 2008. [CrossRef] [Web of Science Times Cited 1143] [SCOPUS Times Cited 1238] [25] G. Ekim, A. Atasoy, N. Ikizler, "A new approach for eye-blink to speech conversion by dynamic time warping," Traitement Du Signal, 38(2), 369-377, 2021. [CrossRef] [Web of Science Times Cited 5] [SCOPUS Times Cited 6] [26] G. Ekim, A. Atasoy, N. Ikizler, "Design of single channel EEG signal acquisition device (Tek Kanalli EEG Sinyal Toplama Cihazi Tasarimi)," 28. IEEE Signal Processing and Communication Applications Congress, Gaziantep, Turkey, 1-4, 2020 [27] A. J. Bhagawati, R. Chutia, "Design of single channel portable EEG signal acquisition system for brain computer interface application," International Journal of Biomedical Engineering and Science (IJBES 2016), 3(1), 37-44, 2016. [CrossRef] [28] L. A. Farwell, E. Donchin, "Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials," Electroencephalography and Clinical Neurophysiology, 70.6: 510-523, 1998. [CrossRef] [Web of Science Times Cited 2106] [SCOPUS Times Cited 2608] [29] P. Meinicke, M. Kaper, F. Hoppe, M. Heumann, H. Ritter, "Improving transfer rates in brain computer interfacing: A case study," In Advances in Neural Information Processing Systems, 1131-1138, 2003 [30] M. Kaper, H. Ritter, "Generalizing to new subjects in brain-computer interfacing," The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2, IEEE, 4363-4366, 2004. [CrossRef] [31] A. Amcalar, M. Cetin, "A Brain-Computer Interface System for Online Spelling," IEEE 18th Signal Processing and Communication Applications Congress, Diyarbakir, 196-199, 2010. [CrossRef] [SCOPUS Times Cited 6] [32] F. Akram, H. Seung Moo, K. Tae-Seong, "An efficient word typing P300-BCI system using a modified T9 interface and random forest classifier," Computers in Biology and Medicine 56, 30-36, 2015. [CrossRef] [Web of Science Times Cited 69] [SCOPUS Times Cited 83] [33] Z. Oralhan, "The effect of interstitial time and stimulus structure on performance in P300 based brain computer interface systems," Duzce University Journal of Science and Technology, 7.3: 1834-1846, 2019. [CrossRef] [34] D. Miniotas, O. Spakov, G. E. Evreinov, "Symbol creator: An alternative eye-based text entry technique with low demand for screen space," In INTERACT, Vol. 3: 137-143, 2003 [35] P. Majaranta, A. Aula, K. J. Raiha, "Effects of feedback on eye typing with a short dwell time," In Proceedings of the 2004 Symposium on Eye tracking Research & Applications, 139-146, 2004. [CrossRef] [SCOPUS Times Cited 56] [36] A. B. Usakli, S. Gurkan, "Design of a novel efficient humanccomputer interface: An electrooculogram based virtual keyboard," IEEE Transactions on Instrumentation and Measurement, 59.8: 2099-2108, 2009. [CrossRef] [Web of Science Times Cited 113] [SCOPUS Times Cited 146] [37] I. S. MacKenzie, B. Ashtiani, "BlinkWrite: efficient text entry using eye blinks," Universal Access in the Information Society, 10.1: 69-80, 2011. [CrossRef] [Web of Science Times Cited 36] [SCOPUS Times Cited 51] [38] C. Zhang, R. Yao, J. Cai, "Efficient eye typing with 9-direction gaze estimation," Multimedia Tools, and Applications, 77.15: 19679-19696, 2018. [CrossRef] [Web of Science Times Cited 28] [SCOPUS Times Cited 40] [39] M. Porta, M. Turina, "Eye-S: a full-screen input modality for pure eye-based communication," In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, 27-34, 2008. [CrossRef] [Web of Science Times Cited 48] [SCOPUS Times Cited 80] [40] J. Tsai, C. Lee, C. Wu, J. Wu, K. Kao, "A feasibility study of an eye-writing system based on electro-oculography," Journal of Medical and Biological Engineering, 28.1, 39, 2008 [41] K. R. Lee, W. D. Chang, S. Kim, C. H. Im, "Real-time "eye-writing" recognition using electrooculogram," IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25(1), 37-48, 2016. [CrossRef] [Web of Science Times Cited 52] [SCOPUS Times Cited 68] [42] F. Fang, T. Shinozaki, "Electrooculography-based continuous eye-writing recognition system for efficient assistive communication systems," PloS one, 13(2), 2018, e0192684. [CrossRef] [Web of Science Times Cited 38] [SCOPUS Times Cited 46] [43] H. Ozbek Ulkutas, "Development of computer-based eye-writing system by using EOG," M.Sc. Thesis, Department of Biomedical Engineering, Baskent University, Ankara, Turkey, 2015 [44] S. Soman, B. K. Murthy, "Using brain computer interface for synthesized speech communication for the physically disabled," Procedia Computer Science, 46, 292-298, 2015. [CrossRef] [Web of Science Times Cited 17] [SCOPUS Times Cited 27] [45] K. Mukherjee, D. Chatterjee, "Augmentative and alternative communication device based on eye-blink detection and conversion to Morse-code to aid paralyzed individuals," In 2015 International Conference on Communication, Information & Computing Technology (ICCICT), IEEE, 1-5, 2015 [CrossRef] [SCOPUS Times Cited 37] Web of Science® Citations for all references: 3,956 TCR SCOPUS® Citations for all references: 5,055 TCR Web of Science® Average Citations per reference: 86 ACR SCOPUS® Average Citations per reference: 110 ACR TCR = Total Citations for References / ACR = Average Citations per Reference We introduced in 2010 - for the first time in scientific publishing, the term "References Weight", as a quantitative indication of the quality ... Read more Citations for references updated on 2024-11-20 20:07 in 268 seconds. Note1: Web of Science® is a registered trademark of Clarivate Analytics. Note2: SCOPUS® is a registered trademark of Elsevier B.V. Disclaimer: All queries to the respective databases were made by using the DOI record of every reference (where available). Due to technical problems beyond our control, the information is not always accurate. Please use the CrossRef link to visit the respective publisher site. |
Copyright ©2001-2024
Faculty of Electrical Engineering and Computer Science
Stefan cel Mare University of Suceava, Romania
All rights reserved: Advances in Electrical and Computer Engineering is a registered trademark of the Stefan cel Mare University of Suceava. No part of this publication may be reproduced, stored in a retrieval system, photocopied, recorded or archived, without the written permission from the Editor. When authors submit their papers for publication, they agree that the copyright for their article be transferred to the Faculty of Electrical Engineering and Computer Science, Stefan cel Mare University of Suceava, Romania, if and only if the articles are accepted for publication. The copyright covers the exclusive rights to reproduce and distribute the article, including reprints and translations.
Permission for other use: The copyright owner's consent does not extend to copying for general distribution, for promotion, for creating new works, or for resale. Specific written permission must be obtained from the Editor for such copying. Direct linking to files hosted on this website is strictly prohibited.
Disclaimer: Whilst every effort is made by the publishers and editorial board to see that no inaccurate or misleading data, opinions or statements appear in this journal, they wish to make it clear that all information and opinions formulated in the articles, as well as linguistic accuracy, are the sole responsibility of the author.
Faculty of Electrical Engineering and Computer Science
Stefan cel Mare University of Suceava, Romania
All rights reserved: Advances in Electrical and Computer Engineering is a registered trademark of the Stefan cel Mare University of Suceava. No part of this publication may be reproduced, stored in a retrieval system, photocopied, recorded or archived, without the written permission from the Editor. When authors submit their papers for publication, they agree that the copyright for their article be transferred to the Faculty of Electrical Engineering and Computer Science, Stefan cel Mare University of Suceava, Romania, if and only if the articles are accepted for publication. The copyright covers the exclusive rights to reproduce and distribute the article, including reprints and translations.
Permission for other use: The copyright owner's consent does not extend to copying for general distribution, for promotion, for creating new works, or for resale. Specific written permission must be obtained from the Editor for such copying. Direct linking to files hosted on this website is strictly prohibited.
Disclaimer: Whilst every effort is made by the publishers and editorial board to see that no inaccurate or misleading data, opinions or statements appear in this journal, they wish to make it clear that all information and opinions formulated in the articles, as well as linguistic accuracy, are the sole responsibility of the author.
