Thoughts of brain EEG signal-to-text conversion using weighted feature fusion-based Multiscale Dilated Adaptive DenseNet with Attention Mechanism
Document Type
Article
Publication Date
9-1-2023
Abstract
Individuals with visual inefficiencies or different abilities face difficulties using their hands to operate smart -phones and computers, necessitating reliance on others to enter data. Such dependence may lead to security and privacy issues, especially when sensitive information is shared with helpers. To address this problem, we present Think2Type, an efficient Brain-Computer Interface (BCI) that enables users to translate their active intentions into text format based on Morse code. BCI leverages brain activity to facilitate interaction with computers, often captured via Electroencephalography (EEG). This work proposes an enhanced attention-based deep learning strategy to develop an efficient text conversion mechanism from EEG signals. We begin by collecting EEG signals from standard benchmark datasets and extracting spectral and statistical features in phase 1, concatenating them into concatenated feature set 1 (F1). In phase 2, we extract spatial and temporal features via a One-Dimensional Convolutional Neural Network (1DCNN) and a Recurrent Neural Network (RNN), respectively, concatenating them into concatenated feature set 2 (F2). Weighted feature fusion is performed on concatenated features F1 and F2, with the hybrid optimization algorithm Eurasian Oystercatcher Wild Geese Migration Optimization (EOWGMO) optimizing the weight for improved fusion efficiency. The text conversion phase utilizes the Mul-tiscale Dilated Adaptive DenseNet with Attention Mechanism (MDADenseNet-AM) to obtain the converted text information. The MDADenseNet-A's parameters are optimized to improve thought-to-text conversion perfor-mance. The developed model's performance is evaluated via experimental analysis and compared to conven-tional techniques, resulting in a higher accuracy value of 96.41%, facilitating appropriate text conversion.
Keywords
Thought-to-text conversion, Electroencephalography signal, Optimal weighted feature fusion, Eurasian oystercatcher wild geese migration optimization, Multiscale Dilated Adaptive DenseNet with Attention Mechanism
Divisions
Computer,mechanical
Funders
King Abdulaziz University (KEP-MSc:90-135-1443)
Publication Title
Biomedical Signal Processing and Control
Volume
86
Issue
A
Publisher
Elsevier
Publisher Location
125 London Wall, London, ENGLAND