Please use this identifier to cite or link to this item:
Title: Salient Arithmetic Data Extraction from Brain Activity via an Improved Deep Network
Authors: Khaleghi, N
Hashemi, S
Ardabili, SZ
Sheykhivand, S
Danishvar, S
Keywords: arithmetic content;visual perception;electroencephalogram;deep learning;MNIST
Issue Date: 23-Nov-2023
Publisher: MDPI
Citation: Khaleghi, N. et al. (2023) 'Salient Arithmetic Data Extraction from Brain Activity via an Improved Deep Network', Sensors, 23 (23), 9351, pp. 1 - 24. doi: 10.3390/s23239351.
Abstract: Interpretation of neural activity in response to stimulations received from the surrounding environment is necessary to realize automatic brain decoding. Analyzing the brain recordings corresponding to visual stimulation helps to infer the effects of perception occurring by vision on brain activity. In this paper, the impact of arithmetic concepts on vision-related brain records has been considered and an efficient convolutional neural network-based generative adversarial network (CNN-GAN) is proposed to map the electroencephalogram (EEG) to salient parts of the image stimuli. The first part of the proposed network consists of depth-wise one-dimensional convolution layers to classify the brain signals into 10 different categories according to Modified National Institute of Standards and Technology (MNIST) image digits. The output of the CNN part is fed forward to a fine-tuned GAN in the proposed model. The performance of the proposed CNN part is evaluated via the visually provoked 14-channel MindBigData recorded by David Vivancos, corresponding to images of 10 digits. An average accuracy of 95.4% is obtained for the CNN part for classification. The performance of the proposed CNN-GAN is evaluated based on saliency metrics of SSIM and CC equal to 92.9% and 97.28%, respectively. Furthermore, the EEG-based reconstruction of MNIST digits is accomplished by transferring and tuning the improved CNN-GAN’s trained weights.
Description: Data Availability Statement: The EEG dataset is available online at (Accessed on 12 February 2020).
Other Identifiers: ORCID iD: Sobhan Sheykhivand
ORCID iD: Sebelan Danishvar
Appears in Collections:Dept of Civil and Environmental Engineering Research Papers

Files in This Item:
File Description SizeFormat 
FullText.pdfCopyright © 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license ( MBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons