Multimodal MRI–EEG fusion for brain–computer interface applications using a lightweight CNN and attention in offline Parkinson's disease diagnosis

Document Type

Article

Publication Date

4-15-2026

Abstract

Parkinson's disease (PD) diagnosis lacks objective biomarkers, leading to subjectivity and delayed treatment. This work aims to improve diagnostic accuracy through a multimodal neuroimaging–EEG framework. Method: We designed a compact CNN-based pipeline that integrates structural MRI (sMRI), functional MRI (fMRI), and electroencephalography (EEG). Modality-specific encoders were fused with a lightweight attention head and optimized using Bayesian methods. Experiments used PPMI MRI/clinical data and OpenNeuro PD EEG datasets with subject-wise train/validation/test splits. Results: The model achieved an accuracy of 0.85 and an F1-score of 0.86, outperforming single-modality baselines and traditional machine-learning methods. Frequency-domain attention enhanced β-band features, while branch masking enabled robust handling of missing modalities. Conclusion: The framework provided interpretable EEG and MRI markers with efficient offline inference. The proposed multimodal CNN demonstrates offline feasibility for PD diagnosis, improving robustness, interpretability, and diagnostic efficiency compared to conventional methods. Significance: This study introduces a scalable, lightweight neuroimaging–EEG fusion strategy compatible with brain–computer interface (BCI) pipelines. It not only enhances PD diagnostics but also provides a methodological foundation for personalized care and future applications in other neurological diseases.

Keywords

Brain-computer interface (BCI), Convolutional neural network (CNN), Electroencephalography (EEG), Functional magnetic resonance imaging (fMRI), Parkinson's disease (PD) diagnosis, Structural magnetic resonance imaging (sMRI)

Publication Title

Biomedical Signal Processing and Control

ISSN

1746-8094

DOI

10.1016/j.bspc.2025.109432

Funders

Education Department of Shaanxi Province

Volume

115

Publisher

Elsevier Ltd

Share

COinS