Grammatical structure detection by instinct plasticity based echo state networks with genetic algorithm
Document Type
Article
Publication Date
1-7-2022
Abstract
A novel model called Instinct Plasticity Echo State Network with New Weights Selection Method, which is Optimized by Genetic Algorithm, is proposed (IP-NESN-GA). There are three proposed methods that are employed in the conventional ESN. New weights selection method provides a novel approach to replace the random weights of ESN, which obtains much better performance than the conventional ESN. At the same time, Instinct Plasticity is successfully applied in ESN, which enhances the connection among reser-voir states and increase the accuracy. Finally, Genetic Algorithm is applied to seek the most suitable parameters. The detecting ability of our proposed model is assessed on two kinds of distinct grammatical constructions data. It not only performs significantly better than the baselines in the meaning error and sentence error, but it also visualizes the expected probabilities for each of the possible thematic roles. (c) 2021 Elsevier B.V. All rights reserved.
Keywords
Grammatical structure, Echo State Network, Instinct Plasticity, Weights selection, Genetic Algorithm
Divisions
ai
Funders
Fundamental Research Funds for the Central Universities [3132019400] [3132021129]
Publication Title
Neurocomputing
Volume
467
Publisher
Elsevier
Publisher Location
RADARWEG 29, 1043 NX AMSTERDAM, NETHERLANDS