Studying the Effect of Training Levenberg Marquardt Neural Network by Using Hybrid Meta-Heuristic Algorithms
Document Type
Article
Publication Date
1-1-2016
Abstract
Accelerated Particle Swarm Optimization (APSO) algorithm is one of the latest additions to the group of meta-heuristic nature inspired algorithms which provides derivative-free solutions to solve complex problems. Meanwhile, the Levenberg Marquardt Back propagation (LMBP) still it is not able to avoid local minimum. To deal with this problem, global search optimization technique has the ability to adjust the weight for NN (Neural Network) to avoid the local minima problem. This paper proposes an accelerated particle swarm optimization (APSO) is implemented in conjunction with Levenberg Marquardt back propagation (LMBP) algorithms to achieve faster convergence rate and to avoid local minima problem. The performances of the proposed Accelerated Particle Swarm Optimization Levenberg Marquardt (APSO-LM) algorithms compared by means of simulations on 7-Bit Parity and six UCI benchmark classification datasets. The simulation results show that the APSO-LM algorithm shows better performance than baseline algorithms in terms of convergence speed and Mean Squared Error (MSE).
Keywords
Data Classification, Levenberg Marquardt Back Propagation, Local Minima, Nature Inspired Algorithms, Particle Swarm Optimization
Divisions
fsktm
Publication Title
Journal of Computational and Theoretical Nanoscience
Volume
13
Issue
1
Publisher
American Scientific Publishers