CSLMEN: A New Optimized Method for Training Levenberg Marquardt Elman Network Based Cuckoo Search Algorithm
Nazri Mohd. Nawi, M.Z Rehman, Abdullah Khan
Nazri Mohd. Nawi
Available Online January 2014.
- Back propagation neural network, cuckoo search algorithm, local minima, artificial bee colony algorithm.
- RNNs have local feedback loops within the network which allows them to shop earlier accessible patterns. This network can be educated with gradient descent back propagation and optimization technique such as second-order methods; conjugate gradient, quasi-Newton, Levenberg- Marquardt have also been used for networks training [14, 15]. But still this algorithm is not definite to find the global minimum of the error function since gradient descent may get stuck in local minima, Nature inspired metaheuristic algorithms provide derivativefree solution to optimize complex problems. This paper proposed a new metaheuristic search algorithm, called cuckoo search (CS), based on cuckoo bird’s behavior to train Levenberg Marquardt Elman network (LMEN) in achieving fast convergence rate and to avoid local minima problem. The proposed Cuckoo Search Levenberg Marquardt Elman network (CSLMEN) results are compared with artificial bee colony using BP algorithm, and other hybrid variants. Specifically OR and XOR datasets are used. The simulation results show that the computational efficiency of BP training process is highly enhanced when coupled with the proposed hybrid method.
- Open Access
- This is an open access article distributed under the CC BY-NC license.
Cite this article
TY - CONF AU - Nazri Mohd. Nawi AU - M.Z Rehman AU - Abdullah Khan PY - 2014/01 DA - 2014/01 TI - CSLMEN: A New Optimized Method for Training Levenberg Marquardt Elman Network Based Cuckoo Search Algorithm BT - Proceedings of the 2013 International Conference on Advances in Intelligent Systems in Bioinformatics PB - Atlantis Press SP - 58 EP - 63 SN - 1951-6851 UR - https://www.atlantis-press.com/article/11358 ID - Nawi2014/01 ER -