Type
Conference PaperKAUST Department
Biological and Environmental Sciences and Engineering (BESE) DivisionBioscience Program
Date
2020-09-03Preprint Posting Date
2020-02-03Online Publication Date
2020-09-03Print Publication Date
2020-07Permanent link to this record
http://hdl.handle.net/10754/661708
Metadata
Show full item recordAbstract
NeuroEvolution is one of the most competitive evolutionary learning strategies for designing novel neural networks for use in specific tasks, such as logic circuit design and digital gaming. However, the application of benchmark methods such as the NeuroEvolution of Augmenting Topologies (NEAT) remains a challenge, in terms of their computational cost and search time inefficiency. This paper advances a method which incorporates a type of topological edge coding, named Reverse Encoding Tree (RET), for evolving scalable neural networks efficiently. Using RET, two types of approaches – NEAT with Binary search encoding (Bi-NEAT) and NEAT with Golden-Section search encoding (GS-NEAT) – have been designed to solve problems in benchmark continuous learning environments such as logic gates, Cartpole, and Lunar Lander, and tested against classical NEAT and FS-NEAT as baselines. Additionally, we conduct a robustness test to evaluate the resilience of the proposed NEAT approaches. The results show that the two proposed approaches deliver improved performance, characterized by (1) a higher accumulated reward within a finite number of time steps; (2) using fewer episodes to solve problems in targeted environments, and (3) maintaining adaptive robustness under noisy perturbations, which outperform the baselines in all tested cases. Our analysis also demonstrates that RET expends potential future research directions in dynamic environments. Code is available from https://github.com/HaolingZHANG/ReverseEncodingTree.Citation
Zhang, H., Yang, C.-H. H., Zenil, H., Kiani, N. A., Shen, Y., & Tegner, J. N. (2020). Evolving Neural Networks through a Reverse Encoding Tree. 2020 IEEE Congress on Evolutionary Computation (CEC). doi:10.1109/cec48606.2020.9185648Sponsors
This work was initiated by Living Systems Laboratory at King Abdullah University of Science and Technology (KAUST) lead by Prof. Jesper Tegner and supported by funds from KAUST. Chao-Han Huck Yang was supported by the Visiting Student Research Program (VSRP) from KAUST.Conference/Event name
2020 IEEE Congress on Evolutionary Computation (CEC)ISBN
978-1-7281-6930-9arXiv
2002.00539Additional Links
https://ieeexplore.ieee.org/document/9185648/https://ieeexplore.ieee.org/document/9185648/
https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9185648
Relations
Is Supplemented By:- [Software]
Title: HaolingZHANG/ReverseEncodingTree: Evolving Neural Network through the Reverse Encoding Tree. Publication Date: 2019-10-23. github: HaolingZHANG/ReverseEncodingTree Handle: 10754/668247
ae974a485f413a2113503eed53cd6c53
10.1109/CEC48606.2020.9185648