Optimization of fuzzy CMAC using evolutionary Bayesian Ying-Yang learning

Abstract

Cerebellar model articulation controller (CMAC) is a popular associative memory neural network that imitates human’s cerebellum, which allows it to learn fast and carry out local generalization efficiently. This research aims to integrate evolutionary computation into fuzzy CMAC Bayesian Ying-Yang (FCMAC-BYY) learning, which is referred to as FCMAC-EBYY, to achieve a synergetic development in the search for optimal fuzzy sets and connection weights. Traditional evolutionary approaches are limited to small populations of short binary string length and as such are not suitable for neural network training, which involves a large searching space due to complex connections as well as real values. The methodology employed by FCMAC-EBYY is coevolution, in which a complex solution is decomposed into some pieces to be optimized in different populations/species and then assembled. The developed FCMAC-EBYY is compared with various neuro-fuzzy systems using a real application of traffic flow prediction.

Keywords

cerebellar model articulation controller (CMAC) / Bayesian Ying-Yang (BYY) learning / evolutionary computation

References

[1] Albus J S. Data storage in the cerebellar model articulation controller (CMAC). Transaction of the ASME, Journal of Dynamic Systems, Measurement, and Control, 1975, 97(3): 228-233

[2] Albus J S. A new approach to manipulator control: the cerebellar model articulation controller (CMAC). Transaction of the ASME, Journal of Dynamic Systems, Measurement, and Control, 1975, 97(3): 220-227

[3] Shi D, Quek C, Tilani R, Fu J. Product demand forecasting with a novel fuzzy CMAC. Neural Processing Letters, 2007, 25(1): 63-78

[4] Xu L. Bayesian-Kullback coupled YING-YANG machines: unified learning and new results on vector quantization. In: Proceedings of the International Conference on Neural Information Processing. 1995, 977-988

[5] Xu L. Bayesian Ying-Yang system, best harmony learning and five action circling. Frontiers of Electrical and Electronic Engineering in China, 2010, 5(3): 281-328

[6] Xu L. Advances on BYY harmony learning: information theoretic perspective, generalized projection geometry, and independent factor autodetermination. IEEE Transactions on Neural Networks, 2004, 15(4): 885-902

[7] Xu L. BYY harmony learning, structural RPCL, and topological self-organizing on mixture models. Neural Networks, 2002, 15(8-9): 1125-1151

[8] Nguyen M N, Shi D, Quek C. FCMAC-BYY: fuzzy CMAC using Bayesian Ying-Yang learning. IEEE Transactions on Systems, Man and Cybernetics – Part B, 2006, 36(5): 1180-1190

[9] Shi D, Nguyen M N, Zhou S, Yin G. Fuzzy CMAC with incremental Bayesian Ying-Yang learning and dynamic rule construction. IEEE Transactions on Systems, Man and Cybernetics – Part B, 2010, 40(2): 548-552

[10] Holland J. Adaptation in Natural and Artificial Systems. Ann Arbor: University of Michigan Press, 1975

[11] Howell M N, Gordon T J, Brandao F V. Genetic learning automata for function optimization. IEEE Transactions on Systems, Man, and Cybernetics – Part B, 2002, 32(6): 804-815

[12] Shi D, Dong C, Yeung D S. Neocognitron’s parameter tuning by genetic algorithms. International Journal of Neural Systems, 1999, 9(6): 497-509

[13] Pena-Reyes C A, Sipper M. Fuzzy CoCo: a cooperativecoevolutionary approach to fuzzy modeling. IEEE Transactions on Fuzzy Systems, 2001, 9(5): 727-737

[14] García-Pedrajas N, Hervás-Mart´inez C, Ortiz-Boyer D. Cooperative coevolution of artificial neural network ensembles for pattern classification. IEEE Transactions on Evolutionary Computation, 2005, 9(3): 271-302

[15] Quek C, Zhou RW. POPFNN: a pseudo outer-product based fuzzy neural network. Neural Networks, 1996, 9(9): 1569-1581

[16] Nafarieh A, Keller J M. A new approach to inference in approximate reasoning. Fuzzy Sets and Systems, 1991, 41(1): 17-37

[17] Yao X. Evolving artificial networks. Proceedings of the IEEE, 1999, 87(7): 1423-1447

[18] Mülenbein H, Schlierkamp-Voosen D. Predictive models for the breeder genetic algorithm: I. Continuous parameter optimization. Journal of Evolutionary Computation, 1993, 1(1): 25-49

[19] Quek C, Pasquier M, Lim B B S. POP-TRAFFIC: a novel fuzzy neural approach to road traffic analysis and prediction. IEEE Transactions on Intelligent Transportation Systems, 2006, 7(2): 133-146

[20] Nguyen M N, Shi D, Quek C, Ng G S. Traffic prediction using Ying-Yang fuzzy cerebellar model articulation controller. In: Proceedings of the 18th International Conference on Pattern Recognition. 2006, 3: 258-261

RIGHTS & PERMISSIONS

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg