UDK 519.6
ABOUT THE EFFECTIVENESS OF EVOLUTIONARY ALGORITHMS FOR MULTICRITERIAL DESIGN OF ARTIFICIAL NEURAL NETWORKS
A. A. Koromyslova*, M. E. Semenkina
Siberian State Aerospace University named after academician M. F. Reshetnev 31, Krasnoyarsky Rabochy Av., Krasnoyarsk, 660014, Russian Federation *E-mail: akoromyslova@mail.ru
Artificial neural networks can be widely used in various fields: economics, medicine, space grown, etc. However, using neural networks to solve a particular problem arises the problem of choosing an effective structure of neural networks. Solving these problems is an important step in the application of neural network technology to practical problems, since these stages directly affects the quality (value) of the resulting neural network model. However, this takes more time and material resources, which leads to the need to automate the process. For this purpose the use of multicriteria evolutionary algorithms, such as SPEA, SPEA2 and NSGAII is offered as they can solve two problems at once. Firstly, they can generate a neural network, thus saving computational resources. And secondly, they can solve tasks quite efficiently. Modified evolutionary algorithms that produce selection of the most informative features, do not improve performance of algorithms that use all the inputs on the problems of small dimension, but significantly improve the accuracy, increasing dimension. The modified algorithms together with automatic design structure of artificial neural networks determine the most informative features, and include as inputs only weakly correlated with each other variables of the original problem.
artificial neural networks design, evolutionary algorithms, multicriteria optimization, most informative features, classification.
References
  1. Goldberg D. E. Genetic algorithms in search, optimization and machine learning. 1989, Reading, MA: Addison-Wesley, 403 p.
  2. Kruglov V., Borisov V. [Artificial neural networks]. Teoriya i praktika. Moscow, Goryachaya liniya – Telekom Publ., 2002, 382 p. (In Russ.).
  3. Girosi F., Jones M., Poggio T. Regularization theory and neural network architecture. Neural Computation. 1995, vol. 7, p. 219–270.
  4. Seshadri A. NSGA - II: A multi-objective optimization algorithm. 2006, 524 p.
  5. Wiley, J. & Sons. Multi-Objective Optimization Using Evolutionary Algorithms. 2001, p. 497.
  6. Holland J. H. Adaptation in natural and artificial systems. MI: University of Michigan Press, 1975.
  7. Test problems unconditional one-criterion optimization. Available at: http://dces.essex.ac.uk/staff/ qzhang/moeacompetition09.htm.
  8. Luke S. Essentials of Metaheuristics. A Set of Undergraduate Lecture Notes. Zeroth Edition. 2009, Online Version 0.5.
  9. Zhang Q., Zhou A., Zhao S., Suganthan P. N., Liu W., Tiwari S. Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition. Proceedings of IEEE Congress on Evolutionary Computation (CEC'2009). 2009, p. 30.
  10. Koromyslova A. A., Semenkina M. E. [Evolutionary design of neural network classifiers with the selection of the most informative features]. Materialy konferentsii “Teorija i praktika sistemnogo analiza” [Proceedings of the conference “Theory and practice of system analysis”]. Part 2, p. 74–83 (In Russ.).
  11. Haykin S. Neural Networks and Learning Machines (3rd Edition). 2009, 906 p.
  12. Brester Ch. Yu., Semenkin E. S. Development of adaptive genetic algorithms for neural network models multicriteria design. Vestnik SibSAU. 2013, No. 4(50),  p. 99–103.
  13. Frank A., Asuncion A. UCI Machine Learning Repository. 2010. Irvine, CA: University of California, School of Information and Computer Science. Available at: http://archive.ics.uci.edu/ml.
  14. Yu J. J. Q., Lam A. Y. S., Li V. O. K.: Evolutionary Artificial Neural Network Based on Chemical Reaction Optimization. In: IEEE Congress on Evolutionary Computation (CEC'2011), 2011, pр. 2083–2090.
  15. Sergienko R., Semenkin E., Bukhtoyarov V. Michigan and Pittsburgh Methods Combining for Fuzzy Classifier Generating with Coevolutionary Algorithm for Strategy Adaptation. Proceedings of IEEE Congress on Evolutionary Computation (CEC'2011). 2011, p. 113–120.

Koromyslova Aleksandra Andreevna – Master’s Degree student, System Analysis and Operations Research Department, Siberian State Aerospace University named after academician M. F. Reshetnev. Е-mail: akoromyslova@mail.ru

Semenkina Maria Evgen’evna – Cand. Sc., Docent, Department of the Higher Mathematics, Siberian State Aerospace University named after academician M. F. Reshetnev. Е-mail: semenkina88@mail.ru