Научная электронная библиотека ULRICH'S Periodicals Directory

Сибирский государственный университет
науки и технологий имени академика М.Ф. Решетнева

Сибирский аэрокосмический журнал
ISSN 2712-8970 (Print) ISSN 2782-5760 (on-line)

Сведения об образовательной организации

UDK 591.87
SVM-BASED CLASSIFIER ENSEMBLES DESIGN WITH CO-OPERATIVE BIOLOGY INSPIRED ALGORITHM
Sh. A. Akhmedova*, E. S. Semenkin
Siberian State Aerospace University named after academician M. F. Reshetnev 31, Krasnoyarsky Rabochy Av., Krasnoyarsk, 660014, Russian Federation E-mail: shahnaz@inbox.ru
The meta-heuristic called Co-Operation of Biology Related Algorithms (COBRA) is used for the automated design of a support vector machine (SVM) based classifiers ensemble. Two non-standard schemes, based on the use of the locally most effective ensemble member’s output, are used to infer the ensemble decision. The usefulness of the approach is demonstrated on four benchmark classification problems solved: two bank scoring problems (Australian and German) and two medical diagnostic problems (Breast Cancer Wisconsin and Pima Indians Diabetes). Numerical experiments showed that classifier ensembles designed by COBRA exhibit high performance and reliability for separating instances from different categories. Ensembles of SVM-based classifiers implemented in this way outperform many alternative methods on the mentioned benchmark classification problems.
support vector machines, ensembles, biology inspired algorithms, classification, optimization.
References
  1. Dietterich T. G. Machine learning research: Four current directions. AI Mag. 1997, no. 18, p. 97–136.
  2. Rojas R. Neural networks: a systematic introduction. Springer-Verlag, Berlin. 1996, 502 p.
  3. Yager R. R., Filev D. P. Essentials of fuzzy modeling and control. Wiley, New York. 1994, 408 p.
  4. Eiben A. E., Smith J. E. Introduction to evolutionary computing. Springer, Berlin. 2003.
  5. Vapnik V., Chervonenkis A. Teoriya raspoznava-niya obrazov [Theory of Pattern Recognition]. Moscow, Nauka Publ., 1974, 415 p.
  6. Akhmedova Sh., Semenkin E. Co-Operation of Biology Related Algorithms. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC’2013). 2013. P. 2207–2214.
  7.  Akhmedova Sh., Semenkin E. [New optimization metaheuristic based on co-operation of biology related algorithms]. Vestnik SibGAU. 2013, No. 4 (50), p. 92–99 (In Russ.).
  8. Joachims T. Text categorization with Support Vector Machines: Learning with many relevant features. In Proceedings of the 10th European Conference on Machine Learning (ECML’1998). 1998, p. 137–142.
  9. Popov E. A., Semenkina M. E., Lipinskiy L. V. [Evolutionary algorithm for automatic generation of neural network based noise suppression systems]. Vestnik SibGAU. 2012, No. 4 (44), p. 79–82 (In Russ.).
  10. Kennedy J., Eberhart R. Particle Swarm Optimization. In Proceedings of International Conference on Neural networks IV. 1995, p. 1942–1948.
  11. Chenguang Yang, Xuyan Tu and Jie Chen. Algorithm of Marriage in Honey Bees Optimization Based on the Wolf Pack Search. In Proceedings of International Conference on Intelligent Pervasive Computing (IPC2007). 2007, p. 462–467.
  12. Yang X. S. Firefly algorithms for multimodal optimization. In Proceedings of 5th Symposium on Stochastic Algorithms, Foundations and Applications (SAGA 2009). 2009, p. 169–178.
  13. Yang X. S., Deb S. Cuckoo Search via Levy flights. In Proceedings of World Congress on Nature & Biologically Inspired Computing (NaBic2009). 2009, p. 210–214.
  14. Yang X. S. A new metaheuristic bat-inspired algorithm. Nature Inspired Cooperative Strategies for Optimization. Studies in Computational Intelligence. 2010, vol. 284, p. 65–74.
  15. Liang J. J., Qu B. Y., Suganthan P. N., Hernandez-Diaz, A. G. Problem Definitions and Evaluation Criteria for the CEC 2013 Special Session on Real-Parameter Optimization. Technical Report, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China, and Technical Report. Nanyang Technological University. Singapore. 2012.
  16. Deb K. An efficient constraint handling method for genetic algorithms. Computer methods in applied mechanics and engineering. 2000, vol. 186 (2–4), p. 311–338.
  17. Liang J. J., Shang Z., Li Z. Coevolutionary Comprehensive Learning Particle Swarm Optimizer. In Proceedings of Congress on Evolutionary Computation (CEC’2010). 2010, p. 1505–1512.
  18. Mallipeddi R., Suganthan P. N. Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real-Parameter Optimization. Technical report. Nanyang Technological University. Singapore. 2009.
  19. Frank A., Asuncion, A. UCI Machine Learning Repository. Irvine, CA: University of California, School of Information and Computer Science. 2010. Available at: http://archive.ics.uci.edu/ml.
  20. Huang J.-J., Tzeng G.-H., Ong Ch.-Sh. Two-stage genetic programming (2SGP) for the credit scoring model. Applied Mathematics and Computation. 2006, vol. 174, p. 1039–1053.
  21. Marcano-Cedeno A., Quintanilla-Domínguez J., Andina D. WBCD breast cancer database classification applying artificial metaplasticity neural network. Expert Systems with Applications: An International Journal. 2011, vol. 38, iss. 8, p. 9573–9579.
  22. Temurtas H., Yumusak N., Temurtas F. A comparative study on diabetes disease diagnosis using neural networks. Expert Systems with Applications. 2009, vol. 36, no. 4, p. 8610–8615.

Akhmedova Shakhnaz Agasuvar kyzy – Master’s Degree student, junior research fellow, Siberian State Aerospace University named after academician M. F. Reshetnev. Е-mail: shahnaz@inbox.ru

Semenkin Eugene Stanislavovich – Dr. Sc., professor of System Analysis and Operations Research Department, Siberian State Aerospace University named after academician M. F. Reshetnev. Е-mail: eugenesemenkin@yandex.ru