UDK 519.87
MULTIAGENT ALGORITHM FOR FUZZY RULE BASES DESIGN FOR CLASSIFICATION PROBLEM
V. V. Stanovov*, S. S. Bezhitskii, E. A. Bezhitskaya, E. A. Popov
Reshetnev Siberian State Aerospace University 31, Krasnoyarskiy Rabochiy Аv., Krasnoyarsk, 660037, Russian Federation *E-mail: vladimirstanovov@yandex.ru
In this article a multiagent approach for organizing an ensemble of optimizers, based on the meetings between algo-rithms is presented. During the optimization process the agents exchange with best solutions and better algorithms re-ceive more resources in the form of meetings. Among agents the six genetic algorithms with different operators and three particle swarm optimizers have been selected. The proposed approach of ensemble-based optimization problems solving is applied to the problem of designing a fuzzy rule base. The fuzzy rule base consisted of a fixed number of rules, for every variable and every rule the membership function was defined with two sigmoidal functions. The encoded parameters were the points where sigmoids reached 0 and 1, so that the problem of designing a fuzzy rule base reduced to a real-valued optimization problem. The number of real-valued parameters depended on the dimension of the classi-fication problem. The effectiveness of the algorithm was compared to the self-configured genetic algorithm, solving the same problem of designing a fuzzy rule base. The classification quality was estimated using the accuracy values; the sample was split with 70 and 30 ratio. As classification problems, six problems have been selected from KEEL and UCI repositories, including credit scoring problems, medical diagnostics problems, banknote recognition and seeds’ forms. Two more classification methods have been selected for comparison, more precisely, support vector machines (SVM) and another fuzzy classification method, in which the term numbers were encoded. According to the testing results, it should be mentioned that the multiagent algorithm has shown the effectiveness, comparable to other method when solving complex optimization problems.
Keywords: evolutionary algorithms, particle swarm optimization, fuzzy logic, machine learning, genetic fuzzy sys-tems, classification.
References

References

 

  1. Cordon O., Herrera F., Hoffmann F., Magdalena L. Genetic Fuzzy Systems. Evolutionary tuning and learning of fuzzy knowledge bases. Advances in Fuzzy Systems: Applications and Theory, World Scientific, 2001, 489 p.
  2. Semenkin E., Semenkina M. Self-configuring genetic algorithm with modified uniform crossover operator. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 7331 LNCS (PART 1), P. 414–421.
  3. Semenkin E., Semenkina M. Self-configuring genetic programming algorithm with modified uniform crossover. 2012 IEEE Congress on Evolutionary Computation, CEC 2012, P. 1918–1923.
  4. Zhong W., Lui J., Xue M., Jiao L. A Multi-Agent Genetic Algorithm for Global Numerical Optimization. IEEE Transactions on Cybernetics, 2004, No. 34(2), P. 1128–1141.
  5. Akhmedova S., Semenkin E. Co-operation of biology related algorithms. 2013 IEEE Congress on Evolutionary Computation, CEC 2013, P. 2207–2214.
  6. Gumennikova A. V., Emeljanova M. N., Semen-
    kin E. S., Sopov E. A. [On evolutionary algorithms for solving complex optimization problems]. Vestnik SibGAU. 2003, No. 4, P. 14–24 (In Russ.).
  7. Clerc M., Kennedy J. The particle swarm–explosion, stability, and convergence in a multidimensional complex space. IEEE Transaction on Evolutionary Computation, 2002, No. 6(1), P. 58–73.
  8. Mendes R., Kennedy J., Neves J. The fully informed particle swarm: Simpler, maybe better. IEEE Transactions on Evolutionary Computation. 2004, No. 8 (3), P. 204–210.
  9. Asuncion A., Newman D. UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences, 2007, Available at: http://www.ics.uci.edu/~mlearn/MLRepository.html.
  10. Alcalá-Fdez J., Sánchez L., Garcia S., del Jesus M. J., Ventura S., Garrell J. M., Otero J., Romero C., Bacardit J., Rivas V. M., Fernández J. C., Herrera F. KEEL: A software tool to assess evolutionary algorithms for data mining problems, Soft Comput., 2009, Vol. 13, No. 3, P. 307–318.
  11. Semenkin E., Semenkina M. Empirical study of self-configuring genetic programming algorithm performance and behavior. IOP Conference Series: Materials Science and Engineering, 2015, No. 70 (1), 012004, P. 1–13.
  12. Stanovov V. V., Semenkin E. S. Self-adjusted evolutionary algorithms based approach for automated design of fuzzy logic systems. Vestnik SibGAU, 2013, No. 4 (50), P. 148–152 (In Russ.).
  13. Akhmedova Sh. A., Semenkin E. S. SVM-based classifier ensembles design with co-operative biology inspired algorithm. Vestnik SibGAU, 2015, Vol. 16, No. 1, P. 22–27 (In Russ.).
  14. Stanovov V. V., Semenkin E. S. [Self-configured evolutionary algorithm for designing fuzzy rule bases for classification problems]. Sistemy upravleniya i informatsionnye tekhnologii. 2014, Iss. 57, No. 3, P. 30–35 (In Russ.).
  15. Bezhitskiy S. S., Semenkin E. S., Semenkina O. J. [Hybrid evolutionary algorithm for the problems of selecting effective variants of control systems]. Avtomatizatsiya. Sovremennye tekhnologii. 2005, No. 11, P. 24 (In Russ.).

Stanovov Vladimir Vadimovich – postgraduate student, Reshetnev Siberian State Aerospace University. E-mail: vladimirstanovov@yandex.ru.

Bezhitskii Sergei Sergeevich – Cand. Sc., Docent, System analysis and operation research department, Reshetnev Siberian State Aerospace University. E-mail: bezhitsk@yandex.ru.

Bezhitskaya Ekaterina Andreevna – master of engineering and technology, senior lecturer, Informational economical systems department, Reshetnev Siberian State Aerospace University. E-mail: bezhitsk@mail.ru.

Popov Eugene Aleksandrovich – Dr. Sc., professor, professor of System analysis and operation research department, Reshetnev Siberian State Aerospace University. E-mail: epopov@bmail.ru.