UDK 3517.9
ABOUT THE METHODS FOR SELECTION INFORMATIVE FEATURES USING SELF-ADJUSTING NEURAL NETWORK CLASSIFIERS AND THEIR ENSEMBLES
E. D. Loseva1, R. B. Sergienko2
1Reshetnev Siberian State Aerospace University 31, Krasnoyarsky Rabochy Av., Krasnoyarsk, 660037, Russian Federation 2Institute of Communications Engineering, Ulm University, 43, Albert Einstein Allee, Ulm, 89081, Germany
Using feature selection procedures based on filters is useful on the pre-processing stage for solving the task of data analysis in different domains including an air-space industry. However, it is a complicated problem, due to the absence of class labels that would guide the search for relevant information. The feature selection using “wrapper” approach requires a learning algorithm (function) to evaluate the candidate feature subsets. However, they are usually performed separately from each other. In this paper, we propose two-stage methods which can be performed in supervised and unsupervised forms simultaneously based on a developed scheme using three criteria for estimation (“filter”) and multi-criteria genetic programming using self-adjusting neural network classifiers and their ensembles (“wrapper”). The proposed approach was compared with different methods for feature selection on tree audio corpora in German, English and Russian languages for the speaker emotion recognition. The obtained results showed that the developed technique for feature selection provides to increase accuracy for emotion recognition.
Keywords: emotion recognition, neural network classifiers, multi-criteria genetic programming, feature selection.
References

1. Ministry of Defence of the Russian Federation. Available at: http://eng.mil.ru/en/structure/forces/cosmic.htm/ (accessed 02.6.2016).

2. Loseva E. D. [Application of ten algorithm for optimization of the support vector machine parameters and for optimization of feature selection process in the task of recognition human’s gender and age]. Materialy XII Mezhdunarodnoy nauch. prakt. konf. “Sovremennyye kontseptsii nauchnykh issledovaniy”. [Proceed. of XII International scientific-practical conference]. (27–28 March 2015, Moscow). Moscow, Part 7, No. 3, 2015, P. 132–136 (in Russ).

3. Maxim Sidorov, Christina Brester, Eugene Semenkin, Wolfgang Minker. Speaker State Recognition with Neural Network-based Classification and Self-adaptive Heuristic Feature Selection. International Conference on Informatics in Control (ICINCO). 2014, P. 699–703.

4. Holland J. H. Adaptation in Natural and Artificial System. University of Michigan Press. 1975, P. 18–35.

5. Jonathon Shlens. A Tutorial on Principal Component Analysis. Cornell University Library. 2014, P. 1–12.

6. Zitzler E., Thiele L. Multiobjective evolutionary algorithms: A comparative case study and the strength pareto approach. Evolutionary Computation (IEEET). 1999, No. 3(4), P. 257–271.

7. Saadia Minhas, Muhammad Younus Javed. Iris Feature Extraction Using Gabor Filter. International Conference on Emerging Technologies. 2009, P. 252–255.

8. Loseva E. D., Lipinsky L. V. [Ensemble of networks with application of multi-objective self-configurable genetic programming]. Vestnik SibGAU. Vol. 17, No. 1, 2016, P. 67–72 (in Russ.).

9. He X., Cai D., Niyogi P. Learning a Laplacian Score for Feature Selection. Advances in Neural Information Processing Systems 18 (NIPS). 2005, P. 1–8.

10. Ashish G., Satchidanada D. Evolutionary Algorithm for Multi-Criterion Optimization. A Survey. International Journal of Computing & Information Science. 2004, Vol. 2, No. 1, P. 43–45.

11. Loseva E. D. [Decision – making Scheme for Ensembles of Neural Networks in the Task of Intellectual Data Analysis]. Materialy XXV Mezhdunar. nauch. konf. “Aaktual’nyye problemy v sovremennoy nauke i puti ikh resheniya”. [Materials of XXV International science conference “Actual problems in science and ways to solve them”]. (28 April 2016, Moscow). Moscow, No. 4 (25), 2016, P. 20–26 (In Russ.).

12. Burkhardt F., Paeschke A., Rolfes M., Sendlmeier W. F., Weiss B. A database of german emotional speech. Interspeech. 2005, P. 1517–1520.

13. Schmitt A., Ultes S., Minker W. A parameterized and annotated corpus of the cmu let’s go bus information system. International Conference on Language Resources and Evaluation (LREC). 2012, P. 208–217.

14. Boersma P. PSat, a system for doing phonetics by computer. Glot international. 2002, No. 5(9/10), P. 341–345.

15. Akthar, F. and Hahne, C. Rapid Miner 5 Operator reference: Rapid-I. Dortmund. 2012, P. 25–55.


Loseva Elena Davidovna – postgraduate student, Institute of Informatics and Telecommunications, Reshetnev

Siberian State Aerospace University. E-mail: rabota_lena_19@mail.ru.

Sergienko Roman Borisovich – Dr. Sc., senior researcher at the research group of dialogue systems, University of

Ulm, Germany. E-mail: roman.sergienko@uni-ulm.de.