Научная электронная библиотека ULRICH'S Periodicals Directory

Сибирский государственный университет
науки и технологий имени академика М.Ф. Решетнева

Сибирский аэрокосмический журнал
ISSN 2712-8970 (Print) ISSN 2782-5760 (on-line)

Сведения об образовательной организации

UDK 519.87 Vestnik SibGAU. 2014, No. 3(55), P. 35–41
SPEECH-BASED EMOTION RECOGNITION OF THE DISTANT STUDENT WITH ADAPTIVE INTELLECTUAL INFORMATION TECHNOLOGIES
Ch. Yu. Brester, S. R. Vishnevskaya, O. E. Semenkina
Siberian State Aerospace University named after academician M. F. Reshetnev 31, Krasnoyarsky Rabochiy Av., Krasnoyarsk, 660014, Russian Federation E-mail: christina.bre@mail.ru, vishni@ngs.ru, semenkina.olga@mail.ru
To overcome the negative sides of distance education and to develop the communicative competence of the distant student, it is necessary to improve the interactive dialogue systems, in particular, to realize the opportunity of speaker state recognition. Although lots of excellent results have already been achieved in this sphere, there are some open questions. Recently scientists have developed various program systems which are good at extracting numerical characteristics from speech-signals. Unfortunately, the amount of features might be huge that becomes a challenge for classification models. There-fore it is significant to determine relevant features from data sets. In this paper we consider the feature selection proce-dure that is based on the adaptive multi-objective evolutionary algorithm and investigate its efficiency in combination with different classification models. Generally, the feature selection procedure can be organized as a wrapper ap-proach or a filter one. Compared with the wrapper approach, the second technique requires less computational re-sources and also demonstrates good results. Therefore in this research we implemented the feature selection procedure according to the scheme of the filter approach. Furthermore, to avoid choosing the genetic algorithm settings we devel-oped a self-adaptive modification of the conventional multi-objective genetic algorithm. Due to application of the self-adaptive heuristic optimization procedure it became possible not only to improve the performance of involved classifiers but also to reduce the number of selected features essentially. Obtained results demonstrate high performance of the developed algorithmic scheme and imply the reasonableness of its usage in the dialogue system modules for recognition of student emotions distantly.
distance education, intellectual dialogue system, emotion recognition, adaptive multi-objective genetic algorithm, classifier.
References

1. Aivazian S. A. Prikladnaja statistika: Klassifikacii i snizhenie razmernosti: Sprav. izd. [Applied Statistics. Classification and reduction of dimension: Ref. ed.] Moscow, Finance and Statistics Publ., 1989, 607 p.

2. Brester C., Semenkin E., Sidorov M., Minker W. Self-adaptive multi-objective genetic algorithms for feature selection. Proceedings of International Conference on Engineering and Applied Sciences Optimization
(OPT-i’14), 2014, p. 1838–1846.

3. Kohavi R., John G. H. Wrappers for feature subset selection. Artificial Intelligence, 97, 1997, p. 273–324.

4. Venkatadri M., Srinivasa Rao K. A multiobjective genetic algorithm for feature selection in data mining. International Journal of Computer Science and Information Technologies, 2010, vol. 1, no. 5, p. 443–448.

5. Brester C., Sidorov M., Semenkin E. Acoustic Emotion Recognition: Two Ways of Features Selection Based on Self-Adaptive Multi-Objective Genetic Algorithm. Proceedings of the International Conference on Informatics in Control, Automation and Robotics (ICINCO), 2014, p. 851–855.

6. Zitzler E., Thiele L. Multiobjective evolutionary algorithms: A comparative case study and the strength pareto approach. Evolutionary Computation, IEEE Transactions on, 1999, vol. 3, no. 4, p. 257–271.

7. Semenkin E., Semenkina M. Self-configuring Genetic Algorithm with Modified Uniform Crossover Operator. Advances in Swarm Intelligence. Lecture Notes in Computer Science 7331. Springer-Verlag, Berlin Heidelberg, 2012, p. 414–421.

8. Semenkina M. [Effectiveness investigation of adaptive evolutionary algorithms for data mining information technology design]. Iskusstvennyj intellekt i prinjatie reshenij. 2013, no. 1, p. 13–23. (In Russ.)

9. Khritonenko D. I., Semenkin E. S. Distributed self-configuring evolutionary algorithms for artificial neural networks design. Vestnik SibGAU. 2013, no. 4 (50), p. 112–116. (In Russ.)

 

10.  Stanovov V. V., Semenkin E. S. Self-adjusted evolutionary algorithms based approach for automated design of fuzzy logic systems. Vestnik SibGAU. 2013,
no. 4 (50), p. 148–152. (In Russ.)

11. Eiben A. E., Hinterding R. and Michalewicz Z. Parameter control in evolutionary algorithms. IEEE Transactions on Evolutionary Computation, 1999, no. 3(2), p. 124–141.

12.  Daridi F., Kharma N. and Salik J. Parameterless genetic algorithms: review and innovation. IEEE Canadian Review, 2004, vol. 47, p. 19–23.

13.  Sergienko R., Semenkin E. Competitive Cooperation for Strategy Adaptation in Coevolutionary Genetic Algorithm for Constrained Optimization. IEEE World Congress on Computational Intelligence (WCCI'2010), Barcelona, Spain, 2010, p. 1626–1631.

14.  Sergienko R. [Effectiveness investigation of the coevolutionary genetic algorithm for constrained optimization]. Vestnik SibGAU. 2009, no. 3 (24), p. 31–34. (In Russ.)

15.  Hall M., Frank E., Holmes G., Pfahringer B., Reutemann P., Witten I. H. The WEKA Data Mining Software: An Update, SIGKDD Explorations, 2009, Vol. 11, Iss. 1.

16.  Burkhardt F., Paeschke A., Rolfes M., Sendlmeier W. F., and Weiss B. A database of german emotional speech. In Interspeech, 2005, p. 1517–1520.

17.  Haq S., Jackson P. Machine Audition: Principles, Algorithms and Systems, chapter Multimodal Emotion Recognition. IGI Global, Hershey PA, Aug. 2010, p. 398–423.

18.  Schmitt A., Ultes S., and Minker W. A parameterized and annotated corpus of the cmu let’s go bus information system. Proceedings of International Conference on Language Resources and Evaluation (LREC), 2012.

19.  Eyben F., Wöllmer M., and Schuller B. Opensmile: the munich versatile and fast opensource audio feature extractor. Proceedings of the international conference on Multimedia, 2010. ACM, p. 1459–1462.

20.    Boersma P. Praat, a system for doing phonetics by computer. Glot international, 5(9/10), 2002, p. 341–345


Brester Christina Yuryevna – Master’s Degree student, junior research fellow, Siberian State Aerospace University named after academician M. F. Reshetnev. E-mail: christina.bre@yandex.ru.

Vishnevskaya Sofya Romanovna – Candidate of Engineering Science, associate professor, Head of Higher Mathematics Department, Siberian State Aerospace University. E-mail: vishni@ngs.ru.

Semenkina Olga Ernestovna – Doctor of Engineering Science, Professor, Professor of Higher Mathematics Department, Siberian State Aerospace University named after academician M. F. Reshetnev. E-mail: semenkina.olga@mail.ru.