UDK 519.2
SOME GENERALIZATIONS OF METHOD OF MOMENTS IN PROBABILITY DENSITY ESTIMATION BY ORTHOGONAL SERIES
V. V. Branishti
Reshetnev Siberian State Aerospace University 31, Krasnoyarsky Rabochy Av., Krasnoyarsk, 660037, Russian Federation E-mail: branishti-v-v@yandex.ru
A problem of probability density function estimation for continuous random variable is considered in the paper. Actuality of this problem for science and technology including aerospace branch is discussed. Building of the probabil-ity density functions estimation by orthonormal series is considered. Applying of the method of moments to statistical estimating series coefficients is investigated, and some generalizations are suggested. Within the scope of method of moments the author uses consecutive ordinary moments of random variable. In this case the calculation of series coeffi-cients estimations is reduced to solving system of linear equations. The paper has the proof of the theorem that in specified conditions of orthonormal system choice, suggested gener-alization of the method of moments includes the ordinary method of moments and also more widespread estimating coefficients method by sample means of orthonormal functions as particular cases. The paper shows that in the case of using Legendre’s orthonormal system the considered methods are identical. The properties of built estimations are researched, mathematical expectations and covariance matrix are founded. The paper shows that in particular cases the estimations of series coefficients are biased. The estimations of series coefficients, which are calculated by suggested method, were used for building estimation of probability density function. The paper has results of numerical calcula-tions of quality functional values for built estimations of probability density function. The calculations are carried out for uniformly distributed random value. The author compares the suggested method with the widespread estimating method with using Chebyshev’s and trigonometric orthonormal systems. Research shows that generalized method of moments gives substantially better result on small samples.
Keywords: nonparametric indeterminacy, probability density function, statistical estimation, orthogonal functions, method of moments, matrix analysis.
References

References

 

1.  Akimov S. S. [Methods of probability density function recovering with sample of the entire assembly]. Estestvennye i matematicheskie nauki v sovremennom mire. 2014, Vol. 1 (13), P. 29–35 (In Russ.).

2.  Kobzar A. I. Prikladnaya matematicheskaya statistika: dlya inzhenerov i nauchnykh rabotnikov [Applied mathematical statistics: for engineers and scientists]. Moscow, Fizmatlit Publ., 2006, 816 p.

3.  Rosenblatt M. [Remarks on some nonparametric estimates of a density function]. The Annals of Mathematical Statistics, 1956, Vol. 27, 3, P. 832–837.

4.  Parzen E. On estimation of a probability density function and mode. The Annals of Mathematical Statistics, 1962, Vol. 35, No. 3, P. 1065–1076.

5.  Chentsov N. N. Statisticheskie reshayushchie pravila i optimal’nye vyvody [Statistical decision rules and optimal conclusions]. Moscow, Fizmatlit Publ., 1972, 520 p.

6.  Kolmogorov A. N., Fomin S. V. Elementy teorii funktsiy i funktsional'nogo analiza [Elements of function theory and function analysis]. 6th edition. Moscow, Nauka Publ., 1989, 624 p.

7.  Chentsov N. N. [Estimation of unknown probability density function on observations]. Doklady Akademii nauk SSSR, 1962, Vol. 147, No. 1, P. 45–48 (In Russ.).

8.  Novoselov A. A. Ob optimal’nom vybore struktury funktsii plotnosti veroyatnosti i regressii: preprint [On optimal choice of probability density function and regression structure: preprint]. Krasnoyarsk, Computational Centre of Siberian Department Academy of Science USSR Publ., 1979, 31 p.

9.  Cramér H. Mathematical methods of statistics. Princeton University Press, 1946, 575 p.

10.  Maltsev A. I. Osnovy lineynoy algebry [Basics of linear algebra], 3rd ed. Moscow, Nauka Publ., 1970, 400 p.

11.  Nikiforov A. F., Uvarov V. B. Spetsial’nye funktsii matematicheskoy fiziki [Special functions of mathematical physics], 2nd ed. Moscow, Nauka Publ., 1984, 344 p.

12.  Fikhtengol’ts G. M. Kurs differentsial’nogo
i integral'nogo ischisleniya
[Course of differential and integral calculus]. 8th ed. Moscow, Fizmatlit Bubl., 2003, Vol. 3, 728 p.

13.  Horn R., Johnson C. Matrix analysis. Cambridge University Press, 1990, 561p.

14.  Epanechnikov V. A. [Nonparametric estimation of a multidimensional probability density]. Teoriya veroyatnostey i ee prilozheniya, 1969, Vol. 14, No. 1,
P. 156–162 (In Russ.).

15.  Vapnik V. N. Vosstanovleniye zavisimostey po empiricheskim dannym [Dependences recovery from empirical data]. Moscow, Nauka Publ., 1979, 448 p.

 


Branishti Vladislav Vladimirovich – senior lecturer, Higher mathematics Dept, Reshetnev Siberian State Aerospace University. Е-mail: branishti-v-v@yandex.ru.