Informatics and Applications
2018, Volume 12, Issue 3, pp 115-121
FILTERING OF MARKOV JUMP PROCESSES BY DISCRETIZED OBSERVATIONS
Abstract
The article is devoted to a solution of the optimal filtering problem of a homogenous Markov jump process state. The available observations represent time increments of the integral transformations of the Markov state corrupted by Wiener processes. The noise intensity is also state-dependent. At the instant of the consecutive observation obtaining, the optimal estimate is calculated recursively as a function of previous estimate and the new observation, meanwhile between observations the filtering estimate is a simple forecast by virtue of the Kolmogorov differential system. The recursion is rather expensive because of need to calculate the integrals, which are the location-scale mixtures of Gaussians. The mixing distributions represent the occupation of the state in each of possible values during the mid-observation intervals. The paper contains numerically cheaper approximations, based on the restriction of the state transitions number between the observations. Both the local and global characteristics of approximation accuracy are obtained as functions of the dynamics parameters, mid-observation interval length, and upper bound of transitions number.
[+] References (11)
- Wonham, W. 1965. Some applications of stochastic differential equations to optimal nonlinear filtering. SIAMJ. Control 2:347-369.
- Kloeden, P., and E. Platen. 1992. Numerical solution of stochastic differential equations. Berlin: Springer. 636 p.
- Yin, G., Q. Zhang, and Y. Liu. 2004. Discrete-time ap-proximation ofWonham filters. J. Control Theory Applica-tions 2:1-10.
- Platen, E., and R. Rendek. 2010. Quasi-exact approximation of hidden Markov chain filters. Communicat. Stoch. Analys. 4(1):129-142.
- Borisov, A. 2018. Wonham filtering by observations with multiplicative noises. Automat. Rem. Contr. 79(1):39-50. doi: 10.1134/ S0005117918010046.
- Bertsekas, D., and S. Shreve. 1996. Stochastic optimal control: The discrete-time case. Nashua, NH: Athena Sci-entific. 330 p.
- Jacod, J., andA. Shiryaev. 2003. Limit theorems for stochastic processes. Berlin: Springer. 664 p.
- Sericola, B. 2000. Occupation times in Markov processes. Commun. Stat. 16(5):479-510.
- Borovkov, A. 1984. Asymptotic methods in queueing theory. Hoboken, NJ: Wiley-Blackwell. 304 p.
- Borisov, A. 2017. Klassifikatsiya po nepreryvnym nablyudemiyam s mul'tiplikativnymi shumami. I. Formuly bayesovskoy otsenki [Classification by continuous-time observations in multiplicative noise. I. Formulae for Bayesian estimate]. Informatika i ee Primeneniya - Inform. Appl. 11(1):11-19. doi: 10.14357/19922264170102.
- Borisov, A. 2017. Klassifikatsiya po nepreryvnym nablyudemiyam s mul'tiplikativnymi summami. II. Formuly bayesovskoy otsenki [Classification by continuoustime observations in multiplicative noise. II. Numerical algorithm]. Informatika i ee Primeneniya - Inform. Appl. 11(2):33-41. doi: 10.14357/19922264170204.
[+] About this article
Title
FILTERING OF MARKOV JUMP PROCESSES BY DISCRETIZED OBSERVATIONS
Journal
Informatics and Applications
2018, Volume 12, Issue 3, pp 115-121
Cover Date
2018-08-30
DOI
10.14357/19922264180316
Print ISSN
1992-2264
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
Markov jump process; optimal filtering; multiplicative observation noises; stochastic differential equation; numerical approximation
Authors
A. V. Borisov
Author Affiliations
Institute of Informatics Problems, Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation
|