TITLE

# Comparative Construction of Plug-in Estimators of the Entropy Rate of Two-state Markov Chains

AUTHOR(S)
Girardin, Valérie; Sesboüé, André
PUB. DATE
June 2009
SOURCE
Methodology & Computing in Applied Probability;Jun2009, Vol. 11 Issue 2, p181
SOURCE TYPE
DOC. TYPE
Article
ABSTRACT
The entropy rate of an ergodic homogeneous Markov chain taking only two values is an explicit function of its transition probabilities. We study plug-in estimators of this entropy rate based on the observation of either one trajectory with long length or several trajectories with fixed length. Their exact asymptotic distributions are given. A detailed numerical study using simulation results is provided. Real data of rainfall occurrences are studied.
ACCESSION #
36966671

## Related Articles

• Degenerate $$U$$- and $$V$$-statistics under ergodicity: asymptotics, bootstrap and applications in statistics. Leucht, Anne; Neumann, Michael // Annals of the Institute of Statistical Mathematics;Apr2013, Vol. 65 Issue 2, p349

We derive the asymptotic distributions of degenerate $$U$$- and $$V$$-statistics of stationary and ergodic random variables. Statistics of these types naturally appear as approximations of test statistics. Since the limit variables are of complicated structure, typically depending on unknown...

• Search Schemes for Random Optimization Algorithms That Preserve the Asymptotic Distribution. Dorea, Chang C. Y.; Goncalves, Catia R. // Journal of Applied Probability;Sep99, Vol. 36 Issue 3, p825

Deals with the Markovian algorithms for estimating the global maximum or minimum of real valued functions defined on some domain omega. Asymptotic distribution; Search schemes.

• Computation of the asymptotic null distribution of goodness-of-fit tests for multi-state models. Titman, Andrew C. // Lifetime Data Analysis;Dec2009, Vol. 15 Issue 4, p519

We develop an improved approximation to the asymptotic null distribution of the goodness-of-fit tests for panel observed multi-state Markov models (Aguirre-Hernandez and Farewell, Stat Med 21:1899â€“1911, 2002) and hidden Markov models (Titman and Sharples, Stat Med 27:2177â€“2195,...

• Efficient p-value evaluation for resampling-based tests. Yu, Kai; Liang, Faming; Ciampa, Julia; Chatterjee, Nilanjan // Biostatistics;Jul2011, Vol. 12 Issue 3, p582

The resampling-based test, which often relies on permutation or bootstrap procedures, has been widely used for statistical hypothesis testing when the asymptotic distribution of the test statistic is unavailable or unreliable. It requires repeated calculations of the test statistic on a large...

• Asymptotic study of an estimator of the entropy rate of a two-state Markov chain for one long trajectory. Girardin, Valérie; Sesboüé, André // AIP Conference Proceedings;2006, Vol. 872 Issue 1, p403

The entropy rate of an ergodic homogeneous Markov chain taking only two values is an explicit function of its transition probabilities. We study a plug-in estimator of this entropy rate obtained from the observation of one trajectory with long length. Its exact asymptotic distribution is given....

• Scaled Entropy for Dynamical Systems. Zhao, Yun; Pesin, Yakov // Journal of Statistical Physics;Jan2015, Vol. 158 Issue 2, p447

In order to characterize the complexity of a system with zero entropy we introduce the notions of scaled topological and metric entropies. We allow asymptotic rates of the general form $$e^{\alpha a(n)}$$ determined by an arbitrary monotonically increasing 'scaling' sequence $$a(n)$$ . This...

• Unmixing hyperspectral images using Markov random fields. Eches, Olivier; Dobigeon, Nicolas; Tourneret, Jean-Yves // AIP Conference Proceedings;3/14/2011, Vol. 1305 Issue 1, p303

This paper proposes a new spectral unmixing strategy based on the normal compositional model that exploits the spatial correlations between the image pixels. The pure materials (referred to as endmembers) contained in the image are assumed to be available (they can be obtained by using an...

• A Monte Carlo Estimation of the Entropy for Markov Chains. Chauveau, Didier; Vandekerkhove, Pierre // Methodology & Computing in Applied Probability;Mar2007, Vol. 9 Issue 1, p133

We introduce an estimate of the entropy $\mathbb{E}_{p^t}(\log p^t)$ of the marginal density p t of a (eventually inhomogeneous) Markov chain at time t=1. This estimate is based on a double Monte Carlo integration over simulated i.i.d. copies of the Markov chain, whose transition density...

• LONG TERM SLOT PLAY AND THE CENTRAL LIMIT THEOREM: SOME SURPRISING RESULTS. MARKOWSKI, EDWARD P.; MARKOWSKI, CAROL A. // Indian Journal of Economics & Business;Special Issue, p9

When applying the Central Limit Theorem(CLT), some judgment must be made concerning whether the sample size available is sufficiently large to obtain reliable results. In this paper, we analyze a real world application where the CLT has been applied to a highly skewed population distribution....

Share