Tail index estimation for discrete heavy-tailed distributions with application to statistical inference for regular markov chains

It is the purpose of this paper to investigate the issue of estimating the regularity index $$\beta >0$$ β > 0 of a discrete heavy-tailed r.v. S, i.e. a r.v. S valued in $$\mathbb {N}^*$$ N ∗ such that $$\mathbb {P}(S>n)=L(n)\cdot n^{-\beta }$$ P ( S > n ) = L ( n ) · n - β for all $$n\ge 1$$ n ≥ 1 , where $$L:\mathbb {R}^*_+\rightarrow \mathbb {R}_+$$ L : R + ∗ → R + is a slowly varying function. Such discrete probability laws, referred to as generalized Zipf’s laws sometimes, are commonly used to model rank-size distributions after a preliminary range segmentation in a wide variety of areas such as e.g. quantitative linguistics, social sciences or information theory. As a first go, we consider the situation where inference is based on independent copies $$S_1,\; \ldots ,\; S_n$$ S 1 , … , S n of the generic variable S. The estimator $$\widehat{\beta }$$ β ^ we propose can be derived by means of a suitable reformulation of the regularly varying condition, replacing S’s survivor function by its empirical counterpart. Under mild assumptions, a non-asymptotic bound for the deviation between $$\widehat{\beta }$$ β ^ and $$\beta $$ β is established, as well as limit results (consistency and asymptotic normality). Beyond the i.i.d. case, the inference method proposed is extended to the estimation of the regularity index of a regenerative $$\beta $$ β -null-recurrent Markov chain. Since the parameter $$\beta $$ β can be then viewed as the tail index of the (regularly varying) distribution of the return time of the chain X to any (pseudo-) regenerative set, in this case, the estimator is constructed from the successive regeneration times. Because the durations between consecutive regeneration times are asymptotically independent, we can prove that the consistency of the estimator promoted is preserved. In addition to the theoretical analysis carried out, simulation results provide empirical evidence of the relevance of the inference technique proposed.