McShane, Blake Adrian, Moshe Bradlow, Eric T Fader, Peter S
Abstract
The widespread popularity and use of both the Poisson and the negative binomial models for count data arise, in part, from their derivation as the number of arrivals in a given time period assuming exponentially distributed interarrival times (without and with heterogeneity in the underlying base rates, respectively). However, with that clean theory come some limitations including limited flexibility in the assumed underlying arrival rate distribution and the inability to model underdispersed counts (variance less than the mean). Although extant research has addressed some of these issues, there still remain numerous valuable extensions. In this research, we present a model that, due to computational tractability, was previously thought to be infeasible. In particular, we introduce here a generalized model for count data based upon an assumed Weibull interarrival process that nests the Poisson and negative binomial models as special cases. The computational intractability is overcome by deriving the Weibull count model using a polynomial expansion which then allows for closed-form inference (integration term-by-term) when incorporating heterogeneity due to the conjugacy of the expansion and a commonly employed gamma distribution. In addition, we demonstrate that this new Weibull count model can (1) model both over- and underdispersed count data, (2) allow covariates to be introduced in a straightforward manner through the hazard function, and (3) be computed in standard software.
Download Info
To download:
If you experience problems downloading a file, check if you have the
proper application to
view it first. Information about this may be contained
in the File-Format links below. In case of further problems read
the IDEAS help
page. Note that these files are not on the IDEAS
site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.