Isotonic Regression for Variance Estimation and Its Role in Mean Estimation and Model Validation

We study isotonic regression which is a nonparametric rank-preserving regression technique. Under the assumption that the variance function of a response is monotone in its mean functional, we investigate a novel application of isotonic regression as an estimator of this variance function. Our proposal of variance estimation with isotonic regression is used in multiple classical regression problems focused on mean estimation and model validation. In a series of numerical examples, we (1) explore the power variance parameter of the variance function within Tweedie’s family of distributions, (2) derive a semi-parametric bootstrap under heteroscedasticity, (3) provide a test for auto calibration, (4) explore a quasi-likelihood approach to benefit from best-asymptotic estimation, and (5) deal with several difficulties under Lognormal assumptions. In all of these problems we verify that the variance estimation with isotonic regression is essential for proper mean estimation and beneficial compared to traditional statistical techniques based on local polynomial smoothers.