IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v144y2020ics0167947319302488.html
   My bibliography  Save this article

Bias and covariance of the least squares estimate in a structured errors-in-variables problem

Author

Listed:
  • Quintana Carapia, Gustavo
  • Markovsky, Ivan
  • Pintelon, Rik
  • Csurcsia, Péter Zoltán
  • Verbeke, Dieter

Abstract

A structured errors-in-variables (EIV) problem arising in metrology is studied. The observations of a sensor response are subject to perturbation. The input estimation from the transient response leads to a structured EIV problem. Total least squares (TLS) is a typical estimation method to solve EIV problems. The TLS estimator of an EIV problem is consistent, and can be computed efficiently when the perturbations have zero mean, and are independently and identically distributed (i.i.d). If the perturbation is additionally Gaussian, the TLS solution coincides with maximum-likelihood (ML). However, the computational complexity of structured TLS and total ML prevents their real-time implementation. The least-squares (LS) estimator offers a suboptimal but simple recursive solution to structured EIV problems with correlation, but the statistical properties of the LS estimator are unknown. To know the LS estimate uncertainty in EIV problems, either structured or not, to provide confidence bounds for the estimation uncertainty, and to find the difference from the optimal solutions, the bias and variance of the LS estimates should be quantified. Expressions to predict the bias and variance of LS estimators applied to unstructured and structured EIV problems are derived. The predicted bias and variance quantify the statistical properties of the LS estimate and give an approximation of the uncertainty and the mean squared error for comparison to the Cramér–Rao lower bound of the structured EIV problem.

Suggested Citation

  • Quintana Carapia, Gustavo & Markovsky, Ivan & Pintelon, Rik & Csurcsia, Péter Zoltán & Verbeke, Dieter, 2020. "Bias and covariance of the least squares estimate in a structured errors-in-variables problem," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    • Handle: RePEc:eee:csdana:v:144:y:2020:i:c:s0167947319302488
    DOI: 10.1016/j.csda.2019.106893
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947319302488
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2019.106893?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kiviet, Jan F. & Phillips, Garry D.A., 2012. "Higher-order asymptotic expansions of the least-squares estimation bias in first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3705-3729.
    2. Kiviet, Jan F. & Phillips, Garry D.A., 2014. "Improved variance estimation of maximum likelihood estimators in stable first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 424-448.
    3. Yeredor, Arie & De Moor, Bart, 2004. "On homogeneous least-squares problems and the inconsistency introduced by mis-constraining," Computational Statistics & Data Analysis, Elsevier, vol. 47(3), pages 455-465, October.
    4. Van Huffel, Sabine & Cheng, Chi-Lun & Mastronardi, Nicola & Paige, Chris & Kukush, Alexander, 2007. "Total Least Squares and Errors-in-variables Modeling," Computational Statistics & Data Analysis, Elsevier, vol. 52(2), pages 1076-1079, October.
    5. Mastronardi, Nicola & O'Leary, Dianne P., 2007. "Fast robust regression algorithms for problems with Toeplitz structure," Computational Statistics & Data Analysis, Elsevier, vol. 52(2), pages 1119-1131, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu-Evans, Gareth, 2014. "A note on approximating moments of least squares estimators," MPRA Paper 57543, University Library of Munich, Germany.
    2. Gareth Liu-Evans, 2021. "Improving the Estimation and Predictions of Small Time Series Models," Working Papers 202106, University of Liverpool, Department of Economics.
    3. van Giersbergen, Noud P.A., 2016. "The ability to correct the bias in the stable AD(1,1) model with a feedback effect," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 186-204.
    4. Kiviet, Jan, 2019. "Instrument-free inference under confined regressor endogeneity; derivations and applications," MPRA Paper 96839, University Library of Munich, Germany.
    5. Boudoukh, Jacob & Israel, Ronen & Richardson, Matthew, 2022. "Biases in long-horizon predictive regressions," Journal of Financial Economics, Elsevier, vol. 145(3), pages 937-969.
    6. Naccarato, Alessia & Zurlo, Davide & Pieraccini, Luciano, 2012. "Least Orthogonal Distance Estimator and Total Least Square," MPRA Paper 42365, University Library of Munich, Germany.
    7. Kiviet, Jan F. & Phillips, Garry D.A., 2014. "Improved variance estimation of maximum likelihood estimators in stable first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 424-448.
    8. Maoshan Tian & Huw Dixon, 2022. "The variances of non-parametric estimates of the cross-sectional distribution of durations," Econometric Reviews, Taylor & Francis Journals, vol. 41(10), pages 1243-1264, November.
    9. Harish Palanthandalam-Madapusi & Tobin Van Pelt & Dennis Bernstein, 2009. "Matrix pencils and existence conditions for quadratic programming with a sign-indefinite quadratic equality constraint," Computational Optimization and Applications, Springer, vol. 45(4), pages 533-549, December.
    10. Liu-Evans Gareth D. & Phillips Garry D. A., 2012. "Bootstrap, Jackknife and COLS: Bias and Mean Squared Error in Estimation of Autoregressive Models," Journal of Time Series Econometrics, De Gruyter, vol. 4(2), pages 1-35, November.
    11. Kiviet, Jan F., 2023. "Instrument-free inference under confined regressor endogeneity and mild regularity," Econometrics and Statistics, Elsevier, vol. 25(C), pages 1-22.
    12. Valerie Good & Douglas E. Hughes & Hao Wang, 2022. "More than money: establishing the importance of a sense of purpose for salespeople," Journal of the Academy of Marketing Science, Springer, vol. 50(2), pages 272-295, March.
    13. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.
    14. Atukorala, Ranjani & Sriananthakumar, Sivagowry, 2015. "A comparison of the accuracy of asymptotic approximations in the dynamic regression model using Kullback-Leibler information," Economic Modelling, Elsevier, vol. 45(C), pages 169-174.
    15. Liu-Evans, Gareth, 2010. "An alternative approach to approximating the moments of least squares estimators," MPRA Paper 26550, University Library of Munich, Germany.
    16. Jan F. Kiviet & Garry D. A. Phillips, 2000. "Improved Coefficient and Variance Estimation in Stable First-Order Dynamic Regression Models," Econometric Society World Congress 2000 Contributed Papers 0631, Econometric Society.
    17. Torti, Francesca & Perrotta, Domenico & Atkinson, Anthony C. & Riani, Marco, 2012. "Benchmark testing of algorithms for very robust regression: FS, LMS and LTS," Computational Statistics & Data Analysis, Elsevier, vol. 56(8), pages 2501-2512.
    18. Phillip, Garry & Xu, Yongdeng, 2016. "Almost Unbiased Variance Estimation in Simultaneous Equation Models," Cardiff Economics Working Papers E2016/10, Cardiff University, Cardiff Business School, Economics Section.
    19. Jacob Boudoukh & Ronen Israel & Matthew P. Richardson, 2020. "Biases in Long-Horizon Predictive Regressions," NBER Working Papers 27410, National Bureau of Economic Research, Inc.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:144:y:2020:i:c:s0167947319302488. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.