IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/8910.html
   My bibliography  Save this paper

On the Equivalence of the Weighted Least Squares and the Generalised Least Squares Estimators, with Applications to Kernel Smoothing

Author

Listed:
  • Luati, Alessandra
  • Proietti, Tommaso

Abstract

The paper establishes the conditions under which the generalised least squares estimator of the regression parameters is equivalent to the weighted least squares estimator. The equivalence conditions have interesting applications in local polynomial regression and kernel smoothing. Specifically, they enable to derive the optimal kernel associated with a particular covariance structure of the measurement error, where optimality has to be intended in the Gauss-Markov sense. For local polynomial regression it is shown that there is a class of covariance structures, associated with non-invertible moving average processes of given orders which yield the the Epanechnikov and the Henderson kernels as the optimal kernels.

Suggested Citation

  • Luati, Alessandra & Proietti, Tommaso, 2008. "On the Equivalence of the Weighted Least Squares and the Generalised Least Squares Estimators, with Applications to Kernel Smoothing," MPRA Paper 8910, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:8910
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/8910/1/MPRA_paper_8910.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Frederick R. Macaulay, 1931. "The Smoothing of Economic Time Series, Curve Fitting and Graduation," NBER Chapters, in: The Smoothing of Time Series, pages 31-42, National Bureau of Economic Research, Inc.
    2. Tian, Yongge & Wiens, Douglas P., 2006. "On equality and proportionality of ordinary least squares, weighted least squares and best linear unbiased estimators in the general linear model," Statistics & Probability Letters, Elsevier, vol. 76(12), pages 1265-1272, July.
    3. Frederick R. Macaulay, 1931. "The Smoothing of Time Series," NBER Books, National Bureau of Economic Research, Inc, number maca31-1, May.
    4. Wallis, Kenneth F, 1981. "Models for X-11 and 'X-11-Forecast' Procedures for Preliminary and Revised Seasonal Adjustments," The Warwick Economics Research Paper Series (TWERPS) 198, University of Warwick, Department of Economics.
    5. Peter C.B. Phillips & Joon Y. Park, 1986. "Asymptotic Equivalence of OLS and GLS in Regressions with Integrated Regressors," Cowles Foundation Discussion Papers 802, Cowles Foundation for Research in Economics, Yale University.
    6. Phillips, Peter C.B., 1992. "Geometry of the Equivalence of OLS and GLS in the Linear Model," Econometric Theory, Cambridge University Press, vol. 8(01), pages 158-159, March.
    7. Frederick R. Macaulay, 1931. "Appendices to "The Smoothing of Time Series"," NBER Chapters, in: The Smoothing of Time Series, pages 118-169, National Bureau of Economic Research, Inc.
    8. Kramer, Walter & Hassler, Uwe, 1998. "Limiting efficiency of OLS vs. GLS when regressors are fractionally integrated," Economics Letters, Elsevier, vol. 60(3), pages 285-290, September.
    9. McAleer, Michael, 1992. "Efficient Estimation: The Rao-Zyskind Condition, Kruskal's Theorem and Ordinary Least Squares," The Economic Record, The Economic Society of Australia, vol. 68(200), pages 65-72, March.
    10. Frederick R. Macaulay, 1931. "Introduction to "The Smoothing of Time Series"," NBER Chapters, in: The Smoothing of Time Series, pages 17-30, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Viv B. Hall & Peter Thomson, 2021. "Does Hamilton’s OLS Regression Provide a “better alternative” to the Hodrick-Prescott Filter? A New Zealand Business Cycle Perspective," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 17(2), pages 151-183, November.
    2. Shouvik Chakraborty, 2012. "Is Export Expansion of Manufactured Goods an Escape Route from Terms of Trade Deterioration of Developing Countries?," Journal of South Asian Development, , vol. 7(2), pages 81-108, October.
    3. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    4. Ingel, Anti & Shahroudi, Novin & Kängsepp, Markus & Tättar, Andre & Komisarenko, Viacheslav & Kull, Meelis, 2020. "Correlated daily time series and forecasting in the M4 competition," International Journal of Forecasting, Elsevier, vol. 36(1), pages 121-128.
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Alexander Dokumentov & Rob J. Hyndman, 2022. "STR: Seasonal-Trend Decomposition Using Regression," INFORMS Joural on Data Science, INFORMS, vol. 1(1), pages 50-62, April.
    7. Hall, Viv & Thomson, Peter & McKelvie, Stuart, 2015. "On trend robustness and end-point issues for New Zealand’s stylised business cycle facts," Working Paper Series 18867, Victoria University of Wellington, School of Economics and Finance.
    8. Dagum Estela Bee & Luati Alessandra, 2004. "Relationship between Local and Global Nonparametric Estimators Measures of Fitting and Smoothing," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 8(2), pages 1-18, May.
    9. Wang, Shuai & Yu, Lean & Tang, Ling & Wang, Shouyang, 2011. "A novel seasonal decomposition based least squares support vector regression ensemble learning approach for hydropower consumption forecasting in China," Energy, Elsevier, vol. 36(11), pages 6542-6554.
    10. Hall, Viv & Thomson, Peter & McKelvie, Stuart, 2015. "On trend robustness and end-point issues for New Zealand’s stylised business cycle facts," Working Paper Series 3761, Victoria University of Wellington, School of Economics and Finance.
    11. Viv B. Hall & Peter Thomson & Stuart McKelvie, 2017. "On the robustness of stylised business cycle facts for contemporary New Zealand," New Zealand Economic Papers, Taylor & Francis Journals, vol. 51(3), pages 193-216, September.
    12. Terence Mills, 2007. "A Note on Trend Decomposition: The 'Classical' Approach Revisited with an Application to Surface Temperature Trends," Journal of Applied Statistics, Taylor & Francis Journals, vol. 34(8), pages 963-972.
    13. Viv B Hall & Peter Thomson, 2020. "Does Hamilton’s OLS regression provide a “better alternative†to the Hodrick-Prescott filter? A New Zealand business cycle perspective," CAMA Working Papers 2020-71, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    14. Zarnowitz, Victor & Ozyildirim, Ataman, 2006. "Time series decomposition and measurement of business cycles, trends and growth cycles," Journal of Monetary Economics, Elsevier, vol. 53(7), pages 1717-1739, October.
    15. Hackl, Peter & Westlund, Anders H., 1996. "Demand for international telecommunication time-varying price elasticity," Journal of Econometrics, Elsevier, vol. 70(1), pages 243-260, January.
    16. Hackl, Peter & Westlund, Anders H., 1995. "On price elasticities of international telecommunication demand," Information Economics and Policy, Elsevier, vol. 7(1), pages 27-36, April.
    17. Ryan Greenaway-McGrevy, 2013. "A Multivariate Approach to Seasonal Adjustment," BEA Working Papers 0100, Bureau of Economic Analysis.
    18. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    19. Yuqin Sun & Rong Ke & Yongge Tian, 2014. "Some overall properties of seemingly unrelated regression models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 103-120, April.
    20. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2009. "Expert opinion versus expertise in forecasting," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 63(3), pages 334-346, August.

    More about this item

    Keywords

    Local polynomial regression; Epanechnikov Kernel; Non-invertible Moving average processes;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:8910. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.