IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v14y1990i2p166-181.html
   My bibliography  Save this article

Sifting Statistical Significance From the Artifact of Regression- Discontinuity Design

Author

Listed:
  • T.D. Stanley

    (Hendrix College)

  • Ann Robinson

    (University of Arkansas at Little Rock)

Abstract

When the covariate of an evaluation study using regression analysis is falhbly measured, the statistical test of program effectiveness is biased. In programs where the target population is "below average, " the bias tends to suppress the beneficial effects of the program, while raising them in programs designed for those "above average. " The magnitude of this bias is calculated, and a correction method is derived and illustrated. In many cases, these biases will make practical differences in program assessment, lending further support to the general distrust of nonexperimental methods. Nonetheless, our approach improves the reliability of nonexperimen tal methods by correcting one potential source of their bias.

Suggested Citation

  • T.D. Stanley & Ann Robinson, 1990. "Sifting Statistical Significance From the Artifact of Regression- Discontinuity Design," Evaluation Review, , vol. 14(2), pages 166-181, April.
    • Handle: RePEc:sae:evarev:v:14:y:1990:i:2:p:166-181
    DOI: 10.1177/0193841X9001400204
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X9001400204
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X9001400204?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Milton Friedman, 1957. "Introduction to "A Theory of the Consumption Function"," NBER Chapters, in: A Theory of the Consumption Function, pages 1-6, National Bureau of Economic Research, Inc.
    2. Milton Friedman, 1957. "A Theory of the Consumption Function," NBER Books, National Bureau of Economic Research, Inc, number frie57-1, March.
    3. Stanley, T. D., 1986. "Stein-rule least squares estimation : A heuristic for fallible data," Economics Letters, Elsevier, vol. 20(2), pages 147-150.
    4. Stock, James H, 1988. "A Reexamination of Friedman's Consumption Puzzle: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(4), pages 413-414, October.
    5. Klepper, Steven & Leamer, Edward E, 1984. "Consistent Sets of Estimates for Regressions with Errors in All Variables," Econometrica, Econometric Society, vol. 52(1), pages 163-183, January.
    6. James J. Heckman & V. Joseph Hotz & Marcelo Dabos, 1987. "Do We Need Experimental Data To Evaluate the Impact of Manpower Training On Earnings?," Evaluation Review, , vol. 11(4), pages 395-427, August.
    7. Lichtenberg, Frank R & Griliches, Zvi, 1989. "Errors of Measurement in Output Deflators," Journal of Business & Economic Statistics, American Statistical Association, vol. 7(1), pages 1-9, January.
    8. Stock, James H, 1988. "A Reexamination of Friedman's Consumption Puzzle," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(4), pages 401-407, October.
    9. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    10. Ashley, Richard & Vaughan, David, 1986. "Measuring Measurement Error in Economic Time Series," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 95-103, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Parise, Gerald F., 1994. "Permanent income hypothesis and the cost of adjustment," ISU General Staff Papers 1994010108000012303, Iowa State University, Department of Economics.
    2. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta‐Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 299-308, July.
    3. Jose Luengo-Prado, Maria, 2006. "Durables, nondurables, down payments and consumption excesses," Journal of Monetary Economics, Elsevier, vol. 53(7), pages 1509-1539, October.
    4. Jim Malley & Hassan Molana, 2003. "The Life-Cycle-Permanent- Income Hypothesis: A Reinterpretation and Supporting Evidence," Dundee Discussion Papers in Economics 138, Economic Studies, University of Dundee.
    5. Xiaohong Chen & Han Hong & Denis Nekipelov, 2011. "Nonlinear Models of Measurement Errors," Journal of Economic Literature, American Economic Association, vol. 49(4), pages 901-937, December.
    6. Casey B. Mulligan, 2018. "Quantifier Elimination for Deduction in Econometrics," NBER Working Papers 24601, National Bureau of Economic Research, Inc.
    7. Chul‐Woo Kwon & Peter F. Orazem & Daniel M. Otto, 2006. "Off‐farm labor supply responses to permanent and transitory farm income," Agricultural Economics, International Association of Agricultural Economists, vol. 34(1), pages 59-67, January.
    8. Bunting, David, 2009. "The saving decline: Macro-facts, micro-behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 70(1-2), pages 282-295, May.
    9. Jonathan Gruber & Aaron Yelowitz, 1999. "Public Health Insurance and Private Savings," Journal of Political Economy, University of Chicago Press, vol. 107(6), pages 1249-1274, December.
    10. Lang, Harald, 1987. "Herman Wold on Optimal Properties of Exponentially Weighted Forecasts," Working Paper Series 179, Research Institute of Industrial Economics.
    11. Brautzsch, Hans-Ulrich & Günther, Jutta & Loose, Brigitte & Ludwig, Udo & Nulsch, Nicole, 2015. "Can R&D subsidies counteract the economic crisis? – Macroeconomic effects in Germany," Research Policy, Elsevier, vol. 44(3), pages 623-633.
    12. Sadullah Çelik & Yasemin Özerkek, 2008. "Panel cointegration analysis of consumer confidence and personal consumption in the European Union," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 10(2), pages 161-168, February.
    13. repec:spo:wpecon:info:hdl:2441/f0uohitsgqh8dhk9814kl7606 is not listed on IDEAS
    14. Ricardo Barradas & Ines Tomas, 2023. "Household indebtedness in the European Union countries: Going beyond the mainstream interpretation," PSL Quarterly Review, Economia civile, vol. 76(304), pages 21-49.
    15. Alok Bhargava, 2006. "Modelling the Health of Filipino Children," World Scientific Book Chapters, in: Econometrics, Statistics And Computational Approaches In Food And Health Sciences, chapter 11, pages 153-168, World Scientific Publishing Co. Pte. Ltd..
    16. Iheonu O Chimere & Tochukwu Nwachukwu, 2020. "Macroeconomic determinants of household consumption in selected West African countries," Economics Bulletin, AccessEcon, vol. 40(2), pages 1596-1606.
    17. Klos, Alexander & Rottke, Simon, 2013. "Saving and Consumption When Children Move Out," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79786, Verein für Socialpolitik / German Economic Association.
    18. Christian Johnson & George G Kaufman, 2007. "Un banco, con cualquier otro nombre…," Boletín, CEMLA, vol. 0(4), pages 185-199, Octubre-d.
    19. Yi Wen, 2011. "Making sense of China’s astronomical foreign reserves," Working Papers 2011-018, Federal Reserve Bank of St. Louis.
    20. Nelson, Edward, 2017. "Reaffirming the Influence of Milton Friedman on U.K. Economic Policy," Working Papers 2017-01, University of Sydney, School of Economics, revised Feb 2017.
    21. Ciarlone, Alessio, 2011. "Housing wealth effect in emerging economies," Emerging Markets Review, Elsevier, vol. 12(4), pages 399-417.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:14:y:1990:i:2:p:166-181. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.