IDEAS home Printed from https://ideas.repec.org/a/bla/jecsur/v24y2010i1p170-191.html
   My bibliography  Save this article

Picture This: A Simple Graph That Reveals Much Ado About Research

Author

Listed:
  • T.D. Stanley
  • Hristos Doucouliagos

Abstract

Funnel graphs provide a simple, yet highly effective, means to identify key features of an empirical literature. This paper illustrates the use of funnel graphs to detect publication selection bias, identify the existence of genuine empirical effects and discover potential moderator variables that can help to explain the wide variation routinely found among reported research findings. Applications include union–productivity effects, water price elasticities, common currency‐trade effects, minimum‐wage employment effects, efficiency wages and the price elasticity of prescription drugs.

Suggested Citation

  • T.D. Stanley & Hristos Doucouliagos, 2010. "Picture This: A Simple Graph That Reveals Much Ado About Research," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 170-191, February.
    • Handle: RePEc:bla:jecsur:v:24:y:2010:i:1:p:170-191
    DOI: 10.1111/j.1467-6419.2009.00593.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-6419.2009.00593.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1467-6419.2009.00593.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Simeon Djankov & Peter Murrell, 2002. "Enterprise Restructuring in Transition: A Quantitative Survey," Journal of Economic Literature, American Economic Association, vol. 40(3), pages 739-792, September.
    2. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta‐Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 299-308, July.
    3. Jasper M. Dalhuisen & Raymond J. G. M. Florax & JHenri L. F. de Groot & Peter Nijkamp, 2003. "Price and Income Elasticities of Residential Water Demand: A Meta-Analysis," Land Economics, University of Wisconsin Press, vol. 79(2), pages 292-308.
    4. Marin C. Gemmill & Joan Costa‐Font & Alistair McGuire, 2007. "In search of a corrected prescription drug Elasticity estimate: a meta‐regression approach," Health Economics, John Wiley & Sons, Ltd., vol. 16(6), pages 627-643, June.
    5. Ian J. Bateman & Andrew P. Jones, 2003. "Contrasting Conventional with Multi-Level Modeling Approaches to Meta-Analysis: Expectation Consistency in U.K. Woodland Recreation Values," Land Economics, University of Wisconsin Press, vol. 79(2), pages 235-258.
    6. Stanley, T. D. & Doucouliagos, Chris, 2007. "Identifying and correcting publication selection bias in the efficiency-wage literature: Heckman Meta-Regression," Working Papers eco_2007_11, Deakin University, Department of Economics.
    7. T. D. Stanley, 2008. "Meta‐Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(1), pages 103-127, February.
    8. Andrew K. Rose & T. D. Stanley, 2005. "A Meta‐Analysis of the Effect of Common Currencies on International Trade," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 347-365, July.
    9. George A. Akerlof, 1982. "Labor Contracts as Partial Gift Exchange," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 97(4), pages 543-569.
    10. Laroche, P., 2000. "What do Unions do to Productivity? A Meta-Analysis," Papers 2000-5, Groupe de recherche en économie financière et en gestion des entreprises, Universite Nancy 2.
    11. Friedman, Milton, 1992. "Do Old Fallacies Ever Die?," Journal of Economic Literature, American Economic Association, vol. 30(4), pages 2129-2132, December.
    12. Andrew K. Rose, 2000. "One money, one market: the effect of common currencies on trade," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 15(30), pages 08-45.
    13. George A. Akerlof, 2003. "Behavioral Macroeconomics and Macroeconomic Behavior," The American Economist, Sage Publications, vol. 47(1), pages 25-47, March.
    14. Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, June.
    15. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer.
    16. T.D. Stanley & Stephen B. Jarrell, 1998. "Gender Wage Discrimination Bias? A Meta-Regression Analysis," Journal of Human Resources, University of Wisconsin Press, vol. 33(4), pages 947-973.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, June.
    2. T.D. Stanley, 2013. "Does economics add up? An introduction to meta-regression analysis," European Journal of Economics and Economic Policies: Intervention, Edward Elgar Publishing, vol. 10(2), pages 207-220.
    3. Tomas Kucera, 2020. "Are Employment Effects of Minimum Wage the Same Across the EU? A Meta-Regression Analysis," Working Papers IES 2020/2, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Jan 2020.
    4. Polák, Petr, 2017. "The productivity paradox: A meta-analysis," Information Economics and Policy, Elsevier, vol. 38(C), pages 38-54.
    5. Stanley, T. D. & Doucouliagos, Hristos, 2011. "Meta-regression approximations to reduce publication selection bias," Working Papers eco_2011_4, Deakin University, Department of Economics.
    6. Hristos Doucouliagos & Janto Haman & T.D. Stanley, 2012. "Pay for Performance and Corporate Governance Reform," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 51(3), pages 670-703, July.
    7. de Linde Leonard, Megan & Stanley, T.D., 2015. "Married with children: What remains when observable biases are removed from the reported male marriage wage premium," Labour Economics, Elsevier, vol. 33(C), pages 72-80.
    8. Tomáš Havránek, 2010. "Rose effect and the euro: is the magic gone?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 146(2), pages 241-261, June.
    9. Stanley, T.D. & Doucouliagos, Chris & Jarrell, Stephen B., 2008. "Meta-regression analysis as the socio-economics of economics research," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(1), pages 276-292, February.
    10. Ian Babetskii & Nauro Campos, 2006. "Does Reform Work? An Econometric Examination of the Reform-Growth Puzzle," William Davidson Institute Working Papers Series wp870, William Davidson Institute at the University of Michigan.
    11. Petr Polák, 2019. "The Euro'S Trade Effect: A Meta‐Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 33(1), pages 101-124, February.
    12. Tomáš Havránek, 2009. "Rose Effect and the Euro: The Magic is Gone," Working Papers IES 2009/20, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Aug 2009.
    13. Markus Hang & Jerome Geyer‐Klingeberg & Andreas Rathgeber & Stefan Stöckl, 2018. "Economic Development Matters: A Meta‐Regression Analysis on the Relation between Environmental Management and Financial Performance," Journal of Industrial Ecology, Yale University, vol. 22(4), pages 720-744, August.
    14. Doucouliagos, Chris & Stanley, T.D. & Giles, Margaret, 2012. "Are estimates of the value of a statistical life exaggerated?," Journal of Health Economics, Elsevier, vol. 31(1), pages 197-206.
    15. Havranek, Tomas & Irsova, Zuzana & Janda, Karel, 2012. "Demand for gasoline is more price-inelastic than commonly thought," Energy Economics, Elsevier, vol. 34(1), pages 201-207.
    16. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    17. Maria Cipollina & Luca Salvatici, 2010. "Reciprocal Trade Agreements in Gravity Models: A Meta‐Analysis," Review of International Economics, Wiley Blackwell, vol. 18(1), pages 63-80, February.
    18. Stephan B. Bruns, 2013. "Identifying Genuine Effects in Observational Research by Means of Meta-Regressions," Jena Economics Research Papers 2013-040, Friedrich-Schiller-University Jena.
    19. Egert, Balazs & Halpern, Laszlo, 2006. "Equilibrium exchange rates in Central and Eastern Europe: A meta-regression analysis," Journal of Banking & Finance, Elsevier, vol. 30(5), pages 1359-1374, May.
    20. Ian Babetskii & Nauro Campos, 2006. "Does Reform Work? An Econometric Examination of the Reform-Growth Puzzle," William Davidson Institute Working Papers Series wp870, William Davidson Institute at the University of Michigan.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jecsur:v:24:y:2010:i:1:p:170-191. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0950-0804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.