IDEAS home Printed from https://ideas.repec.org/p/umc/wpaper/0706.html
   My bibliography  Save this paper

When Good Instruments Go Bad

Author

Abstract

This note examines the instrumental variables method used by Neumark, Zhang, and Ciccarella (2005) to analyze Wal-Mart's effect on retail labor markets, and exposes major flaws in that methodology. Neumark, Zhang, and Ciccarella use an interaction between distance from Wal-Mart's headquarters and time effects to predict Wal-Mart's presence in a county, and find that each Wal-Mart store destroys, on average, approximately 200 retail jobs. These findings are in stark contrast to Basker (2005) who found a small, but positive and statistically significant, effect on jobs. I show that the IV estimates obtained by Neumark, Zhang, and Ciccarella confound Wal-Mart's causal effect with other factors. To illustrate the problem, I show that their methodology implies a large impact of Wal-Mart not only on retail employment but also on county manufacturing employment. Reduced-form estimates of the regressions show statistically and economically indistinguishable effects in counties with and without Wal-Mart presence, implying that other factors are most likely driving the results.

Suggested Citation

  • Emek Basker, 2007. "When Good Instruments Go Bad," Working Papers 0706, Department of Economics, University of Missouri.
    • Handle: RePEc:umc:wpaper:0706
    as

    Download full text from publisher

    File URL: https://drive.google.com/file/d/1EhjNML3MhtNZnGSTeuaGe3SskExbYjKo/view?usp=sharing
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas J. Holmes & John J. Stevens, 2004. "Geographic concentration and establishment size: analysis in an alternative economic geography model," Journal of Economic Geography, Oxford University Press, vol. 4(3), pages 227-250, June.
    2. Neumark, David & Zhang, Junfu & Ciccarella, Stephen, 2008. "The effects of Wal-Mart on local labor markets," Journal of Urban Economics, Elsevier, vol. 63(2), pages 405-430, March.
    3. Thomas J. Holmes, 2006. "The Diffusion of Wal-Mart and Economies of Density," 2006 Meeting Papers 15, Society for Economic Dynamics.
    4. Emek Basker, 2005. "Job Creation or Destruction? Labor Market Effects of Wal-Mart Expansion," The Review of Economics and Statistics, MIT Press, vol. 87(1), pages 174-183, February.
    5. Thomas J. Kane & Cecilia Rouse, 1993. "Labor Market Returns to Two- And Four-Year College: Is A Credit a Credit And Do Degrees Matter?," Working Papers 690, Princeton University, Department of Economics, Industrial Relations Section..
    6. repec:fth:prinin:311 is not listed on IDEAS
    7. Thomas J. Kane & Cecilia E. Rouse, 1993. "Labor Market Returns to Two- and Four-Year Colleges: Is a Credit a Credit and Do Degrees Matter?," NBER Working Papers 4268, National Bureau of Economic Research, Inc.
    8. Maluccio, John A., 1998. "Endogeneity of schooling in the wage function," FCND discussion papers 54, International Food Policy Research Institute (IFPRI).
    9. Jinyong Hahn & Jerry Hausman, 2002. "A New Specification Test for the Validity of Instrumental Variables," Econometrica, Econometric Society, vol. 70(1), pages 163-189, January.
    10. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    11. Thomas J. Kane & Cecilia E. Rouse, 1993. "Labor Market Returns to Two- And Four-Year College: Is a Credit a Credit And Do Degrees Matter?," Working Papers 690, Princeton University, Department of Economics, Industrial Relations Section..
    12. Jeffrey D. Sachs, 2003. "Institutions Don't Rule: Direct Effects of Geography on Per Capita Income," NBER Working Papers 9490, National Bureau of Economic Research, Inc.
    13. Daron Acemoglu & Joshua Angrist, 1999. "How Large are the Social Returns to Education? Evidence from Compulsory Schooling Laws," NBER Working Papers 7444, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernando Borraz & Juan Dubra & Daniel Ferrés & Leandro Zipitría, 2014. "Supermarket Entry and the Survival of Small Stores," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 44(1), pages 73-93, February.
    2. Charles Courtemanche & Art Carden, 2014. "Competing with Costco and Sam's Club: Warehouse Club Entry and Grocery Prices," Southern Economic Journal, John Wiley & Sons, vol. 80(3), pages 565-585, January.
    3. Basker, Emek, 2011. "The Causes and Consequences of Wal-Mart’s Growth," Ekonomicheskaya Politika / Economic Policy, Russian Presidential Academy of National Economy and Public Administration, vol. 5, pages 110-134.
    4. Emek Basker & Lucia Foster & Shawn Klimek, 2017. "Customer‐employee substitution: Evidence from gasoline stations," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 26(4), pages 876-896, December.
    5. Bonanno, Alessandro & Lopez, Rigoberto A., 2009. "Is Wal-Mart a Monopsony? Evidence from Local Labor Markets," 2009 Conference, August 16-22, 2009, Beijing, China 51289, International Association of Agricultural Economists.
    6. John Haltiwanger & Ron Jarmin & C. J. Krizan, 2010. "Mom-and-Pop Meet Big-Box: Complements or Substitutes?," NBER Chapters, in: Cities and Entrepreneurship, National Bureau of Economic Research, Inc.
    7. Courtemanche, Charles & Carden, Art, 2011. "Supersizing supercenters? The impact of Walmart Supercenters on body mass index and obesity," Journal of Urban Economics, Elsevier, vol. 69(2), pages 165-181, March.
    8. Fabiano Schivardi & Eliana Viviano, 2011. "Entry Barriers in Retail Trade," Economic Journal, Royal Economic Society, vol. 121(551), pages 145-170, March.
    9. Emek Basker & Javier Miranda, 2014. "Taken By Storm: Business Survival In The Aftermath Of Hurricane Katrina," Working Papers 14-20, Center for Economic Studies, U.S. Census Bureau.
    10. Rudholm, Niklas & Li, Yuijao & Kenneth, Carling, 2018. "How Does Big-Box Entry Affect Labor Productivity in Durable Goods Retailing? A Synthetic Control Approach," HUI Working Papers 130, HUI Research.
    11. Srikanth Paruchuri & Joel A. C. Baum & David Potere, 2009. "The Wal‐Mart Effect: Wave of Destruction or Creative Destruction?," Economic Geography, Clark University, vol. 85(2), pages 209-236, April.
    12. Emek Basker & Michael Noel, 2009. "The Evolving Food Chain: Competitive Effects of Wal‐Mart's Entry into the Supermarket Industry," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 18(4), pages 977-1009, December.
    13. Sven-Olov Daunfeldt & Oana Mihaescu & Niklas Rudholm, 2022. "The Decline of Small Cities: Increased Competition from External Shopping Malls or Long-Term Negative Trends?," International Regional Science Review, , vol. 45(2), pages 225-257, March.
    14. Michael Hicks, 2015. "Does Wal-Mart Cause an Increase in Anti-Poverty Expenditures?," Social Science Quarterly, Southwestern Social Science Association, vol. 96(4), pages 1136-1152, December.
    15. Emek Basker, 2011. "Does Wal‐Mart Sell Inferior Goods?," Economic Inquiry, Western Economic Association International, vol. 49(4), pages 973-981, October.
    16. Finn McGuire & Noemi Kreif & Peter C. Smith, 2021. "The effect of distance on maternal institutional delivery choice: Evidence from Malawi," Health Economics, John Wiley & Sons, Ltd., vol. 30(9), pages 2144-2167, September.
    17. Emek Basker & Javier Miranda, 2014. "Taken by Storm: Business Financing, Survival, and Contagion in the Aftermath of Hurricane Katrina," Working Papers 1406, Department of Economics, University of Missouri, revised 23 Oct 2014.
    18. Alessandro Bonanno & Stephan J. Goetz, 2012. "WalMart and Local Economic Development," Economic Development Quarterly, , vol. 26(4), pages 285-297, November.
    19. Courtemanche, Charles & Carden, Art, 2009. "The skinny on big box retailing: Wal-Mart, warehouse clubs, and obesity," MPRA Paper 25326, University Library of Munich, Germany.
    20. Bonanno, Alessandro & Lopez, Rigoberto A., 2012. "Wal-Mart's monopsony power in metro and non-metro labor markets," Regional Science and Urban Economics, Elsevier, vol. 42(4), pages 569-579.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lars Lefgren & Frank McIntyre, 2006. "The Relationship between Women's Education and Marriage Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 24(4), pages 787-830, October.
    2. Card, David, 2001. "Estimating the Return to Schooling: Progress on Some Persistent Econometric Problems," Econometrica, Econometric Society, vol. 69(5), pages 1127-1160, September.
    3. Tansel, Aysit & Keskin, Halil Ibrahim, 2017. "Education Effects on Days Hospitalized and Days out of Work by Gender: Evidence from Turkey," IZA Discussion Papers 11210, Institute of Labor Economics (IZA).
    4. Nikolov, Plamen & Jimi, Nusrat & Chang, Jerray, 2020. "The Importance of Cognitive Domains and the Returns to Schooling in South Africa: Evidence from Two Labor Surveys," Labour Economics, Elsevier, vol. 65(C).
    5. Arendt, Jacob Nielsen, 2008. "In sickness and in health--Till education do us part: Education effects on hospitalization," Economics of Education Review, Elsevier, vol. 27(2), pages 161-172, April.
    6. Martin E Andresen & Martin Huber, 2021. "Instrument-based estimation with binarised treatments: issues and tests for the exclusion restriction," The Econometrics Journal, Royal Economic Society, vol. 24(3), pages 536-558.
    7. Hidehiko Ichimura & Christopher R. Taber, 2000. "Direct Estimation of Policy Impacts," NBER Technical Working Papers 0254, National Bureau of Economic Research, Inc.
    8. Raquel Bernal & Adriana Camacho, 2010. "La importancia de los programas para la primera infancia en Colombia," Documentos CEDE 7605, Universidad de los Andes, Facultad de Economía, CEDE.
    9. Arendt, Jacob Nielsen, 2005. "Does education cause better health? A panel data analysis using school reforms for identification," Economics of Education Review, Elsevier, vol. 24(2), pages 149-160, April.
    10. Sloczynski, Tymon, 2021. "When Should We (Not) Interpret Linear IV Estimands as LATE?," IZA Discussion Papers 14349, Institute of Labor Economics (IZA).
    11. Aysit Tansel & Halil Ibrahim Keskin, 2017. "Education Effects on Days Hospitalized and Days out of Work by Gender: Evidence from Turkey," Koç University-TUSIAD Economic Research Forum Working Papers 1721, Koc University-TUSIAD Economic Research Forum.
    12. Charles Courtemanche & Art Carden, 2014. "Competing with Costco and Sam's Club: Warehouse Club Entry and Grocery Prices," Southern Economic Journal, John Wiley & Sons, vol. 80(3), pages 565-585, January.
    13. Philip Oreopoulos & Kjell G. Salvanes, 2009. "How large are returns to schooling? Hint: Money isn't everything," NBER Working Papers 15339, National Bureau of Economic Research, Inc.
    14. Orley Ashenfelter & Cecilia Rouse, 1998. "Income, Schooling, and Ability: Evidence from a New Sample of Identical Twins," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(1), pages 253-284.
    15. Kyui, Natalia, 2016. "Expansion of higher education, employment and wages: Evidence from the Russian Transition," Labour Economics, Elsevier, vol. 39(C), pages 68-87.
    16. Rahman, Mustafizur & Al-Hasan, Md., 2018. "Returns to Schooling in Bangladesh Revisited: An Instrumental Variable Quantile Regression Approach," Bangladesh Development Studies, Bangladesh Institute of Development Studies (BIDS), vol. 41(02), pages 27-42, June.
    17. repec:rre:publsh:v:39:y:2009:i:1:p:73-83 is not listed on IDEAS
    18. John Giles & Albert Park & Meiyan Wang, 2019. "The Great Proletarian Cultural Revolution, Disruptions to Education, and the Returns to Schooling in Urban China," Economic Development and Cultural Change, University of Chicago Press, vol. 68(1), pages 131-164.
    19. Gensowski, Miriam, 2018. "Personality, IQ, and lifetime earnings," Labour Economics, Elsevier, vol. 51(C), pages 170-183.
    20. Estelle, Sarah M., 2011. "The academic impact on children of maternal post-secondary enrollment," Economics of Education Review, Elsevier, vol. 30(2), pages 353-364, April.
    21. Ishikawa, Mamoru & Ryan, Daniel, 2002. "Schooling, basic skills and economic outcomes," Economics of Education Review, Elsevier, vol. 21(3), pages 231-243, June.

    More about this item

    Keywords

    Instrumental Variables; Wal-Mart; Retail Employment;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure
    • L81 - Industrial Organization - - Industry Studies: Services - - - Retail and Wholesale Trade; e-Commerce

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:umc:wpaper:0706. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chao Gu (email available below). General contact details of provider: https://edirc.repec.org/data/edumous.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.