IDEAS home Printed from https://ideas.repec.org/p/cam/camdae/1630.html
   My bibliography  Save this paper

Reading Between the Lines: Prediction of Political Violence Using Newspaper Text

Author

Listed:
  • Hannes Mueller
  • Christopher Rauh

Abstract

This article provides a new methodology to predict conflict by using newspaper text. Through machine learning, vast quantities of newspaper text are reduced to interpretable topic shares. We use changes in topic shares to predict conflict one and two years before it occurs. In our predictions we distinguish between predicting the likelihood of conflict across countries and the timing of conflict within each country. Most factors identified by the literature, though performing well at predicting the location of conflict, add little to the prediction of timing. We show that news topics indeed can predict the timing of conflict onset. We also use the estimated topic shares to document how reporting changes before conflict breaks out.

Suggested Citation

  • Hannes Mueller & Christopher Rauh, 2016. "Reading Between the Lines: Prediction of Political Violence Using Newspaper Text," Cambridge Working Papers in Economics 1630, Faculty of Economics, University of Cambridge.
  • Handle: RePEc:cam:camdae:1630
    Note: cr542
    as

    Download full text from publisher

    File URL: http://www.econ.cam.ac.uk/research-files/repec/cam/pdf/cwpe1630.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hannes Mueller, 2016. "Growth and Violence: Argument for a Per Capita Measure of Civil War," Economica, London School of Economics and Political Science, vol. 83(331), pages 473-497, July.
    2. Francesco Caselli & Wilbur John Coleman II, 2013. "On The Theory Of Ethnic Conflict," Journal of the European Economic Association, European Economic Association, vol. 11, pages 161-192, January.
    3. Stephen Hansen & Michael McMahon & Andrea Prat, 2018. "Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 801-870.
    4. Cass, David & Shell, Karl, 1983. "Do Sunspots Matter?," Journal of Political Economy, University of Chicago Press, vol. 91(2), pages 193-227, April.
    5. Daina Chiba & Kristian Skrede Gleditsch, 2017. "The shape of things to come? Expanding the inequality and grievance model for civil war forecasts with event data," Journal of Peace Research, Peace Research Institute Oslo, vol. 54(2), pages 275-297, March.
    6. Thomas Chadefaux, 2017. "Market anticipations of conflict onsets," Journal of Peace Research, Peace Research Institute Oslo, vol. 54(2), pages 313-327, March.
    7. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2012. "Temperature Shocks and Economic Growth: Evidence from the Last Half Century," American Economic Journal: Macroeconomics, American Economic Association, vol. 4(3), pages 66-95, July.
    8. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2011. "Inference for High-Dimensional Sparse Econometric Models," Papers 1201.0220, arXiv.org.
    9. Matthew Gentzkow & Jesse M. Shapiro, 2010. "What Drives Media Slant? Evidence From U.S. Daily Newspapers," Econometrica, Econometric Society, vol. 78(1), pages 35-71, January.
    10. Patrick T. Brandt & John R. Freeman & Philip A. Schrodt, 2011. "Real Time, Time Series Forecasting of Inter- and Intra-State Political Conflict," Conflict Management and Peace Science, Peace Science Society (International), vol. 28(1), pages 41-64, February.
    11. Ilyana Kuziemko & Eric Werker, 2006. "How Much Is a Seat on the Security Council Worth? Foreign Aid and Bribery at the United Nations," Journal of Political Economy, University of Chicago Press, vol. 114(5), pages 905-930, October.
    12. Kevin M. Quinn & Burt L. Monroe & Michael Colaresi & Michael H. Crespin & Dragomir R. Radev, 2010. "How to Analyze Political Attention with Minimal Assumptions and Costs," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 209-228, January.
    13. Timothy Besley & Torsten Persson, 2011. "Pillars of Prosperity: The Political Economics of Development Clusters," Economics Books, Princeton University Press, edition 1, number 9624.
    14. Fearon, James D. & Laitin, David D., 2003. "Ethnicity, Insurgency, and Civil War," American Political Science Review, Cambridge University Press, vol. 97(1), pages 75-90, February.
    15. Blattman, Christopher & Hartman, Alexandra C. & Blair, Robert A., 2014. "How to Promote Order and Property Rights under Weak Rule of Law? An Experiment in Changing Dispute Resolution Behavior through Community Education," American Political Science Review, Cambridge University Press, vol. 108(1), pages 100-120, February.
    16. Jack A. Goldstone & Robert H. Bates & David L. Epstein & Ted Robert Gurr & Michael B. Lustik & Monty G. Marshall & Jay Ulfelder & Mark Woodward, 2010. "A Global Model for Forecasting Political Instability," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 190-208, January.
    17. Kalyvas, Stathis N. & Balcells, Laia, 2010. "International System and Technologies of Rebellion: How the End of the Cold War Shaped Internal Conflict," American Political Science Review, Cambridge University Press, vol. 104(3), pages 415-429, August.
    18. Thomas Chadefaux, 2014. "Early warning signals for war in the news," Journal of Peace Research, Peace Research Institute Oslo, vol. 51(1), pages 5-18, January.
    19. Therése Pettersson & Peter Wallensteen, 2015. "Armed conflicts, 1946–2014," Journal of Peace Research, Peace Research Institute Oslo, vol. 52(4), pages 536-550, July.
    20. Valerie A. Ramey, 2011. "Can Government Purchases Stimulate the Economy?," Journal of Economic Literature, American Economic Association, vol. 49(3), pages 673-685, September.
    21. Frank DW Witmer & Andrew M Linke & John O’Loughlin & Andrew Gettelman & Arlene Laing, 2017. "Subnational violent conflict forecasts for sub-Saharan Africa, 2015–65, using climate-sensitive models," Journal of Peace Research, Peace Research Institute Oslo, vol. 54(2), pages 175-192, March.
    22. Nils Petter Gleditsch & Peter Wallensteen & Mikael Eriksson & Margareta Sollenberg & Hã…Vard Strand, 2002. "Armed Conflict 1946-2001: A New Dataset," Journal of Peace Research, Peace Research Institute Oslo, vol. 39(5), pages 615-637, September.
    23. H. Buhaug & J. Nordkvelle & T. Bernauer & T. Böhmelt & M. Brzoska & J. Busby & A. Ciccone & H. Fjelde & E. Gartzke & N. Gleditsch & J. Goldstone & H. Hegre & H. Holtermann & V. Koubi & J. Link & P. Li, 2014. "One effect to rule them all? A comment on climate and conflict," Climatic Change, Springer, vol. 127(3), pages 391-397, December.
    24. Edward Miguel & Shanker Satyanath & Ernest Sergenti, 2004. "Economic Shocks and Civil Conflict: An Instrumental Variables Approach," Journal of Political Economy, University of Chicago Press, vol. 112(4), pages 725-753, August.
    25. Li, Quan & Reuveny, Rafael, 2003. "Economic Globalization and Democracy: An Empirical Analysis," British Journal of Political Science, Cambridge University Press, vol. 33(1), pages 29-54, January.
    26. Nils B. Weidmann, 2016. "A Closer Look at Reporting Bias in Conflict Event Data," American Journal of Political Science, John Wiley & Sons, vol. 60(1), pages 206-218, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Toke S. Aidt & Facundo Albornoz & Esther Hauk, 2021. "Foreign Influence and Domestic Policy," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 426-487, June.
    2. Jonathan Goyette & Maroua Smaoui, 2019. "Civil armed conflicts: the impact of the interaction between climate change and agricultural potential," RIEEM Discussion Paper Series 1903, Research Institute for Environmental Economics and Management, Waseda University.
    3. Jonathan Goyette & Maroua Smaoui, 2019. "Civil armed conflicts: the impact of the interaction between climate change and agricultural potential," Cahiers de recherche 19-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    4. Samuel Brazys & Krishna Chaitanya Vadlamannati & Indra de Soysa, 2019. "Oil Price Volatility and Political Unrest: Prudence and Protest in Producer and Consumer Societies, 1980-2013," Working Papers 201908 Key words: Oil wea, Geary Institute, University College Dublin.
    5. Ang, James B. & Gupta, Satyendra Kumar, 2018. "Agricultural yield and conflict," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 397-417.
    6. David Castells-Quintana & Maria del Pilar Lopez-Uribe & Tom McDermott, 2015. "Climate change and the geographical and institutional drivers of economic development," GRI Working Papers 198, Grantham Research Institute on Climate Change and the Environment.
    7. Lopez-Uribe, Maria del Pilar & Castells-Quintana, David & McDermott, Thomas K. J., 2017. "Geography, institutions and development: a review ofthe long-run impacts of climate change," LSE Research Online Documents on Economics 65147, London School of Economics and Political Science, LSE Library.
    8. Toke S. Aidt & Facundo Albornoz & Esther Hauk, 2019. "Foreign Influence and Domestic Policy: A Survey," Working Papers 1072, Barcelona School of Economics.
    9. Christopher Blattman & Edward Miguel, 2010. "Civil War," Journal of Economic Literature, American Economic Association, vol. 48(1), pages 3-57, March.
    10. Aguirre, Alvaro, 2016. "The risk of civil conflicts as a determinant of political institutions," European Journal of Political Economy, Elsevier, vol. 42(C), pages 36-59.
    11. Cemal Eren Arbatlı & Quamrul H. Ashraf & Oded Galor & Marc Klemp, 2020. "Diversity and Conflict," Econometrica, Econometric Society, vol. 88(2), pages 727-797, March.
    12. Martin-Shields, Charles P. & Stojetz, Wolfgang, 2019. "Food security and conflict: Empirical challenges and future opportunities for research and policy making on food security and conflict," World Development, Elsevier, vol. 119(C), pages 150-164.
    13. Giménez Gómez, José M. (José Manuel), 2016. "Linking social heterogeneity and commodity price shocks to civil conflicts," Working Papers 2072/290744, Universitat Rovira i Virgili, Department of Economics.
    14. Vadlamannati, Krishna Chaitanya & de Soysa, Indra, 2020. "Oil price volatility and political unrest: Prudence and protest in producer and consumer societies, 1980–2013," Energy Policy, Elsevier, vol. 145(C).
    15. Giménez-Gómez, José-Manuel & Zergawu, Yitagesu-Zewdu, 2018. "The impact of social heterogeneity and commodity price shocks on civil conflicts," Journal of Policy Modeling, Elsevier, vol. 40(5), pages 959-997.
    16. Matthew Gentzkow & Bryan T. Kelly & Matt Taddy, 2017. "Text as Data," NBER Working Papers 23276, National Bureau of Economic Research, Inc.
    17. Martínez, Luis R., 2017. "Transnational insurgents: Evidence from Colombia's FARC at the border with Chávez's Venezuela," Journal of Development Economics, Elsevier, vol. 126(C), pages 138-153.
    18. Mahdi FAWAZ, 2020. "Ressources naturelles et guerres civiles au Moyen-Orient," Bordeaux Economics Working Papers 2020-09, Bordeaux School of Economics (BSE).
    19. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2014. "What Do We Learn from the Weather? The New Climate-Economy Literature," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 740-798, September.
    20. Rabah Arezki & Markus Brückner, 2011. "Food prices and political instability," NCID Working Papers 01/2011, Navarra Center for International Development, University of Navarra.

    More about this item

    Keywords

    Conflict; Forecasting; Machine Learning; Panel Data; Topic Models; Latent Dirichlet Allocation.;
    All these keywords.

    JEL classification:

    • O11 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Macroeconomic Analyses of Economic Development
    • H12 - Public Economics - - Structure and Scope of Government - - - Crisis Management
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • H56 - Public Economics - - National Government Expenditures and Related Policies - - - National Security and War

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cam:camdae:1630. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jake Dyer (email available below). General contact details of provider: https://www.econ.cam.ac.uk/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.