IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/11516.html
   My bibliography  Save this paper

Reading Between the Lines: Prediction of Political Violence Using Newspaper Text

Author

Listed:
  • Mueller, Hannes
  • Rauh, Christopher

Abstract

This article provides a new methodology to predict armed conflict by using newspaper text. Through machine learning, vast quantities of newspaper text are reduced to interpretable topics. We propose the use of the within-country variation of these topics to predict the timing of conflict. This allows us to avoid the tendency of predicting conflict only in countries where it occurred before. We show that the within-country variation of topics is an extremely robust predictor of conflict and becomes particularly useful when new conflict risks arise. Two aspects seem to be responsible for these features. Topics provide depth because they consist of changing, long lists of terms which makes them able to capture the changing context of conflict. At the same time topics provide width because they summarize all text, including coverage of stabilizing factors.

Suggested Citation

  • Mueller, Hannes & Rauh, Christopher, 2016. "Reading Between the Lines: Prediction of Political Violence Using Newspaper Text," CEPR Discussion Papers 11516, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:11516
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP11516
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hannes Mueller, 2016. "Growth and Violence: Argument for a Per Capita Measure of Civil War," Economica, London School of Economics and Political Science, vol. 83(331), pages 473-497, July.
    2. Timothy Besley & Torsten Persson, 2011. "Pillars of Prosperity: The Political Economics of Development Clusters," Economics Books, Princeton University Press, edition 1, number 9624.
    3. Francesco Caselli & Wilbur John Coleman II, 2013. "On The Theory Of Ethnic Conflict," Journal of the European Economic Association, European Economic Association, vol. 11, pages 161-192, January.
    4. Fearon, James D. & Laitin, David D., 2003. "Ethnicity, Insurgency, and Civil War," American Political Science Review, Cambridge University Press, vol. 97(1), pages 75-90, February.
    5. Stephen Hansen & Michael McMahon & Andrea Prat, 2018. "Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 801-870.
    6. Blattman, Christopher & Hartman, Alexandra C. & Blair, Robert A., 2014. "How to Promote Order and Property Rights under Weak Rule of Law? An Experiment in Changing Dispute Resolution Behavior through Community Education," American Political Science Review, Cambridge University Press, vol. 108(1), pages 100-120, February.
    7. Jack A. Goldstone & Robert H. Bates & David L. Epstein & Ted Robert Gurr & Michael B. Lustik & Monty G. Marshall & Jay Ulfelder & Mark Woodward, 2010. "A Global Model for Forecasting Political Instability," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 190-208, January.
    8. Kalyvas, Stathis N. & Balcells, Laia, 2010. "International System and Technologies of Rebellion: How the End of the Cold War Shaped Internal Conflict," American Political Science Review, Cambridge University Press, vol. 104(3), pages 415-429, August.
    9. Thomas Chadefaux, 2014. "Early warning signals for war in the news," Journal of Peace Research, Peace Research Institute Oslo, vol. 51(1), pages 5-18, January.
    10. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2011. "Inference for high-dimensional sparse econometric models," CeMMAP working papers CWP41/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Therése Pettersson & Peter Wallensteen, 2015. "Armed conflicts, 1946–2014," Journal of Peace Research, Peace Research Institute Oslo, vol. 52(4), pages 536-550, July.
    12. Valerie A. Ramey, 2011. "Can Government Purchases Stimulate the Economy?," Journal of Economic Literature, American Economic Association, vol. 49(3), pages 673-685, September.
    13. Cass, David & Shell, Karl, 1983. "Do Sunspots Matter?," Journal of Political Economy, University of Chicago Press, vol. 91(2), pages 193-227, April.
    14. Frank DW Witmer & Andrew M Linke & John O’Loughlin & Andrew Gettelman & Arlene Laing, 2017. "Subnational violent conflict forecasts for sub-Saharan Africa, 2015–65, using climate-sensitive models," Journal of Peace Research, Peace Research Institute Oslo, vol. 54(2), pages 175-192, March.
    15. Daina Chiba & Kristian Skrede Gleditsch, 2017. "The shape of things to come? Expanding the inequality and grievance model for civil war forecasts with event data," Journal of Peace Research, Peace Research Institute Oslo, vol. 54(2), pages 275-297, March.
    16. Thomas Chadefaux, 2017. "Market anticipations of conflict onsets," Journal of Peace Research, Peace Research Institute Oslo, vol. 54(2), pages 313-327, March.
    17. Nils Petter Gleditsch & Peter Wallensteen & Mikael Eriksson & Margareta Sollenberg & Hã…Vard Strand, 2002. "Armed Conflict 1946-2001: A New Dataset," Journal of Peace Research, Peace Research Institute Oslo, vol. 39(5), pages 615-637, September.
    18. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2012. "Temperature Shocks and Economic Growth: Evidence from the Last Half Century," American Economic Journal: Macroeconomics, American Economic Association, vol. 4(3), pages 66-95, July.
    19. Matthew Gentzkow & Jesse M. Shapiro, 2010. "What Drives Media Slant? Evidence From U.S. Daily Newspapers," Econometrica, Econometric Society, vol. 78(1), pages 35-71, January.
    20. Patrick T. Brandt & John R. Freeman & Philip A. Schrodt, 2011. "Real Time, Time Series Forecasting of Inter- and Intra-State Political Conflict," Conflict Management and Peace Science, Peace Science Society (International), vol. 28(1), pages 41-64, February.
    21. H. Buhaug & J. Nordkvelle & T. Bernauer & T. Böhmelt & M. Brzoska & J. Busby & A. Ciccone & H. Fjelde & E. Gartzke & N. Gleditsch & J. Goldstone & H. Hegre & H. Holtermann & V. Koubi & J. Link & P. Li, 2014. "One effect to rule them all? A comment on climate and conflict," Climatic Change, Springer, vol. 127(3), pages 391-397, December.
    22. Edward Miguel & Shanker Satyanath & Ernest Sergenti, 2004. "Economic Shocks and Civil Conflict: An Instrumental Variables Approach," Journal of Political Economy, University of Chicago Press, vol. 112(4), pages 725-753, August.
    23. Ilyana Kuziemko & Eric Werker, 2006. "How Much Is a Seat on the Security Council Worth? Foreign Aid and Bribery at the United Nations," Journal of Political Economy, University of Chicago Press, vol. 114(5), pages 905-930, October.
    24. Li, Quan & Reuveny, Rafael, 2003. "Economic Globalization and Democracy: An Empirical Analysis," British Journal of Political Science, Cambridge University Press, vol. 33(1), pages 29-54, January.
    25. Nils B. Weidmann, 2016. "A Closer Look at Reporting Bias in Conflict Event Data," American Journal of Political Science, John Wiley & Sons, vol. 60(1), pages 206-218, January.
    26. Kevin M. Quinn & Burt L. Monroe & Michael Colaresi & Michael H. Crespin & Dragomir R. Radev, 2010. "How to Analyze Political Attention with Minimal Assumptions and Costs," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 209-228, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonathan Goyette & Maroua Smaoui, 2019. "Civil armed conflicts: the impact of the interaction between climate change and agricultural potential," RIEEM Discussion Paper Series 1903, Research Institute for Environmental Economics and Management, Waseda University.
    2. Jonathan Goyette & Maroua Smaoui, 2019. "Civil armed conflicts: the impact of the interaction between climate change and agricultural potential," Cahiers de recherche 19-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    3. Samuel Brazys & Krishna Chaitanya Vadlamannati & Indra de Soysa, 2019. "Oil Price Volatility and Political Unrest: Prudence and Protest in Producer and Consumer Societies, 1980-2013," Working Papers 201908 Key words: Oil wea, Geary Institute, University College Dublin.
    4. Toke S. Aidt & Facundo Albornoz & Esther Hauk, 2021. "Foreign Influence and Domestic Policy," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 426-487, June.
    5. Cemal Eren Arbatlı & Quamrul H. Ashraf & Oded Galor & Marc Klemp, 2020. "Diversity and Conflict," Econometrica, Econometric Society, vol. 88(2), pages 727-797, March.
    6. Ang, James B. & Gupta, Satyendra Kumar, 2018. "Agricultural yield and conflict," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 397-417.
    7. David Castells-Quintana & Maria del Pilar Lopez-Uribe & Tom McDermott, 2015. "Climate change and the geographical and institutional drivers of economic development," GRI Working Papers 198, Grantham Research Institute on Climate Change and the Environment.
    8. Toke S. Aidt & Facundo Albornoz & Esther Hauk, 2019. "Foreign in influence and domestic policy: A survey," Cambridge Working Papers in Economics 1928, Faculty of Economics, University of Cambridge.
    9. Lopez-Uribe, Maria del Pilar & Castells-Quintana, David & McDermott, Thomas K. J., 2017. "Geography, institutions and development: a review ofthe long-run impacts of climate change," LSE Research Online Documents on Economics 65147, London School of Economics and Political Science, LSE Library.
    10. Christopher Blattman & Edward Miguel, 2010. "Civil War," Journal of Economic Literature, American Economic Association, vol. 48(1), pages 3-57, March.
    11. Aguirre, Alvaro, 2016. "The risk of civil conflicts as a determinant of political institutions," European Journal of Political Economy, Elsevier, vol. 42(C), pages 36-59.
    12. Giménez-Gómez, José-Manuel & Zergawu, Yitagesu-Zewdu, 2018. "The impact of social heterogeneity and commodity price shocks on civil conflicts," Journal of Policy Modeling, Elsevier, vol. 40(5), pages 959-997.
    13. Martin-Shields, Charles P. & Stojetz, Wolfgang, 2019. "Food security and conflict: Empirical challenges and future opportunities for research and policy making on food security and conflict," World Development, Elsevier, vol. 119(C), pages 150-164.
    14. Giménez Gómez, José M. (José Manuel), 2016. "Linking social heterogeneity and commodity price shocks to civil conflicts," Working Papers 2072/290744, Universitat Rovira i Virgili, Department of Economics.
    15. Matthew Gentzkow & Bryan T. Kelly & Matt Taddy, 2017. "Text as Data," NBER Working Papers 23276, National Bureau of Economic Research, Inc.
    16. Martínez, Luis R., 2017. "Transnational insurgents: Evidence from Colombia's FARC at the border with Chávez's Venezuela," Journal of Development Economics, Elsevier, vol. 126(C), pages 138-153.
    17. Vadlamannati, Krishna Chaitanya & de Soysa, Indra, 2020. "Oil price volatility and political unrest: Prudence and protest in producer and consumer societies, 1980–2013," Energy Policy, Elsevier, vol. 145(C).
    18. Mahdi FAWAZ, 2020. "Ressources naturelles et guerres civiles au Moyen-Orient," Bordeaux Economics Working Papers 2020-09, Bordeaux School of Economics (BSE).
    19. Shiran Victoria Shen, 2021. "Integrating Political Science into Climate Modeling: An Example of Internalizing the Costs of Climate-Induced Violence in the Optimal Management of the Climate," Sustainability, MDPI, vol. 13(19), pages 1-24, September.
    20. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2014. "What Do We Learn from the Weather? The New Climate-Economy Literature," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 740-798, September.

    More about this item

    Keywords

    Conflict; Civil war; Forecasting; Machine learning; Panel data; Topic models; Latent dirichlet allocation;
    All these keywords.

    JEL classification:

    • O11 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Macroeconomic Analyses of Economic Development
    • H12 - Public Economics - - Structure and Scope of Government - - - Crisis Management
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • H56 - Public Economics - - National Government Expenditures and Related Policies - - - National Security and War

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:11516. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.