IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v282y2020i1p221-234.html
   My bibliography  Save this article

On the learning patterns and adaptive behavior of terrorist organizations

Author

Listed:
  • Jaspersen, Johannes G.
  • Montibeller, Gilberto

Abstract

The threat to national security posed by terrorists makes the design of evidence-based counter-terrorism strategies paramount. As terrorist organizations are purposeful entities, it is crucial to understand their decision processes if we want to plan defenses and counter-measures. In particular, there is evidence that terrorist organizations are both adaptive in their behavior and driven by multiple objectives in their actions. In this paper, we use insights from learning theory and compare several different reinforcement learning models regarding their ability to predict terrorist organizations’ actions. Using data on target choices of terrorist attacks and two different objectives (renown and revenge), we show that a total reinforcement learning with power (Luce) choice probabilities and information discounting can be used to model the adaptive behavior of terrorist organizations. The model renders out-of-sample predictions which are comparable in their validity to those observed for learning in laboratory studies. We draw implications for counter-terrorism strategies by comparing the predictive validity of the different models and their calibrated parameters. Our results also offer a starting point for studying the convergence process in game theoretic analyses of conflicts involving terrorists.

Suggested Citation

  • Jaspersen, Johannes G. & Montibeller, Gilberto, 2020. "On the learning patterns and adaptive behavior of terrorist organizations," European Journal of Operational Research, Elsevier, vol. 282(1), pages 221-234.
  • Handle: RePEc:eee:ejores:v:282:y:2020:i:1:p:221-234
    DOI: 10.1016/j.ejor.2019.09.011
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719307490
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2019.09.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Botond Kőszegi & Matthew Rabin, 2006. "A Model of Reference-Dependent Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(4), pages 1133-1165.
    2. Sumitra Sri Bhashyam & Gilberto Montibeller, 2012. "Modeling State-Dependent Priorities of Malicious Agents," Decision Analysis, INFORMS, vol. 9(2), pages 172-185, June.
    3. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    4. Berman, Eli & Laitin, David D., 2008. "Religion, terrorism and public goods: Testing the club model," Journal of Public Economics, Elsevier, vol. 92(10-11), pages 1942-1967, October.
    5. Borgers, Tilman & Sarin, Rajiv, 2000. "Naive Reinforcement Learning with Endogenous Aspirations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 921-950, November.
    6. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    7. Beggs, A.W., 2005. "On the convergence of reinforcement learning," Journal of Economic Theory, Elsevier, vol. 122(1), pages 1-36, May.
    8. Powell, Robert, 2007. "Allocating Defensive Resources with Private Information about Vulnerability," American Political Science Review, Cambridge University Press, vol. 101(4), pages 799-809, November.
    9. Jerker Denrell, 2008. "Organizational risk taking: adaptation versus variable risk preferences," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 17(3), pages 427-466, June.
    10. Charlinda Santifort & Todd Sandler & Patrick T Brandt, 2013. "Terrorist attack and target diversity," Journal of Peace Research, Peace Research Institute Oslo, vol. 50(1), pages 75-90, January.
    11. Theresa K. Lant, 1992. "Aspiration Level Adaptation: An Empirical Exploration," Management Science, INFORMS, vol. 38(5), pages 623-644, May.
    12. Moshe Kress & Roberto Szechtman, 2009. "Why Defeating Insurgencies Is Hard: The Effect of Intelligence in Counterinsurgency Operations---A Best-Case Scenario," Operations Research, INFORMS, vol. 57(3), pages 578-585, June.
    13. Manel Baucells & Martin Weber & Frank Welfens, 2011. "Reference-Point Formation and Updating," Management Science, INFORMS, vol. 57(3), pages 506-519, March.
    14. Walter Enders & Paan Jindapon, 2010. "Network Externalities and the Structure of Terror Networks," Journal of Conflict Resolution, Peace Science Society (International), vol. 54(2), pages 262-280, April.
    15. Mookherjee, Dilip & Sopher, Barry, 1997. "Learning and Decision Costs in Experimental Constant Sum Games," Games and Economic Behavior, Elsevier, vol. 19(1), pages 97-132, April.
    16. Kjell Hausken, 2018. "A cost–benefit analysis of terrorist attacks," Defence and Peace Economics, Taylor & Francis Journals, vol. 29(2), pages 111-129, February.
    17. Edward L. Glaeser, 2005. "The Political Economy of Hatred," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(1), pages 45-86.
    18. Cheung, Yin-Wong & Friedman, Daniel, 1997. "Individual Learning in Normal Form Games: Some Laboratory Results," Games and Economic Behavior, Elsevier, vol. 19(1), pages 46-76, April.
    19. Ioana Popescu & Yaozhong Wu, 2007. "Dynamic Pricing Strategies with Reference Effects," Operations Research, INFORMS, vol. 55(3), pages 413-429, June.
    20. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    21. Seidl, Andrea & Kaplan, Edward H. & Caulkins, Jonathan P. & Wrzaczek, Stefan & Feichtinger, Gustav, 2016. "Optimal control of a terror queue," European Journal of Operational Research, Elsevier, vol. 248(1), pages 246-256.
    22. David Gill & Victoria Prowse, 2016. "Cognitive Ability, Character Skills, and Learning to Play Equilibrium: A Level-k Analysis," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1619-1676.
    23. Milton Friedman & L. J. Savage, 1948. "The Utility Analysis of Choices Involving Risk," Journal of Political Economy, University of Chicago Press, vol. 56(4), pages 279-279.
    24. Juan Camilo Bohorquez & Sean Gourley & Alexander R. Dixon & Michael Spagat & Neil F. Johnson, 2009. "Common ecology quantifies human insurgency," Nature, Nature, vol. 462(7275), pages 911-914, December.
    25. Henry Stott, 2006. "Cumulative prospect theory's functional menagerie," Journal of Risk and Uncertainty, Springer, vol. 32(2), pages 101-130, March.
    26. Jun Zhuang & Vicki M. Bier, 2007. "Balancing Terrorism and Natural Disasters---Defensive Strategy with Endogenous Attacker Effort," Operations Research, INFORMS, vol. 55(5), pages 976-991, October.
    27. Reinhard Selten, 1998. "Axiomatic Characterization of the Quadratic Scoring Rule," Experimental Economics, Springer;Economic Science Association, vol. 1(1), pages 43-61, June.
    28. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    29. Scott Atran, 2003. "Genesis of Suicide Terrorm (supporting online material)," Post-Print ijn_00000344, HAL.
    30. Shining Wu & Qian Liu & Rachel Q. Zhang, 2015. "The Reference Effects on a Retailer’s Dynamic Pricing and Inventory Strategies with Strategic Consumers," Operations Research, INFORMS, vol. 63(6), pages 1320-1335, December.
    31. John G. Cross, 1973. "A Stochastic Learning Model of Economic Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(2), pages 239-266.
    32. Konstantinos V. Katsikopoulos, 2014. "Bounded rationality: the two cultures," Journal of Economic Methodology, Taylor & Francis Journals, vol. 21(4), pages 361-374, December.
    33. Herriott, Scott R & Levinthal, Daniel & March, James G, 1985. "Learning from Experience in Organizations," American Economic Review, American Economic Association, vol. 75(2), pages 298-302, May.
    34. Peren Arin, K. & Lorz, Oliver & Reich, Otto F.M. & Spagnolo, Nicola, 2011. "Exploring the dynamics between terrorism and anti-terror spending: Theory and UK-evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 77(2), pages 189-202, February.
    35. Franco, L. Alberto & Hämäläinen, Raimo P., 2016. "Behavioural operational research: Returning to the roots of the OR profession," European Journal of Operational Research, Elsevier, vol. 249(3), pages 791-795.
    36. Bryan Caplan, 2006. "Terrorism: The relevance of the rational choice model," Public Choice, Springer, vol. 128(1), pages 91-107, July.
    37. Vicki Bier & Kjell Hausken, 2011. "Endogenizing the sticks and carrots: modeling possible perverse effects of counterterrorism measures," Annals of Operations Research, Springer, vol. 186(1), pages 39-59, June.
    38. Johannes Siebert & Detlof von Winterfeldt & Richard S. John, 2016. "Identifying and Structuring the Objectives of the Islamic State of Iraq and the Levant (ISIL) and Its Followers," Decision Analysis, INFORMS, vol. 13(1), pages 26-50, March.
    39. Johannes G. Jaspersen & Richard Peter, 2017. "Experiential Learning, Competitive Selection, and Downside Risk: A New Perspective on Managerial Risk Taking," Organization Science, INFORMS, vol. 28(5), pages 915-930, October.
    40. Edward H. Kaplan, 2012. "OR Forum---Intelligence Operations Research: The 2010 Philip McCord Morse Lecture," Operations Research, INFORMS, vol. 60(6), pages 1297-1309, December.
    41. Katsikopoulos, Konstantinos V., 2016. "On the role of psychological heuristics in operational research; and a demonstration in military stability operationsAuthor-Name: Keller, Niklas," European Journal of Operational Research, Elsevier, vol. 249(3), pages 1063-1073.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Raj Bridgelall, 2022. "An Application of Natural Language Processing to Classify What Terrorists Say They Want," Social Sciences, MDPI, vol. 11(1), pages 1-15, January.
    2. Mohammad Ebrahim Nikoofal & Morteza Pourakbar & Mehmet Gumus, 2023. "Securing containerized supply chain through public and private partnership," Production and Operations Management, Production and Operations Management Society, vol. 32(7), pages 2341-2361, July.
    3. Hunt, Kyle & Agarwal, Puneet & Zhuang, Jun, 2022. "On the adoption of new technology to enhance counterterrorism measures: An attacker–defender game with risk preferences," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chmura, Thorsten & Goerg, Sebastian J. & Selten, Reinhard, 2012. "Learning in experimental 2×2 games," Games and Economic Behavior, Elsevier, vol. 76(1), pages 44-73.
    2. Nick Feltovich, 2000. "Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information," Econometrica, Econometric Society, vol. 68(3), pages 605-642, May.
    3. Laurent Denant-Boemont & Olivier L’Haridon, 2013. "La rationalité à l'épreuve de l'économie comportementale," Revue française d'économie, Presses de Sciences-Po, vol. 0(2), pages 35-89.
    4. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Gotts, Nicholas M. & Polhill, J. Gary, 2007. "Transient and asymptotic dynamics of reinforcement learning in games," Games and Economic Behavior, Elsevier, vol. 61(2), pages 259-276, November.
    5. Andreas Ortmann & Leonidas Spiliopoulos, 2017. "The beauty of simplicity? (Simple) heuristics and the opportunities yet to be realized," Chapters, in: Morris Altman (ed.), Handbook of Behavioural Economics and Smart Decision-Making, chapter 7, pages 119-136, Edward Elgar Publishing.
    6. Oyarzun, Carlos & Sarin, Rajiv, 2013. "Learning and risk aversion," Journal of Economic Theory, Elsevier, vol. 148(1), pages 196-225.
    7. Atanasios Mitropoulos, 2001. "Learning Under Little Information: An Experiment on Mutual Fate Control," Game Theory and Information 0110003, University Library of Munich, Germany.
    8. Mitropoulos, Atanasios, 2001. "Learning under minimal information: An experiment on mutual fate control," Journal of Economic Psychology, Elsevier, vol. 22(4), pages 523-557, August.
    9. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    10. Francisco Gomes & Michael Haliassos & Tarun Ramadorai, 2021. "Household Finance," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 919-1000, September.
    11. Xie, Erhao, 2021. "Empirical properties and identification of adaptive learning models in behavioral game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 798-821.
    12. Stahl, Dale O., 2000. "Rule Learning in Symmetric Normal-Form Games: Theory and Evidence," Games and Economic Behavior, Elsevier, vol. 32(1), pages 105-138, July.
    13. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    14. Shu-Heng Chen & Yi-Lin Hsieh, 2011. "Reinforcement Learning in Experimental Asset Markets," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 37(1), pages 109-133.
    15. Özalp Özer & Yanchong Zheng, 2016. "Markdown or Everyday Low Price? The Role of Behavioral Motives," Management Science, INFORMS, vol. 62(2), pages 326-346, February.
    16. Schuster, Stephan, 2012. "Applications in Agent-Based Computational Economics," MPRA Paper 47201, University Library of Munich, Germany.
    17. Erev, Ido & Bereby-Meyer, Yoella & Roth, Alvin E., 1999. "The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models," Journal of Economic Behavior & Organization, Elsevier, vol. 39(1), pages 111-128, May.
    18. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    19. Colombo, Luca & Labrecciosa, Paola, 2021. "Dynamic oligopoly pricing with reference-price effects," European Journal of Operational Research, Elsevier, vol. 288(3), pages 1006-1016.
    20. Shafran, Aric P., 2012. "Learning in games with risky payoffs," Games and Economic Behavior, Elsevier, vol. 75(1), pages 354-371.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:282:y:2020:i:1:p:221-234. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.