IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1007811.html
   My bibliography  Save this article

Unsupervised manifold learning of collective behavior

Author

Listed:
  • Mathew Titus
  • George Hagstrom
  • James R Watson

Abstract

Collective behavior is an emergent property of numerous complex systems, from financial markets to cancer cells to predator-prey ecological systems. Characterizing modes of collective behavior is often done through human observation, training generative models, or other supervised learning techniques. Each of these cases requires knowledge of and a method for characterizing the macro-state(s) of the system. This presents a challenge for studying novel systems where there may be little prior knowledge. Here, we present a new unsupervised method of detecting emergent behavior in complex systems, and discerning between distinct collective behaviors. We require only metrics, d(1), d(2), defined on the set of agents, X, which measure agents’ nearness in variables of interest. We apply the method of diffusion maps to the systems (X, d(i)) to recover efficient embeddings of their interaction networks. Comparing these geometries, we formulate a measure of similarity between two networks, called the map alignment statistic (MAS). A large MAS is evidence that the two networks are codetermined in some fashion, indicating an emergent relationship between the metrics d(1) and d(2). Additionally, the form of the macro-scale organization is encoded in the covariances among the two sets of diffusion map components. Using these covariances we discern between different modes of collective behavior in a data-driven, unsupervised manner. This method is demonstrated on a synthetic flocking model as well as empirical fish schooling data. We show that our state classification subdivides the known behaviors of the school in a meaningful manner, leading to a finer description of the system’s behavior.Author summary: Many complex systems in society and nature exhibit collective behavior where individuals’ local interactions lead to system-wide organization. One challenge we face today is to identify and characterize these emergent behaviors, and here we have developed a new method for analyzing data from individuals, to detect when a given complex system is exhibiting system-wide organization. Importantly, our approach requires no prior knowledge of the fashion in which the collective behavior arises, or the macro-scale variables in which it manifests. We apply the new method to an agent-based model and empirical observations of fish schooling. While we have demonstrated the utility of our approach to biological systems, it can be applied widely to financial, medical, and technological systems for example.

Suggested Citation

  • Mathew Titus & George Hagstrom & James R Watson, 2021. "Unsupervised manifold learning of collective behavior," PLOS Computational Biology, Public Library of Science, vol. 17(2), pages 1-20, February.
  • Handle: RePEc:plo:pcbi00:1007811
    DOI: 10.1371/journal.pcbi.1007811
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007811
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1007811&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1007811?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert M. May & Simon A. Levin & George Sugihara, 2008. "Ecology for bankers," Nature, Nature, vol. 451(7181), pages 893-894, February.
    2. Iain D. Couzin & Jens Krause & Nigel R. Franks & Simon A. Levin, 2005. "Effective leadership and decision-making in animal groups on the move," Nature, Nature, vol. 433(7025), pages 513-516, February.
    3. Cont, Rama & Bouchaud, Jean-Philipe, 2000. "Herd Behavior And Aggregate Fluctuations In Financial Markets," Macroeconomic Dynamics, Cambridge University Press, vol. 4(2), pages 170-196, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pakpour, Fatemeh & Vicsek, Tamás, 2024. "Delay-induced phase transitions in active matter," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 634(C).
    2. Westerhoff, Frank H. & Dieci, Roberto, 2006. "The effectiveness of Keynes-Tobin transaction taxes when heterogeneous agents can trade in different markets: A behavioral finance approach," Journal of Economic Dynamics and Control, Elsevier, vol. 30(2), pages 293-322, February.
    3. Simon Levin & Anastasios Xepapadeas, 2021. "On the Coevolution of Economic and Ecological Systems," Annual Review of Resource Economics, Annual Reviews, vol. 13(1), pages 355-377, October.
    4. Westerhoff Frank H., 2008. "The Use of Agent-Based Financial Market Models to Test the Effectiveness of Regulatory Policies," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 195-227, April.
    5. Choi, Gahyun & Park, Kwangyeol & Yi, Eojin & Ahn, Kwangwon, 2023. "Price fairness: Clean energy stocks and the overall market," Chaos, Solitons & Fractals, Elsevier, vol. 168(C).
    6. Ehrentreich, Norman, 2006. "Technical trading in the Santa Fe Institute Artificial Stock Market revisited," Journal of Economic Behavior & Organization, Elsevier, vol. 61(4), pages 599-616, December.
    7. Cetina, Jill & Paddrik, Mark & Rajan, Sriram, 2018. "Stressed to the core: Counterparty concentrations and systemic losses in CDS markets," Journal of Financial Stability, Elsevier, vol. 35(C), pages 38-52.
    8. Chen, Zhimin & Ibragimov, Rustam, 2019. "One country, two systems? The heavy-tailedness of Chinese A- and H- share markets," Emerging Markets Review, Elsevier, vol. 38(C), pages 115-141.
    9. Becco, Ch. & Vandewalle, N. & Delcourt, J. & Poncin, P., 2006. "Experimental evidences of a structural and dynamical transition in fish school," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 367(C), pages 487-493.
    10. Karimi Rahjerdi, Bahareh & Ramamoorthy, Ramesh & Nazarimehr, Fahimeh & Rajagopal, Karthikeyan & Jafari, Sajad, 2022. "Indicating the synchronization bifurcation points using the early warning signals in two case studies: Continuous and explosive synchronization," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    11. Long-Hai Wang & Alexander Ulrich Ernst & Duo An & Ashim Kumar Datta & Boris Epel & Mrignayani Kotecha & Minglin Ma, 2021. "A bioinspired scaffold for rapid oxygenation of cell encapsulation systems," Nature Communications, Nature, vol. 12(1), pages 1-16, December.
    12. Wang, Yougui & Stanley, H.E., 2009. "Statistical approach to partial equilibrium analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(7), pages 1173-1180.
    13. A. Corcos & J-P Eckmann & A. Malaspinas & Y. Malevergne & D. Sornette, 2002. "Imitation and contrarian behaviour: hyperbolic bubbles, crashes and chaos," Quantitative Finance, Taylor & Francis Journals, vol. 2(4), pages 264-281.
    14. Richard P Mann, 2011. "Bayesian Inference for Identifying Interaction Rules in Moving Animal Groups," PLOS ONE, Public Library of Science, vol. 6(8), pages 1-10, August.
    15. Campos, Daniel & Llebot, Josep E. & Méndez, Vicenç, 2008. "Limited resources and evolutionary learning may help to understand the mistimed reproduction in birds caused by climate change," Theoretical Population Biology, Elsevier, vol. 74(1), pages 16-21.
    16. E. Samanidou & E. Zschischang & D. Stauffer & T. Lux, 2001. "Microscopic Models of Financial Markets," Papers cond-mat/0110354, arXiv.org.
    17. Annika Westphal, 2015. "Systemic Risk in the European Union: A Network Approach to Banks’ Sovereign Debt Exposures," IJFS, MDPI, vol. 3(3), pages 1-36, July.
    18. Javier Morales & V'ictor Tercero & Fernando Camacho & Eduardo Cordero & Luis L'opez & F-Javier Almaguer, 2014. "Trend and Fractality Assessment of Mexico's Stock Exchange," Papers 1411.3399, arXiv.org.
    19. Ma, Jian & Song, Wei-guo & Zhang, Jun & Lo, Siu-ming & Liao, Guang-xuan, 2010. "k-Nearest-Neighbor interaction induced self-organized pedestrian counter flow," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(10), pages 2101-2117.
    20. Gu, Gao-Feng & Chen, Wei & Zhou, Wei-Xing, 2008. "Empirical regularities of order placement in the Chinese stock market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(13), pages 3173-3182.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1007811. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.