IDEAS home Printed from https://ideas.repec.org/a/spr/jcomop/v28y2014i3d10.1007_s10878-013-9675-z.html
   My bibliography  Save this article

Improvement of path analysis algorithm in social networks based on HBase

Author

Listed:
  • Yan Qiang

    (Taiyuan University of Technology)

  • Bo Pei

    (Taiyuan University of Technology)

  • Weili Wu

    (Taiyuan University of Technology
    University of Texas at Dallas)

  • Juanjuan Zhao

    (Taiyuan University of Technology)

  • Xiaolong Zhang

    (Taiyuan University of Technology
    Pennsylvania State University)

  • Yue Li

    (Taiyuan University of Technology)

  • Lidong Wu

    (University of Texas at Dallas)

Abstract

When social network has reached hundreds of million users, the analysis of data in social network services becomes very important. Understanding how nodes interconnect in large graphs is an essential problem in many fields. In order to find connecting nodes between two nodes or two groups of source nodes in huge graphs, we propose a parallelized data-mining algorithm to get the shortest path between nodes in a social network based on HBase distributed key/value store. Our algorithm can achieve the shortest path among different nodes in network under the parallel environment. We analyze the social network model by this algorithm first, and then optimize the output from cloud platform by using the intermediary degrees and degree central algorithm. Finally, with a simulated social network, we validate the efficiency of the proposed algorithm. The experiment results indicate that our algorithm can improve the efficiency of parallel breath-first search (BSF).

Suggested Citation

  • Yan Qiang & Bo Pei & Weili Wu & Juanjuan Zhao & Xiaolong Zhang & Yue Li & Lidong Wu, 2014. "Improvement of path analysis algorithm in social networks based on HBase," Journal of Combinatorial Optimization, Springer, vol. 28(3), pages 588-599, October.
  • Handle: RePEc:spr:jcomop:v:28:y:2014:i:3:d:10.1007_s10878-013-9675-z
    DOI: 10.1007/s10878-013-9675-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10878-013-9675-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10878-013-9675-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Barabási, Albert-László & Albert, Réka & Jeong, Hawoong, 1999. "Mean-field theory for scale-free random networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 272(1), pages 173-187.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liang, Wei & Shi, Yuming & Huang, Qiuling, 2014. "Modeling the Chinese language as an evolving network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 393(C), pages 268-276.
    2. Stephanie Rend'on de la Torre & Jaan Kalda & Robert Kitt & Juri Engelbrecht, 2016. "On the topologic structure of economic complex networks: Empirical evidence from large scale payment network of Estonia," Papers 1602.04352, arXiv.org.
    3. Gabrielle Demange, 2012. "On the influence of a ranking system," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(2), pages 431-455, July.
    4. Tsao, J.Y. & Boyack, K.W. & Coltrin, M.E. & Turnley, J.G. & Gauster, W.B., 2008. "Galileo's stream: A framework for understanding knowledge production," Research Policy, Elsevier, vol. 37(2), pages 330-352, March.
    5. Pier Paolo Saviotti, 2011. "Knowledge, Complexity and Networks," Chapters, in: Cristiano Antonelli (ed.), Handbook on the Economic Complexity of Technological Change, chapter 6, Edward Elgar Publishing.
    6. Duan, Shuyu & Wen, Tao & Jiang, Wen, 2019. "A new information dimension of complex network based on Rényi entropy," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 516(C), pages 529-542.
    7. Chung-Yuan Huang & Chuen-Tsai Sun & Hsun-Cheng Lin, 2005. "Influence of Local Information on Social Simulations in Small-World Network Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(4), pages 1-8.
    8. Sun, Bingbin & Yao, Jialing & Xi, Lifeng, 2019. "Eigentime identities of fractal sailboat networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 520(C), pages 338-349.
    9. Yang, Xu-Hua & Lou, Shun-Li & Chen, Guang & Chen, Sheng-Yong & Huang, Wei, 2013. "Scale-free networks via attaching to random neighbors," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(17), pages 3531-3536.
    10. Colizza, Vittoria & Flammini, Alessandro & Maritan, Amos & Vespignani, Alessandro, 2005. "Characterization and modeling of protein–protein interaction networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 352(1), pages 1-27.
    11. Wouter Vermeer & Otto Koppius & Peter Vervest, 2018. "The Radiation-Transmission-Reception (RTR) model of propagation: Implications for the effectiveness of network interventions," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-21, December.
    12. Haider, Sajjad & Mariotti, Francesca, 2016. "The orchestration of alliance portfolios: The role of alliance portfolio capability," Scandinavian Journal of Management, Elsevier, vol. 32(3), pages 127-141.
    13. Lotfi, Nastaran & Rodrigues, Francisco A., 2022. "On the effect of memory on the Prisoner’s Dilemma game in correlated networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 607(C).
    14. Laurienti, Paul J. & Joyce, Karen E. & Telesford, Qawi K. & Burdette, Jonathan H. & Hayasaka, Satoru, 2011. "Universal fractal scaling of self-organized networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(20), pages 3608-3613.
    15. L. Jarina Banu & P. Balasubramaniam, 2014. "Synchronisation of discrete-time complex networks with randomly occurring uncertainties, nonlinearities and time-delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 45(7), pages 1427-1450, July.
    16. Chen, Qinghua & Shi, Dinghua, 2004. "The modeling of scale-free networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 335(1), pages 240-248.
    17. Csárdi, Gábor & Strandburg, Katherine J. & Zalányi, László & Tobochnik, Jan & Érdi, Péter, 2007. "Modeling innovation by a kinetic description of the patent citation system," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 374(2), pages 783-793.
    18. Wang, Yi & Cao, Jinde & Jin, Zhen & Zhang, Haifeng & Sun, Gui-Quan, 2013. "Impact of media coverage on epidemic spreading in complex networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(23), pages 5824-5835.
    19. Du, Siyuan & Guo, Chunxiang & Jin, Maozhu, 2016. "Agent-based simulation on tourists’ congestion control during peak travel period using Logit model," Chaos, Solitons & Fractals, Elsevier, vol. 89(C), pages 187-194.
    20. Vigier, A., 2008. "Globalization, Education, and the Topology of Social Networks," Cambridge Working Papers in Economics 0851, Faculty of Economics, University of Cambridge.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jcomop:v:28:y:2014:i:3:d:10.1007_s10878-013-9675-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.