IDEAS home Printed from https://ideas.repec.org/a/spr/infosf/v26y2024i2d10.1007_s10796-023-10395-5.html
   My bibliography  Save this article

Finetuning Analytics Information Systems for a Better Understanding of Users: Evidence of Personification Bias on Multiple Digital Channels

Author

Listed:
  • Bernard J. Jansen

    (Hamad Bin Khalifa University
    Education City)

  • Soon-gyo Jung

    (Hamad Bin Khalifa University)

  • Joni Salminen

    (University of Vaasa)

Abstract

Although the effect of hyperparameters on algorithmic outputs is well known in machine learning, the effects of hyperparameters on information systems that produce user or customer segments are relatively unexplored. This research investigates the effect of varying the number of user segments on the personification of user engagement data in a real analytics information system, employing the concept of persona. We increment the number of personas from 5 to 15 for a total of 330 personas and 33 persona generations. We then examine the effect of changing the hyperparameter on the gender, age, nationality, and combined gender-age-nationality representation of the user population. The results show that despite using the same data and algorithm, varying the number of personas strongly biases the information system’s personification of the user population. The hyperparameter selection for the 990 total personas results in an average deviation of 54.5% for gender, 42.9% for age, 28.9% for nationality, and 40.5% for gender-age-nationality. A repeated analysis of two other organizations shows similar results for all attributes. The deviation occurred for all organizations on all platforms for all attributes, as high as 90.9% in some cases. The results imply that decision makers using analytics information systems should be aware of the effect of hyperparameters on the set of user or customer segments they are exposed to. Organizations looking to effectively use persona analytics systems must be wary that altering the number of personas could substantially change the results, leading to drastically different interpretations about the actual user base.

Suggested Citation

  • Bernard J. Jansen & Soon-gyo Jung & Joni Salminen, 2024. "Finetuning Analytics Information Systems for a Better Understanding of Users: Evidence of Personification Bias on Multiple Digital Channels," Information Systems Frontiers, Springer, vol. 26(2), pages 775-798, April.
    • Handle: RePEc:spr:infosf:v:26:y:2024:i:2:d:10.1007_s10796-023-10395-5
    DOI: 10.1007/s10796-023-10395-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10796-023-10395-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10796-023-10395-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bernard J. Jansen & Mimi Zhang & Kate Sobel & Abdur Chowdury, 2009. "Twitter power: Tweets as electronic word of mouth," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(11), pages 2169-2188, November.
    2. Lin, Canchu & Kunnathur, Anand, 2019. "Strategic orientations, developmental culture, and big data capability," Journal of Business Research, Elsevier, vol. 105(C), pages 49-60.
    3. Daniel D. Lee & H. Sebastian Seung, 1999. "Learning the parts of objects by non-negative matrix factorization," Nature, Nature, vol. 401(6755), pages 788-791, October.
    4. Salminen, Joni & Yoganathan, Vignesh & Corporan, Juan & Jansen, Bernard J. & Jung, Soon-Gyo, 2019. "Machine learning approach to auto-tagging online content for content marketing efficiency: A comparative analysis between methods and content type," Journal of Business Research, Elsevier, vol. 101(C), pages 203-217.
    5. Shailaja Venkatsubramanyan & Timothy R. Hill, 2010. "An empirical investigation into the effects of web search characteristics on decisions associated with impression formation," Information Systems Frontiers, Springer, vol. 12(5), pages 579-593, November.
    6. Hossain, Md Afnan & Akter, Shahriar & Yanamandram, Venkata, 2020. "Revisiting customer analytics capability for data-driven retailing," Journal of Retailing and Consumer Services, Elsevier, vol. 56(C).
    7. Raghav Pavan Karumur & Tien T. Nguyen & Joseph A. Konstan, 2018. "Personality, User Preferences and Behavior in Recommender systems," Information Systems Frontiers, Springer, vol. 20(6), pages 1241-1265, December.
    8. Xu, Zhenning & Frankwick, Gary L. & Ramirez, Edward, 2016. "Effects of big data analytics and traditional marketing analytics on new product success: A knowledge fusion perspective," Journal of Business Research, Elsevier, vol. 69(5), pages 1562-1566.
    9. Lene Nielsen & Kira Storgaard Hansen & Jan Stage & Jane Billestrup, 2015. "A Template for Design Personas: Analysis of 47 Persona Descriptions from Danish Industries and Organizations," International Journal of Sociotechnology and Knowledge Development (IJSKD), IGI Global, vol. 7(1), pages 45-61, January.
    10. Roland T. Rust & Ming-Hui Huang, 2014. "The Service Revolution and the Transformation of Marketing Science," Marketing Science, INFORMS, vol. 33(2), pages 206-221, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guojun Ji & Muhong Yu & Kim Hua Tan & Ajay Kumar & Shivam Gupta, 2024. "Decision optimization in cooperation innovation: the impact of big data analytics capability and cooperative modes," Annals of Operations Research, Springer, vol. 333(2), pages 871-894, February.
    2. Hossain, Md Afnan & Akter, Shahriar & Yanamandram, Venkata, 2021. "Why doesn't our value creation payoff: Unpacking customer analytics-driven value creation capability to sustain competitive advantage," Journal of Business Research, Elsevier, vol. 131(C), pages 287-296.
    3. Mustak, Mekhail & Salminen, Joni & Plé, Loïc & Wirtz, Jochen, 2021. "Artificial intelligence in marketing: Topic modeling, scientometric analysis, and research agenda," Journal of Business Research, Elsevier, vol. 124(C), pages 389-404.
    4. Anastasia Griva & Cleopatra Bardaki & Katerina Pramatari & Georgios Doukidis, 2022. "Factors Affecting Customer Analytics: Evidence from Three Retail Cases," Information Systems Frontiers, Springer, vol. 24(2), pages 493-516, April.
    5. Purva Grover & Arpan Kumar Kar, 2017. "Big Data Analytics: A Review on Theoretical Contributions and Tools Used in Literature," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 18(3), pages 203-229, September.
    6. Zhengang Zhang & Yu Shang & Linyuan Cheng & Antao Hu, 2022. "Big Data Capability and Sustainable Competitive Advantage: The Mediating Role of Ambidextrous Innovation Strategy," Sustainability, MDPI, vol. 14(14), pages 1-17, July.
    7. Dawn Iacobucci & Maria Petrescu & Anjala Krishen & Michael Bendixen, 2019. "The state of marketing analytics in research and practice," Journal of Marketing Analytics, Palgrave Macmillan, vol. 7(3), pages 152-181, September.
    8. Chun Xue & Juanru Wang, 2024. "Proactive boundary‐spanning search, organizational resilience, and radical green innovation," Business Strategy and the Environment, Wiley Blackwell, vol. 33(3), pages 1834-1852, March.
    9. Imran Bashir Dar & Muhammad Bashir Khan & Abdul Zahid Khan & Bahaudin G. Mujtaba, 2021. "A qualitative analysis of the marketing analytics literature: where would ethical issues and legality rank?," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(3), pages 242-261, September.
    10. Akter, Shahriar & Hossain, Md Afnan & Sajib, Shahriar & Sultana, Saida & Rahman, Mahfuzur & Vrontis, Demetris & McCarthy, Grace, 2023. "A framework for AI-powered service innovation capability: Review and agenda for future research," Technovation, Elsevier, vol. 125(C).
    11. Jaeger, Lena-Christin & Höhler, Julia, 2021. "Using word of mouth data from social media to identify asymmetric competition in food retailing," Journal of Retailing and Consumer Services, Elsevier, vol. 58(C).
    12. Nazir, Sajjad & Khadim, Sahar & Ali Asadullah, Muhammad & Syed, Nausheen, 2023. "Exploring the influence of artificial intelligence technology on consumer repurchase intention: The mediation and moderation approach," Technology in Society, Elsevier, vol. 72(C).
    13. Sheng, Jie & Amankwah-Amoah, Joseph & Wang, Xiaojun, 2017. "A multidisciplinary perspective of big data in management research," International Journal of Production Economics, Elsevier, vol. 191(C), pages 97-112.
    14. Rafael Teixeira & Mário Antunes & Diogo Gomes & Rui L. Aguiar, 2024. "Comparison of Semantic Similarity Models on Constrained Scenarios," Information Systems Frontiers, Springer, vol. 26(4), pages 1307-1330, August.
    15. Jiatong Yu & Jiajue Wang & Taesoo Moon, 2022. "Influence of Digital Transformation Capability on Operational Performance," Sustainability, MDPI, vol. 14(13), pages 1-20, June.
    16. Del Corso, Gianna M. & Romani, Francesco, 2019. "Adaptive nonnegative matrix factorization and measure comparisons for recommender systems," Applied Mathematics and Computation, Elsevier, vol. 354(C), pages 164-179.
    17. P Fogel & C Geissler & P Cotte & G Luta, 2022. "Applying separative non-negative matrix factorization to extra-financial data," Working Papers hal-03689774, HAL.
    18. Xiao-Bai Li & Jialun Qin, 2017. "Anonymizing and Sharing Medical Text Records," Information Systems Research, INFORMS, vol. 28(2), pages 332-352, June.
    19. Muhammad Nur Firdaus Nasir & Iqbal Jaapar & Walid Muhmmad Syafrien Effendi & Fadly Mohamed Sharif & Khairulwafi Mamat & Nurul Farhana Nasir, 2024. "Exploring the Role of Artificial Intelligence in the Design Industry: Client Satisfaction through Enhancing Quality while Preserving Human Creativity," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 8(3s), pages 4538-4543, October.
    20. Smith, Andrew N. & Fischer, Eileen & Yongjian, Chen, 2012. "How Does Brand-related User-generated Content Differ across YouTube, Facebook, and Twitter?," Journal of Interactive Marketing, Elsevier, vol. 26(2), pages 102-113.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:infosf:v:26:y:2024:i:2:d:10.1007_s10796-023-10395-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.