IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v33y2022i4p1467-1489.html
   My bibliography  Save this article

How Network Embeddedness Affects Real-Time Performance Feedback: An Empirical Investigation

Author

Listed:
  • Mariia Petryk

    (School of Business, George Mason University, Fairfax, Virginia 22030)

  • Michael Rivera

    (Fox School of Business, Temple University, Philadelphia, Pennsylvania 19122)

  • Siddharth Bhattacharya

    (School of Business, George Mason University, Fairfax, Virginia 22030)

  • Liangfei Qiu

    (Warrington College of Business, University of Florida, Gainesville, Florida 32611)

  • Subodha Kumar

    (Fox School of Business, Temple University, Philadelphia, Pennsylvania 19122)

Abstract

Firms and organizations are increasingly using real-time performance feedback mechanisms to evaluate employees, where any employee (rather than just the supervisor) can rate other employees. Hence, a need arises to better understand how network positions of employees in such a system impact their performance. Analyzing nearly 4,000 feedback instances from employees at five major organizations that use such a real-time performance feedback application called DevelapMe, we explore the effects of network embeddedness—or the nature of relationships among employees—on performance rating scores according to two dimensions of embeddedness: (i) positional, the position of an individual in the emerging network of performance ratings, and (ii) structural, the extent to which a person is entrenched in a network of relationships. We visualize rating networks within organizations: Employees are nodes, and connections between nodes exist if an evaluation between the pair occurs. We find that specific aspects of network embeddedness affect performance rating scores differently. In particular, a rater’s positional embeddedness (measured by eigenvector centrality) is positively associated with the rating score he or she gives others. However, a rater’s structural embeddedness (measured by outdegree centrality) is negatively associated with the rating score he or she gives. We also uncover the moderating effects of anonymity and hierarchy on the role of network embeddedness, as well as the sentiment of the textual comments provided with feedback. Our findings have important implications for the design of performance management systems using network analysis.

Suggested Citation

  • Mariia Petryk & Michael Rivera & Siddharth Bhattacharya & Liangfei Qiu & Subodha Kumar, 2022. "How Network Embeddedness Affects Real-Time Performance Feedback: An Empirical Investigation," Information Systems Research, INFORMS, vol. 33(4), pages 1467-1489, December.
  • Handle: RePEc:inm:orisre:v:33:y:2022:i:4:p:1467-1489
    DOI: 10.1287/isre.2022.1110
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2022.1110
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.2022.1110?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lynn Wu, 2013. "Social Network Effects on Productivity and Job Security: Evidence from the Adoption of a Social Networking Tool," Information Systems Research, INFORMS, vol. 24(1), pages 30-51, March.
    2. Liangfei Qiu & Zhan (Michael) Shi & Andrew B. Whinston, 2018. "Learning from Your Friends’ Check-Ins: An Empirical Study of Location-Based Social Networks," Information Systems Research, INFORMS, vol. 29(4), pages 1044-1061, December.
    3. Yue, Xiaohang & Liu, John, 2006. "Demand forecast sharing in a dual-channel supply chain," European Journal of Operational Research, Elsevier, vol. 174(1), pages 646-667, October.
    4. Carolyn Heinrich & Alessandro Maffioli & Gonzalo Vázquez, 2010. "A Primer for Applying Propensity-Score Matching," SPD Working Papers 1005, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    5. Daniel D. Lee & H. Sebastian Seung, 1999. "Learning the parts of objects by non-negative matrix factorization," Nature, Nature, vol. 401(6755), pages 788-791, October.
    6. Zhengrui Jiang & Vijay S. Mookerjee & Sumit Sarkar, 2005. "Lying on the Web: Implications for Expert Systems Redesign," Information Systems Research, INFORMS, vol. 16(2), pages 131-148, June.
    7. Engelberg, Joseph & Gao, Pengjie & Parsons, Christopher A., 2012. "Friends with money," Journal of Financial Economics, Elsevier, vol. 103(1), pages 169-188.
    8. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    9. Peter Cappelli & Martin J. Conyon, 2018. "What Do Performance Appraisals Do?," ILR Review, Cornell University, ILR School, vol. 71(1), pages 88-116, January.
    10. Michael Rivera & Liangfei Qiu & Subodha Kumar & Tony Petrucci, 2021. "Are Traditional Performance Reviews Outdated? An Empirical Analysis on Continuous, Real-Time Feedback in the Workplace," Information Systems Research, INFORMS, vol. 32(2), pages 517-540, June.
    11. Taha Havakhor & Rajiv Sabherwal & Zachary R. Steelman & Sanjiv Sabherwal, 2019. "Relationships Between Information Technology and Other Investments: A Contingent Interaction Model," Service Science, INFORMS, vol. 30(1), pages 291-305, March.
    12. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    13. David Gefen & Paul A. Pavlou, 2012. "The Boundaries of Trust and Risk: The Quadratic Moderating Role of Institutional Structures," Information Systems Research, INFORMS, vol. 23(3-part-2), pages 940-959, September.
    14. Khim-Yong Goh & Cheng-Suang Heng & Zhijie Lin, 2013. "Social Media Brand Community and Consumer Behavior: Quantifying the Relative Impact of User- and Marketer-Generated Content," Information Systems Research, INFORMS, vol. 24(1), pages 88-107, March.
    15. J. H. Jung & Christoph Schneider & Joseph Valacich, 2010. "Enhancing the Motivational Affordance of Information Systems: The Effects of Real-Time Performance Feedback and Goal Setting in Group Collaboration Environments," Management Science, INFORMS, vol. 56(4), pages 724-742, April.
    16. Larcker, David F. & So, Eric C. & Wang, Charles C.Y., 2013. "Boardroom centrality and firm performance," Journal of Accounting and Economics, Elsevier, vol. 55(2), pages 225-250.
    17. Podsakoff, Philip M. & Farh, Jiing-Lih, 1989. "Effects of feedback sign and credibility on goal setting and task performance," Organizational Behavior and Human Decision Processes, Elsevier, vol. 44(1), pages 45-67, August.
    18. Michael L. Tushman & Elaine Romanelli, 1983. "Uncertainty, Social Location and Influence in Decision Making: A Sociometric Analysis," Management Science, INFORMS, vol. 29(1), pages 12-23, January.
    19. Gordon Burtch & Anindya Ghose & Sunil Wattal, 2013. "An Empirical Examination of the Antecedents and Consequences of Contribution Patterns in Crowd-Funded Markets," Information Systems Research, INFORMS, vol. 24(3), pages 499-519, September.
    20. Ishii, Joy & Xuan, Yuhai, 2014. "Acquirer-target social ties and merger outcomes," Journal of Financial Economics, Elsevier, vol. 112(3), pages 344-363.
    21. Yang Pan & Liangfei Qiu, 2022. "How Ride‐Sharing Is Shaping Public Transit System: A Counterfactual Estimator Approach," Production and Operations Management, Production and Operations Management Society, vol. 31(3), pages 906-927, March.
    22. Lin Hao & Hong Guo & Robert F. Easley, 2017. "A Mobile Platform's In‐App Advertising Contract Under Agency Pricing for App Sales," Production and Operations Management, Production and Operations Management Society, vol. 26(2), pages 189-202, February.
    23. Tianshu Sun & Lanfei Shi & Siva Viswanathan & Elena Zheleva, 2019. "Motivating Effective Mobile App Adoptions: Evidence from a Large-Scale Randomized Field Experiment," Information Systems Research, INFORMS, vol. 30(2), pages 523-539, June.
    24. Param Vir Singh & Nachiketa Sahoo & Tridas Mukhopadhyay, 2014. "How to Attract and Retain Readers in Enterprise Blogging?," Information Systems Research, INFORMS, vol. 25(1), pages 35-52, March.
    25. Victor Maas & Raquel Torres-González, 2011. "Subjective Performance Evaluation and Gender Discrimination," Journal of Business Ethics, Springer, vol. 101(4), pages 667-681, July.
    26. Ajay Mehra & Andrea L. Dixon & Daniel J. Brass & Bruce Robertson, 2006. "The Social Network Ties of Group Leaders: Implications for Group Performance and Leader Reputation," Organization Science, INFORMS, vol. 17(1), pages 64-79, February.
    27. Davide Proserpio & Georgios Zervas, 2017. "Online Reputation Management: Estimating the Impact of Management Responses on Consumer Reviews," Marketing Science, INFORMS, vol. 36(5), pages 645-665, September.
    28. Kerwin Kofi Charles & Jonathan Guryan, 2008. "Prejudice and Wages: An Empirical Assessment of Becker's The Economics of Discrimination," Journal of Political Economy, University of Chicago Press, vol. 116(5), pages 773-809, October.
    29. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    30. Anjana Susarla, 2012. "Contractual Flexibility, Rent Seeking, and Renegotiation Design: An Empirical Analysis of Information Technology Outsourcing Contracts," Management Science, INFORMS, vol. 58(7), pages 1388-1407, July.
    31. Franceschet, Massimo & Costantini, Antonio, 2010. "The effect of scholar collaboration on impact and quality of academic papers," Journal of Informetrics, Elsevier, vol. 4(4), pages 540-553.
    32. Kilduff, Martin, 1990. "The interpersonal structure of decision making: A social comparison approach to organizational choice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 47(2), pages 270-288, December.
    33. Cai, Ye & Sevilir, Merih, 2012. "Board connections and M&A transactions," Journal of Financial Economics, Elsevier, vol. 103(2), pages 327-349.
    34. Kiron Ravindran & Anjana Susarla & Deepa Mani & Vijay Gurbaxani, 2015. "Social Capital and Contract Duration in Buyer-Supplier Networks for Information Technology Outsourcing," Information Systems Research, INFORMS, vol. 26(2), pages 379-397, June.
    35. Jingchuan Pu & Yang Liu & Yuan Chen & Liangfei Qiu & Hsing Kenneth Cheng, 2022. "What Questions Are You Inclined to Answer? Effects of Hierarchy in Corporate Q&A Communities," Information Systems Research, INFORMS, vol. 33(1), pages 244-264, March.
    36. Liangfei Qiu & Subodha Kumar, 2017. "Understanding Voluntary Knowledge Provision and Content Contribution Through a Social-Media-Based Prediction Market: A Field Experiment," Information Systems Research, INFORMS, vol. 28(3), pages 529-546, September.
    37. Yan Chen & Sherry Xin Li, 2009. "Group Identity and Social Preferences," American Economic Review, American Economic Association, vol. 99(1), pages 431-457, March.
    38. Stephen P. Borgatti & Daniel S. Halgin, 2011. "On Network Theory," Organization Science, INFORMS, vol. 22(5), pages 1168-1181, October.
    39. Sinan Aral & Dylan Walker, 2014. "Tie Strength, Embeddedness, and Social Influence: A Large-Scale Networked Experiment," Management Science, INFORMS, vol. 60(6), pages 1352-1370, June.
    40. Rajdeep Grewal & Gary L. Lilien & Girish Mallapragada, 2006. "Location, Location, Location: How Network Embeddedness Affects Project Success in Open Source Systems," Management Science, INFORMS, vol. 52(7), pages 1043-1056, July.
    41. ., 2017. "Standing on the shoulders of giants," Chapters, in: Endogenous Innovation, chapter 1, pages 3-24, Edward Elgar Publishing.
    42. Jingchuan Pu & Yuan Chen & Liangfei Qiu & Hsing Kenneth Cheng, 2020. "Does Identity Disclosure Help or Hurt User Content Generation? Social Presence, Inhibition, and Displacement Effects," Information Systems Research, INFORMS, vol. 31(2), pages 297-322, June.
    43. Brad Greenwood & Idris Adjerid & Corey M. Angst & Nathan L. Meikle, 2022. "How Unbecoming of You: Online Experiments Uncovering Gender Biases in Perceptions of Ridesharing Performance," Journal of Business Ethics, Springer, vol. 175(3), pages 499-518, January.
    44. Amjad, Tehmina & Ding, Ying & Xu, Jian & Zhang, Chenwei & Daud, Ali & Tang, Jie & Song, Min, 2017. "Standing on the shoulders of giants," Journal of Informetrics, Elsevier, vol. 11(1), pages 307-323.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Naveen Kumar & Liangfei Qiu & Subodha Kumar, 2022. "A Hashtag Is Worth a Thousand Words: An Empirical Investigation of Social Media Strategies in Trademarking Hashtags," Information Systems Research, INFORMS, vol. 33(4), pages 1403-1427, December.
    2. Ramah Al Balawi & Yuheng Hu & Liangfei Qiu, 2023. "Brand Crisis and Customer Relationship Management on Social Media: Evidence from a Natural Experiment from the Airline Industry," Information Systems Research, INFORMS, vol. 34(2), pages 442-462, June.
    3. Michael Rivera & Liangfei Qiu & Subodha Kumar & Tony Petrucci, 2021. "Are Traditional Performance Reviews Outdated? An Empirical Analysis on Continuous, Real-Time Feedback in the Workplace," Information Systems Research, INFORMS, vol. 32(2), pages 517-540, June.
    4. Sandeep Khurana & Liangfei Qiu & Subodha Kumar, 2019. "When a Doctor Knows, It Shows: An Empirical Analysis of Doctors’ Responses in a Q&A Forum of an Online Healthcare Portal," Information Systems Research, INFORMS, vol. 30(3), pages 872-891, September.
    5. Wenjuan Fan & Qiqi Zhou & Liangfei Qiu & Subodha Kumar, 2023. "Should Doctors Open Online Consultation Services? An Empirical Investigation of Their Impact on Offline Appointments," Information Systems Research, INFORMS, vol. 34(2), pages 629-651, June.
    6. Fogel, Kathy & Jandik, Tomas & McCumber, William R., 2018. "CFO social capital and private debt," Journal of Corporate Finance, Elsevier, vol. 52(C), pages 28-52.
    7. Chahine, Salim & Fang, Yiwei & Hasan, Iftekhar & Mazboudi, Mohamad, 2019. "Entrenchment through corporate social responsibility: Evidence from CEO network centrality," International Review of Financial Analysis, Elsevier, vol. 66(C).
    8. Zhijun Yan & Lini Kuang & Liangfei Qiu, 2022. "Prosocial behaviors and economic performance: Evidence from an online mental healthcare platform," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3859-3876, October.
    9. DuckKi Cho & Lyungmae Choi & Jessie Jiaxu Wang, 2023. "It's Not Who You Know—It's Who Knows You: Employee Social Capital and Firm Performance," Finance and Economics Discussion Series 2023-020, Board of Governors of the Federal Reserve System (U.S.).
    10. Fang, Yiwei & Francis, Bill & Hasan, Iftekhar, 2018. "Differences make a difference: Diversity in social learning and value creation," Journal of Corporate Finance, Elsevier, vol. 48(C), pages 474-491.
    11. Dbouk, Wassim & Fang, Yiwei & Liu, Liuling & Wang, Haizhi, 2020. "Do social networks encourage risk-taking? Evidence from bank CEOs," Journal of Financial Stability, Elsevier, vol. 46(C).
    12. Mochen Yang & Gediminas Adomavicius & Gordon Burtch & Yuqing Rena, 2018. "Mind the Gap: Accounting for Measurement Error and Misclassification in Variables Generated via Data Mining," Information Systems Research, INFORMS, vol. 29(1), pages 4-24, March.
    13. Junho Park, 2022. "We are advertis’d by our loving friends: CEO‐connected directors," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(3), pages 3189-3238, September.
    14. Stephen P. Ferris & David Javakhadze & Tijana Rajkovic, 2019. "An international analysis of CEO social capital and corporate risk‐taking," European Financial Management, European Financial Management Association, vol. 25(1), pages 3-37, January.
    15. Sun, Jiong & Fang, Yiwei, 2015. "Executives’ professional ties along the supply chain: The impact on partnership sustainability and firm risk," Journal of Financial Stability, Elsevier, vol. 20(C), pages 144-154.
    16. Fang, Ming & Francis, Bill & Hasan, Iftekhar & Wu, Qiang, 2022. "External social networks and earnings management," The British Accounting Review, Elsevier, vol. 54(2).
    17. Tao, Qizhi & Li, Haoyu & Wu, Qun & Zhang, Ting & Zhu, Yingjun, 2019. "The dark side of board network centrality: Evidence from merger performance," Journal of Business Research, Elsevier, vol. 104(C), pages 215-232.
    18. Angela Aerry Choi & Daegon Cho & Dobin Yim & Jae Yun Moon & Wonseok Oh, 2019. "When Seeing Helps Believing: The Interactive Effects of Previews and Reviews on E-Book Purchases," Information Systems Research, INFORMS, vol. 30(4), pages 1164-1183, December.
    19. Yang Gao & Wenjing Duan & Huaxia Rui, 2022. "Does Social Media Accelerate Product Recalls? Evidence from the Pharmaceutical Industry," Information Systems Research, INFORMS, vol. 33(3), pages 954-977, September.
    20. Erfan Rezvani & Christian Rojas, 2022. "Firm responsiveness to consumers' reviews: The effect on online reputation," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(4), pages 898-922, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:33:y:2022:i:4:p:1467-1489. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.