IDEAS home Printed from https://ideas.repec.org/p/osf/thesis/9pqg7_v1.html
   My bibliography  Save this paper

Virtual Assessment Center - A Media Comparison Study on the Diagnostic Value of Online Role Play for Social Competence Assessment

Author

Listed:
  • Hasler, Béatrice

Abstract

The assessment center (AC) method is often used in personnel selection and development to assess job applicants' or employees' social competences. The aim of this thesis was to evaluate whether virtual ACs ad-ministered via the Internet would lead to the same results as traditional face-to-face (FTF) administered ACs. Based on a definition of social competence, an operational framework is outlined for its assessment with emphasis on the behavioral manifestation of social skills. After dis-cussing the AC method with focus on role-play as a common type of AC simulation exercise, current approaches to virtual ACs are presented, which are still in their infancy. Based on a discussion of the characteristics of FTF and computer-mediated communication, and quality standards for assessment procedures, 16 presumptions are derived concerning the expected similarities or differences between FTF and online assessment of social skills. Assessment outcome and quality of assessment da-ta are evaluated in a media comparison study using a within-subject de-sign comparing FTF and text-based, anonymous online role-play. Inter-rater reliability was found to be higher in FTF assessment while concur-rent validity, as measured by correlations with self-rated personality traits, was higher in online assessment. Moderate convergent validity was found between the two media indicating the equivalence of assessment results. Used as a pre-selection instrument, online role-play has the potential to reduce the number of candidates invited to costly ACs as it is able to predict AC role-play performance better than chance. Further-more, judgments of social skills based on anonymous online interactions are less biased compared to FTF observation. Nevertheless, chat experience and typing skills have been found to be a critical factor influencing skill ratings in online assessment but their influence can be reduced by modifying the assessment task. Despite relatively high ecological validity and lower levels of negative affective reactions during online role-play, participants showed higher preference for FTF assessment than for online assessment. Women and experienced chat users, however, rated online role-play as an assessment tool more favorably than men and in-experienced chat users did. Based on theoretical considerations and the results of the empirical study, recommendations are derived for human resource professionals and organizational psychology researchers. This thesis is a first step towards the validation of virtual ACs using interactive web-based exercises and lays the corner stone for further media comparison studies concerning their diagnostic value. The practicability of virtual ACs, however, has yet to be evaluated.

Suggested Citation

  • Hasler, Béatrice, 2009. "Virtual Assessment Center - A Media Comparison Study on the Diagnostic Value of Online Role Play for Social Competence Assessment," Thesis Commons 9pqg7_v1, Center for Open Science.
  • Handle: RePEc:osf:thesis:9pqg7_v1
    DOI: 10.31219/osf.io/9pqg7_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/68d540b94c70c7605bc94a62/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/9pqg7_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Terri L. Griffith & Gregory B. Northcraft, 1994. "Distinguishing Between the Forest and the Trees: Media, Features, and Methodology in Electronic Communication Research," Organization Science, INFORMS, vol. 5(2), pages 272-285, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daily, Bonnie F. & Teich, Jeffrey E., 2001. "Perceptions of contribution in multi-cultural groups in non-GDSS and GDSS environments," European Journal of Operational Research, Elsevier, vol. 134(1), pages 70-83, October.
    2. Janet Fulk & Rebecca Heino & Andrew J. Flanagin & Peter R. Monge & François Bar, 2004. "A Test of the Individual Action Model for Organizational Information Commons," Organization Science, INFORMS, vol. 15(5), pages 569-585, October.
    3. Michael Ahearne & Eli Jones & Adam Rapp & John Mathieu, 2008. "High Touch Through High Tech: The Impact of Salesperson Technology Usage on Sales Performance via Mediating Mechanisms," Management Science, INFORMS, vol. 54(4), pages 671-685, April.
    4. Choon-Ling Sia & Bernard C. Y. Tan & Kwok-Kee Wei, 2002. "Group Polarization and Computer-Mediated Communication: Effects of Communication Cues, Social Presence, and Anonymity," Information Systems Research, INFORMS, vol. 13(1), pages 70-90, March.
    5. Kim, Hyo-Jeong & Mannino, Michael & Nieschwietz, Robert J., 2009. "Information technology acceptance in the internal audit profession: Impact of technology features and complexity," International Journal of Accounting Information Systems, Elsevier, vol. 10(4), pages 214-228.
    6. Ingmar Geiger, 2020. "From Letter to Twitter: A Systematic Review of Communication Media in Negotiation," Group Decision and Negotiation, Springer, vol. 29(2), pages 207-250, April.
    7. Andrew Burton-Jones & Detmar W. Straub, 2006. "Reconceptualizing System Usage: An Approach and Empirical Test," Information Systems Research, INFORMS, vol. 17(3), pages 228-246, September.
    8. Dong-Gil Ko & Alan R. Dennis, 2011. "Profiting from Knowledge Management: The Impact of Time and Experience," Information Systems Research, INFORMS, vol. 22(1), pages 134-152, March.
    9. Neale, Margaret A. & Griffith, Terri & Sawyer, John E., 2000. "Information Technology as a Jealous Mistress: Competition for Knowledge between Individuals and Organizations," Research Papers 1611, Stanford University, Graduate School of Business.
    10. Joel Harmon, 1998. "Electronic Meetings and Intense Group Conflict: Effects of a Policy-Modeling Performance Support System and an Audio Communication Support System on Satisfaction and Agreement," Group Decision and Negotiation, Springer, vol. 7(2), pages 131-153, March.
    11. Kurtzberg, Terri R. & Naquin, Charles E. & Belkin, Liuba Y., 2005. "Electronic performance appraisals: The effects of e-mail communication on peer ratings in actual and simulated environments," Organizational Behavior and Human Decision Processes, Elsevier, vol. 98(2), pages 216-226, November.
    12. Neale, Margaret A. & Griffith, Terri, 1999. "Information Processing in Traditional, Hybrid, and Virtual Teams: From Nascent Knowledge to Transactive Memory," Research Papers 1613, Stanford University, Graduate School of Business.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:thesis:9pqg7_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://thesiscommons.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.