IDEAS home Printed from https://ideas.repec.org/a/taf/accted/v23y2014i6p542-561.html
   My bibliography  Save this article

Assessment in Higher Education: The Potential for a Community of Practice to Improve Inter-marker Reliability

Author

Listed:
  • Ian P. Herbert
  • John Joyce
  • Trevor Hassall

Abstract

The design, delivery and assessment of a complete educational scheme, such as a degree programme or a professional qualification course, is a complex matter. Maintaining alignment between the stated aims of the curriculum and the scoring of student achievement is an overarching concern. The potential for drift across individual aspects of an educational scheme (teaching, learning and assessment), together with emerging criticism in extant literature of the reliability of marking processes, suggests that, in practice, maintaining alignment might be more difficult than had previously been assumed.In this paper, the concept of a Community of Practice (CoP) is employed as an analytical lens through which the notion of a markers' standardisation meeting that focuses on maintaining alignment between the curriculum, the marking scheme and the scoring of student scripts can be critically examined. Given that the aims and subject content of management learning are both multidimensional and contextual, such meetings have the potential to develop a shared approach to the elaboration and application of the marking scheme. A further role of the CoP is in the calibration of markers to accommodate further variations in student responses as they arise in the actual marking process. In this respect, the CoP has both descriptive and prescriptive potential in terms of aiding the development of markers of professional accounting examinations and also, we suggest, within accounting education more generally.

Suggested Citation

  • Ian P. Herbert & John Joyce & Trevor Hassall, 2014. "Assessment in Higher Education: The Potential for a Community of Practice to Improve Inter-marker Reliability," Accounting Education, Taylor & Francis Journals, vol. 23(6), pages 542-561, December.
    • Handle: RePEc:taf:accted:v:23:y:2014:i:6:p:542-561
    DOI: 10.1080/09639284.2014.974195
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/09639284.2014.974195
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/09639284.2014.974195?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Karen Handley & Andrew Sturdy & Robin Fincham & Timothy Clark, 2006. "Within and Beyond Communities of Practice: Making Sense of Learning Through Participation, Identity and Practice," Journal of Management Studies, Wiley Blackwell, vol. 43(3), pages 641-653, May.
    2. Alessia Contu & Hugh Willmott, 2003. "Re-Embedding Situatedness: The Importance of Power Relations in Learning Theory," Organization Science, INFORMS, vol. 14(3), pages 283-296, June.
    3. Joanne Roberts, 2006. "Limits to Communities of Practice," Journal of Management Studies, Wiley Blackwell, vol. 43(3), pages 623-639, May.
    4. John Seely Brown & Paul Duguid, 1991. "Organizational Learning and Communities-of-Practice: Toward a Unified View of Working, Learning, and Innovation," Organization Science, INFORMS, vol. 2(1), pages 40-57, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wolcott, Susan K. & Sargent, Matthew J., 2021. "Critical thinking in accounting education: Status and call to action," Journal of Accounting Education, Elsevier, vol. 56(C).
    2. Apostolou, Barbara & Dorminey, Jack W. & Hassell, John M. & Rebele, James E., 2015. "Accounting education literature review (2013–2014)," Journal of Accounting Education, Elsevier, vol. 33(2), pages 69-127.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Kaethler, 2019. "Curating creative communities of practice: the role of ambiguity," Journal of Organization Design, Springer;Organizational Design Community, vol. 8(1), pages 1-17, December.
    2. Emmanuelle Vaast & Geoff Walsham, 2009. "Trans-Situated Learning: Supporting a Network of Practice with an Information Infrastructure," Information Systems Research, INFORMS, vol. 20(4), pages 547-564, December.
    3. Simon Turner, 2013. "Absorptive Capacity: The Role of Communities of Practice," Working Papers wp444, Centre for Business Research, University of Cambridge.
    4. Nooteboom, B., 2007. "Cognitive Distance in and Between COP’s and Firms : Where do Exploitation and Exploration take Place, and How are they Connected?," Discussion Paper 2007-4, Tilburg University, Center for Economic Research.
    5. Torsten Ringberg & Markus Reihlen, 2008. "Towards a Socio‐Cognitive Approach to Knowledge Transfer," Journal of Management Studies, Wiley Blackwell, vol. 45(5), pages 912-935, July.
    6. Papadopoulos, Thanos & Stamati, Teta & Nopparuch, Pawit, 2013. "Exploring the determinants of knowledge sharing via employee weblogs," International Journal of Information Management, Elsevier, vol. 33(1), pages 133-146.
    7. Agterberg, M. & Hooff, B. van den & Huysman, M., 2008. "Keeping the wheels turning : multi-level dynamics in organizing networks of practice," Serie Research Memoranda 0003, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    8. Siedlok, Frank & Hibbert, Paul & Sillince, John, 2015. "From practice to collaborative community in interdisciplinary research contexts," Research Policy, Elsevier, vol. 44(1), pages 96-107.
    9. Amin, Ash & Roberts, Joanne, 2008. "Knowing in action: Beyond communities of practice," Research Policy, Elsevier, vol. 37(2), pages 353-369, March.
    10. Yakhlef, Ali, 2010. "The three facets of knowledge: A critique of the practice-based learning theory," Research Policy, Elsevier, vol. 39(1), pages 39-46, February.
    11. J. Andrei Villarroel & John E. Taylor & Christopher L. Tucci, 2013. "Innovation and learning performance implications of free revealing and knowledge brokering in competing communities: insights from the Netflix Prize challenge," Computational and Mathematical Organization Theory, Springer, vol. 19(1), pages 42-77, March.
    12. Karin Dessne & Katriina Byström, 2015. "Imitating CoPs: Imposing formality on informality," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2277-2284, November.
    13. Ikujiro Nonaka & Georg von Krogh, 2009. "Perspective---Tacit Knowledge and Knowledge Conversion: Controversy and Advancement in Organizational Knowledge Creation Theory," Organization Science, INFORMS, vol. 20(3), pages 635-652, June.
    14. Verena Brinks, 2016. "Situated affect and collective meaning: A community perspective on processes of value creation and commercialization in enthusiast-driven fields," Environment and Planning A, , vol. 48(6), pages 1152-1169, June.
    15. Alvesson, Mats & Sveningsson, Stefan, 2011. "Management is the solution: Now what was the problem? On the fragile basis for managerialism," Scandinavian Journal of Management, Elsevier, vol. 27(4), pages 349-361.
    16. Halvor Holtskog, 2017. "Defining the Characteristics of an Expert in a Social Context Through Subjective Evaluation," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 8(3), pages 1014-1031, September.
    17. Sandra Dubouloz & Anne Berthinier-Poncet & Luciana Castro Gonçalves & Emilie Ruiz & Catherine Thevenard-Puthod, 2021. "Innovation communities: from their characterization to the questioning of their boundaries [Comunidades de innovación: desde su caracterización hasta el cuestionamiento de sus fronteras]," Post-Print hal-02891869, HAL.
    18. Anne Kokkonen & Pauli Alin, 2015. "Practice-based learning in construction projects: a literature review," Construction Management and Economics, Taylor & Francis Journals, vol. 33(7), pages 513-530, July.
    19. Davide Nicolini, 2011. "Practice as the Site of Knowing: Insights from the Field of Telemedicine," Organization Science, INFORMS, vol. 22(3), pages 602-620, June.
    20. Marijn A. van Weele & Henk J. Steinz & Frank J. van Rijnsoever, 2018. "Start‐up Communities as Communities of Practice: Shining a Light on Geographical Scale and Membership," Tijdschrift voor Economische en Sociale Geografie, Royal Dutch Geographical Society KNAG, vol. 109(2), pages 173-188, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:accted:v:23:y:2014:i:6:p:542-561. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RAED20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.