IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v68y2018icp166-175.html
   My bibliography  Save this article

Validation of the evaluation capacity in organizations questionnaire

Author

Listed:
  • Gagnon, France
  • Aubry, Tim
  • Cousins, J. Bradley
  • Goh, Swee C.
  • Elliott, Catherine

Abstract

The purpose of this study was to test the construct validity of the Evaluation Capacity in Organizations Questionnaire (ECOQ). Conceptually, the ECOQ examines the role of evaluation in organizational development and, most notably in organizational learning. In this model, evaluation capacity building (ECB) initiatives are assumed to contribute to the development of a culture of systematic self-assessment and reflection, which, in turn, leads to increased organizational learning. Our sample consisted of internal evaluators within the federal, provincial or municipal government, not-for-profit organizations, private firms, and colleges or universities in Canada. Exploratory factor analysis (EFA) and latent path analysis (LPA) were conducted to better understand the underlying structural aspect of the organizational capacity to do and use evaluation construct as measured by the ECOQ. The results of our study indicate that the ECOQ effectively assesses an organization’s capacity to do and use evaluation. Furthermore, evidence provided by the LPA statistical analysis suggests that an organization’s capacity to learn is enhanced by the relationships among the various factors. Implications of using a validated model of an organization’s capacity to do and use evaluations in both research and practice are discussed.

Suggested Citation

  • Gagnon, France & Aubry, Tim & Cousins, J. Bradley & Goh, Swee C. & Elliott, Catherine, 2018. "Validation of the evaluation capacity in organizations questionnaire," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 166-175.
    • Handle: RePEc:eee:epplan:v:68:y:2018:i:c:p:166-175
    DOI: 10.1016/j.evalprogplan.2018.01.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S014971891730263X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2018.01.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Goh, Swee & Richards, Gregory, 1997. "Benchmarking the learning capability of organizations," European Management Journal, Elsevier, vol. 15(5), pages 575-583, October.
    2. Turnbull, B., 1999. "The mediating effect of participation efficacy on evaluation use," Evaluation and Program Planning, Elsevier, vol. 22(2), pages 131-140, May.
    3. Kim Forss & Basil Cracknell & Knut Samset, 1994. "Can Evaluation Help an Organization to Learn?," Evaluation Review, , vol. 18(5), pages 574-591, October.
    4. Henry Kaiser, 1970. "A second generation little jiffy," Psychometrika, Springer;The Psychometric Society, vol. 35(4), pages 401-415, December.
    5. Louis Guttman, 1954. "Some necessary conditions for common-factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 19(2), pages 149-161, June.
    6. Preskill, Hallie, 1994. "Evaluation's role in enhancing organizational learning: A model for practice," Evaluation and Program Planning, Elsevier, vol. 17(3), pages 291-297.
    7. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Schwarzman, Joanna & Bauman, Adrian & Gabbe, Belinda J. & Rissel, Chris & Shilton, Trevor & Smith, Ben J., 2019. "Understanding the factors that influence health promotion evaluation: The development and validation of the evaluation practice analysis survey," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 76-83.
    2. Rubén Jesús Pérez-López & Jesús Everardo Olguín Tiznado & María Mojarro Magaña & Claudia Camargo Wilson & Juan Andrés López Barreras & Jorge Luis García-Alcaraz, 2019. "Information Sharing with ICT in Production Systems and Operational Performance," Sustainability, MDPI, vol. 11(13), pages 1-18, July.
    3. Schwarzman, Joanna & Bauman, Adrian & Gabbe, Belinda J. & Rissel, Chris & Shilton, Trevor & Smith, Ben J., 2022. "How practitioner, organisational and system-level factors act to influence health promotion evaluation capacity: Validation of a conceptual framework," Evaluation and Program Planning, Elsevier, vol. 91(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daigneault, Pierre-Marc, 2014. "Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: A systematic map," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 171-181.
    2. Yusa, Anna & Hynie, Michaela & Mitchell, Scott, 2016. "Utilization of internal evaluation results by community mental health organizations: Credibility in different forms," Evaluation and Program Planning, Elsevier, vol. 54(C), pages 11-18.
    3. Philip Stevens, 2005. "The job satisfaction of English academics and their intentions to quit academe," Labor and Demography 0512005, University Library of Munich, Germany.
    4. Stefan Schulenberg & Amanda Melton, 2010. "A Confirmatory Factor-Analytic Evaluation of the Purpose in Life Test: Preliminary Psychometric Support for a Replicable Two-Factor Model," Journal of Happiness Studies, Springer, vol. 11(1), pages 95-111, March.
    5. Agyeman, Stephen & Cheng, Lin, 2020. "Analysis of barriers to perceived service quality in Ghana: Students’ perspectives on bus mobility attributes," Transport Policy, Elsevier, vol. 99(C), pages 63-85.
    6. Biljana Popeska & Snezana Jovanova-Mitkovska & Ming-Kai Chin & Christopher R. Edginton & Magdalena Mo Ching Mok & Serjoza Gontarev, 2018. "Implementation of Brain Breaks ® in the Classroom and Effects on Attitudes toward Physical Activity in a Macedonian School Setting," IJERPH, MDPI, vol. 15(6), pages 1-18, May.
    7. GUO-FITOUSSI, Liang, 2013. "A Comparison of the Finite Sample Properties of Selection Rules of Factor Numbers in Large Datasets," MPRA Paper 50005, University Library of Munich, Germany.
    8. Andrea C Vial & Janine Bosak & Patrick C Flood & John F Dovidio, 2021. "Individual variation in role construal predicts responses to third-party biases in hiring contexts," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-28, February.
    9. Siwarit Pongsakornrungsilp & Pimlapas Pongsakornrungsilp & Theeranuch Pusaksrikit & Pimmada Wichasin & Vikas Kumar, 2021. "Co-Creating a Sustainable Regional Brand from Multiple Sub-Brands: The Andaman Tourism Cluster of Thailand," Sustainability, MDPI, vol. 13(16), pages 1-23, August.
    10. Bangyi Yan & Shiguang Ni & Xi Wang & Jin Liu & Qianjing Zhang & Kaiping Peng, 2020. "Using Virtual Reality to Validate the Chinese Version of the Independent Television Commission-Sense of Presence Inventory," SAGE Open, , vol. 10(2), pages 21582440209, May.
    11. Christoph, Inken B. & Roosen, Jutta & Bruhn, Maike, 2006. "Willingness to pay for genetically modified food and non-food products," 2006 Annual meeting, July 23-26, Long Beach, CA 21303, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    12. Louis Guttman, 1955. "A generalized simplex for factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 20(3), pages 173-192, September.
    13. Chetan Doddamani & M. Manoj, 2023. "Analysis of the influences of built environment measures on household car and motorcycle ownership decisions in Hubli-Dharwad cities," Transportation, Springer, vol. 50(1), pages 205-243, February.
    14. Marcin Chlebus, 2014. "One-day prediction of state of turbulence for financial instrument based on models for binary dependent variable," Ekonomia journal, Faculty of Economic Sciences, University of Warsaw, vol. 37.
    15. Nico Migenda & Ralf Möller & Wolfram Schenck, 2021. "Adaptive dimensionality reduction for neural network-based online principal component analysis," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-32, March.
    16. Faheem Ahmed & Luiz Fernando Capretz, 2011. "A business maturity model of software product line engineering," Information Systems Frontiers, Springer, vol. 13(4), pages 543-560, September.
    17. Libin Yang & William Rea & Alethea Rea, 2015. "How much diversification potential is there in a single market? Evidence from the Australian Stock Exchange," Working Papers in Economics 15/07, University of Canterbury, Department of Economics and Finance.
    18. Anos-Casero, Paloma & Udomsaph, Charles, 2009. "What drives firm productivity growth ?," Policy Research Working Paper Series 4841, The World Bank.
    19. Gerhard Derflinger, 1984. "A loss function for alpha factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 325-330, September.
    20. Taiki Yoshida & Yohei Otaka & Shin Kitamura & Kazuki Ushizawa & Masashi Kumagai & Yuto Kurihara & Jun Yaeda & Rieko Osu, 2022. "Development and validation of new evaluation scale for measuring stroke patients’ motivation for rehabilitation in rehabilitation wards," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-17, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:68:y:2018:i:c:p:166-175. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.