Quality and rigor of the concept mapping methodology: A pooled study analysis
AbstractThe use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal Evaluation and Program Planning.
Volume (Year): 35 (2012)
Issue (Month): 2 ()
Contact details of provider:
Web page: http://www.elsevier.com/locate/evalprogplan
Concept mapping; Pooled analysis; Quality; Benchmarking; Validity; Reliability;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Keith, Douglas, 1989. "Refining concept maps: Methodological issues and an example," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 75-80, January.
- Joanna Sale & Lynne Lohfeld & Kevin Brazil, 2002. "Revisiting the Quantitative-Qualitative Debate: Implications for Mixed-Methods Research," Quality & Quantity: International Journal of Methodology, Springer, vol. 36(1), pages 43-53, February.
- Trochim, William M. K., 1989. "Concept mapping : Soft science or hard art?," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 87-110, January.
- Joanna Sale & Kevin Brazil, 2004. "A Strategy to Identify Critical Appraisal Criteria for Primary Mixed-Method Studies," Quality & Quantity: International Journal of Methodology, Springer, vol. 38(4), pages 351-365, August.
- Dumont, Jeanne, 1989. "Validity of multidimensional scaling in the context of structured conceptualization," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 81-86, January.
- J. Kruskal, 1964. "Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis," Psychometrika, Springer, vol. 29(1), pages 1-27, March.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.