IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v39y2015i3p283-307.html
   My bibliography  Save this article

Evaluating the Effectiveness of Website Content Features Using Retrospective Pretest Methodology

Author

Listed:
  • Christoph Emanuel Mueller

Abstract

Background and Objectives: In order to assess website content effectiveness (WCE), investigations have to be made into whether the reception of website contents leads to a change in the characteristics of website visitors or not. Because randomized controlled trials (RCTs) are not always the method of choice, researchers may have to follow other strategies such as using retrospective pretest methodology (RPM), a straightforward and easy-to-implement tool for estimating intervention effects. This article aims to introduce RPM in the context of website evaluation and test its viability under experimental conditions. Method: Building on the idea that RCTs deliver unbiased estimates of the true causal effects of website content reception, I compared the performance of RPM with that of an RCT within the same study. Hence, if RPM provides effect estimates similar to those of the RCT, it can be considered a viable tool for assessing the effectiveness of the website content features under study. Results and Conclusions: RPM was capable of delivering comparatively resilient estimates of the effects of a YouTube video and a text feature on knowledge and attitudes. With regard to all of the outcome variables considered, the differences between the sizes of the effects estimated by the RCT and RPM were not significant. Additionally, RPM delivered relatively accurate effect size estimates in most of the cases. Therefore, I conclude that RPM could be a viable alternative for assessing WCE in cases where RCTs are not the preferred method.

Suggested Citation

  • Christoph Emanuel Mueller, 2015. "Evaluating the Effectiveness of Website Content Features Using Retrospective Pretest Methodology," Evaluation Review, , vol. 39(3), pages 283-307, June.
    • Handle: RePEc:sae:evarev:v:39:y:2015:i:3:p:283-307
    DOI: 10.1177/0193841X15582142
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X15582142
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X15582142?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alexandra Resch & Jillian Berk & Lauren Akers, "undated". "Recognizing and Conducting Opportunistic Experiments in Education: A Guide for Policymakers and Researchers," Mathematica Policy Research Reports b58a999ab27a4cabafac5aa08, Mathematica Policy Research.
    2. repec:mpr:mprres:8126 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tan, Hwee Cheng, 2019. "Using a structured collaborative learning approach in a case-based management accounting course," Journal of Accounting Education, Elsevier, vol. 49(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jacqueline Kauff & Elizabeth Clary & Julia Lyskawa, "undated". "An Evaluation of SOAR: The Implementation and Outcomes of an Effort to Increase Access to SSI and SSDI," Mathematica Policy Research Reports c3d9cd951dbf484994fac60a4, Mathematica Policy Research.
    2. Alicia Meckstroth & Alexandra Resch & Jonathan McCay & Michelle Derr & Jillian Berk & Lauren Akers, "undated". "Advancing Evidence-Based Decision Making: A Toolkit on Recognizing and Conducting Opportunistic Experiments in the Family Self-Sufficiency and Stability Policy Area," Mathematica Policy Research Reports 1b4e98bbc73c4b6a80f6ba1c7, Mathematica Policy Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:39:y:2015:i:3:p:283-307. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.