IDEAS home Printed from https://ideas.repec.org/a/spr/reihed/v60y2019i6d10.1007_s11162-018-9536-9.html
   My bibliography  Save this article

Knowing is Half the Battle, or Is It? A Randomized Experiment of the Impact of Supplemental Notification Letters on Placement Exam Participation, Preparation, and Performance

Author

Listed:
  • Brian G. Moss

    (Wayne State University)

  • Peter Riley Bahr

    (University of Michigan)

  • Leigh Arsenault

    (University of Michigan)

  • Meghan Oster

    (University of Michigan)

Abstract

Community college students often are unaware of the stakes involved in their performance on placement exams, used to sort the students into their first math and English courses. In our randomized experiment of approximately 13,000 newly admitted community college students, we test whether informing students, via a supplemental notification letter, about the implications of placement exam scores influences their placement exam participation, preparation, and performance. We also test whether message framing (loss-framed vs. gain-framed) alters the effect of the information on study outcomes. We find that neither type of message has an effect on placement exam preparation or performance. We find limited evidence to suggest that the loss-framed message may have a small effect on the avoidance of placement exams by increasing the likelihood of students’ submitting alternative evidence of academic preparation. Overall, our evidence suggests that students’ prior knowledge about the ramifications of placement exams is not enough to improve performance. Colleges should consider alternative means of assessing college readiness, such as measures of high school achievement, and should provide students who still have to take placement exams with detailed information about test content and study materials before testing.

Suggested Citation

  • Brian G. Moss & Peter Riley Bahr & Leigh Arsenault & Meghan Oster, 2019. "Knowing is Half the Battle, or Is It? A Randomized Experiment of the Impact of Supplemental Notification Letters on Placement Exam Participation, Preparation, and Performance," Research in Higher Education, Springer;Association for Institutional Research, vol. 60(6), pages 737-759, September.
    • Handle: RePEc:spr:reihed:v:60:y:2019:i:6:d:10.1007_s11162-018-9536-9
    DOI: 10.1007/s11162-018-9536-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11162-018-9536-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11162-018-9536-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Brian G. Moss & William H. Yeaton, 2013. "Evaluating Effects of Developmental Education for College Students Using a Regression Discontinuity Design," Evaluation Review, , vol. 37(5), pages 370-404, October.
    2. Paul Attewell & David Lavin & Thurston Domina & Tania Levey, 2006. "New Evidence on College Remediation," The Journal of Higher Education, Taylor & Francis Journals, vol. 77(5), pages 886-924, September.
    3. Barry I. Graubard & Edward L. Korn, 1999. "Predictive Margins with Survey Data," Biometrics, The International Biometric Society, vol. 55(2), pages 652-659, June.
    4. Bailey, Thomas & Jeong, Dong Wook & Cho, Sung-Woo, 2010. "Referral, enrollment, and completion in developmental education sequences in community colleges," Economics of Education Review, Elsevier, vol. 29(2), pages 255-270, April.
    5. Levin, Irwin P & Gaeth, Gary J, 1988. "How Consumers Are Affected by the Framing of Attribute Information before and after Consuming the Product," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 15(3), pages 374-378, December.
    6. Herbert A. Simon, 1991. "Bounded Rationality and Organizational Learning," Organization Science, INFORMS, vol. 2(1), pages 125-134, February.
    7. Grewal, Dhruv & Gotlieb, Jerry & Marmorstein, Howard, 1994. "The Moderating Effects of Message Framing and," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 21(1), pages 145-153, June.
    8. Tversky, Amos & Kahneman, Daniel, 1986. "Rational Choice and the Framing of Decisions," The Journal of Business, University of Chicago Press, vol. 59(4), pages 251-278, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giuseppe Pernagallo & Benedetto Torrisi, 2020. "A theory of information overload applied to perfectly efficient financial markets," Review of Behavioral Finance, Emerald Group Publishing Limited, vol. 14(2), pages 223-236, October.
    2. Dan K. Hsu & Johan Wiklund & Richard D. Cotton, 2017. "Success, Failure, and Entrepreneurial Reentry: An Experimental Assessment of the Veracity of Self–Efficacy and Prospect Theory," Entrepreneurship Theory and Practice, , vol. 41(1), pages 19-47, January.
    3. Tomáš Frömmel, 2017. "The Rational Expectations Hypothesis: Theoretical Critique," E-LOGOS, Prague University of Economics and Business, vol. 2017(2), pages 4-12.
    4. Kuhberger, Anton, 1998. "The Influence of Framing on Risky Decisions: A Meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 75(1), pages 23-55, July.
    5. Christine G. Mokher & Toby J. Park-Gaghan & Shouping Hu, 2021. "What Happens to Efficiency and Equity? The Cost Implications of Developmental Education Reform," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(2), pages 151-174, March.
    6. Van de Velde, Liesbeth & Verbeke, Wim & Popp, Michael & Van Huylenbroeck, Guido, 2010. "The importance of message framing for providing information about sustainability and environmental aspects of energy," Energy Policy, Elsevier, vol. 38(10), pages 5541-5549, October.
    7. Martine Séville, 2008. "Habitude, cognition et actions des dirigeants," Revue Finance Contrôle Stratégie, revues.org, vol. 11(2), pages 51-78, June.
    8. Euis Soliha & Suzy Widyasari, 2018. "Message Framing and Source Credibility in Product Advertisements with High Consumer Involvement," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 3), pages 413-422.
    9. Daniele SCHILIRÒ, 2013. "Bounded Rationality: Psychology, Economics And The Financial Crises," Theoretical and Practical Research in the Economic Fields, ASERS Publishing, vol. 4(1), pages 97-108.
    10. Federick Ngo, 2019. "Fractions in College: How Basic Math Remediation Impacts Community College Students," Research in Higher Education, Springer;Association for Institutional Research, vol. 60(4), pages 485-520, June.
    11. Robert C. Bird & Vivek Soundararajan, 2020. "The Role of Precontractual Signals in Creating Sustainable Global Supply Chains," Journal of Business Ethics, Springer, vol. 164(1), pages 81-94, June.
    12. Martin Baekgaard & Nicola Belle & Søren Serritzlew & Mariafrancesca Sicilia & Ileana Steccolini, 2019. "Performance information in politics: How framing, format, and rhetoric matter to politicians’ preferences," Journal of Behavioral Public Administration, Center for Experimental and Behavioral Public Administration, vol. 2(2).
    13. Giovanni Gavetti & Jan W. Rivkin, 2007. "On the Origin of Strategy: Action and Cognition over Time," Organization Science, INFORMS, vol. 18(3), pages 420-439, June.
    14. van Buiten, Marc & Keren, Gideon, 2009. "Speaker-listener incompatibility: Joint and separate processing in risky choice framing," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(1), pages 106-115, January.
    15. Walrave, Bob & Gilsing, Victor A., 2023. "Game of skill or game of luck? Distant search in response to performance feedback," Technovation, Elsevier, vol. 121(C).
    16. Hodara, Michelle & Xu, Di, 2018. "Are two subjects better than one? The effects of developmental English courses on language minority and native English-speaking students’ community college outcomes," Economics of Education Review, Elsevier, vol. 66(C), pages 1-13.
    17. Mark J Hurlstone & Stephan Lewandowsky & Ben R Newell & Brittany Sewell, 2014. "The Effect of Framing and Normative Messages in Building Support for Climate Policies," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-19, December.
    18. Daniele Schilirò, 2012. "Bounded Rationality And Perfect Rationality: Psychology Into Economics," Theoretical and Practical Research in the Economic Fields, ASERS Publishing, vol. 3(2), pages 99-108.
    19. Berger, Paul D & Smith, Gerald E, 1998. "The Impact of Prospect Theory Based Framing Tactics on Advertising Effectiveness," Omega, Elsevier, vol. 26(5), pages 593-609, October.
    20. Pei Hu & Christine G. Mokher & Kai Zhao & Toby J. Park-Gaghan & Shouping Hu, 2023. "Has a U.S. Developmental Education Reform for Academically Underprepared Students Affected College Enrollment?," SAGE Open, , vol. 13(4), pages 21582440231, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reihed:v:60:y:2019:i:6:d:10.1007_s11162-018-9536-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.