IDEAS home Printed from https://ideas.repec.org/a/eee/jobhdp/v158y2020icp66-79.html
   My bibliography  Save this article

Simplification and defaults affect adoption and impact of technology, but decision makers do not realize it

Author

Listed:
  • Bergman, Peter
  • Lasky-Fink, Jessica
  • Rogers, Todd

Abstract

A field experiment (N = 6976) examines how enrollment defaults affect adoption and impact of an education technology that sends weekly automated alerts on students’ academic progress to parents. We show that a standard (high-friction) opt-in process induces extremely low parent take-up (<1%), while a simplified process yields higher enrollment (11%). Yet, with such low take-up, both fail to improve average student achievement. Meanwhile, automatically enrolling parents increases take-up to 95% and improves student achievement as measured by GPA and course passing. The GPA of students whose parents were automatically enrolled increased by an average of 0.06 points, and one in four students did not fail a class they would have otherwise failed. Surveys show automatic enrollment is uncommon, and its impact is underestimated: District leaders overestimate take-up under standard opt-in processes by about 40 percentage points and underestimate take-up under automatic enrollment by 29 percentage points. After learning the actual take-up rates, district leaders report being willing to pay substantially more for the technology when implemented under automatic enrollment than by standard opt-in processes.

Suggested Citation

  • Bergman, Peter & Lasky-Fink, Jessica & Rogers, Todd, 2020. "Simplification and defaults affect adoption and impact of technology, but decision makers do not realize it," Organizational Behavior and Human Decision Processes, Elsevier, vol. 158(C), pages 66-79.
    • Handle: RePEc:eee:jobhdp:v:158:y:2020:i:c:p:66-79
    DOI: 10.1016/j.obhdp.2019.04.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0749597818306289
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.obhdp.2019.04.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. repec:mpr:mprres:7375 is not listed on IDEAS
    2. Darron Billeter & Ajay Kalra & George Loewenstein, 2011. "Underpredicting Learning after Initial Experience with a Product," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(5), pages 723-736.
    3. Petra E. Todd & Kenneth I. Wolpin, 2007. "The Production of Cognitive Achievement in Children: Home, School, and Racial Test Score Gaps," Journal of Human Capital, University of Chicago Press, vol. 1(1), pages 91-136.
    4. Jeffrey R. Kling & Sendhil Mullainathan & Eldar Shafir & Lee C. Vermeulen & Marian V. Wrobel, 2012. "Comparison Friction: Experimental Evidence from Medicare Drug Plans," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 199-235.
    5. Pascaline Dupas, 2014. "Short‐Run Subsidies and Long‐Run Adoption of New Health Products: Evidence From a Field Experiment," Econometrica, Econometric Society, vol. 82(1), pages 197-228, January.
    6. Bruns, Hendrik & Kantorowicz-Reznichenko, Elena & Klement, Katharina & Luistro Jonsson, Marijane & Rahali, Bilel, 2018. "Can nudges be transparent and yet effective?," Journal of Economic Psychology, Elsevier, vol. 65(C), pages 41-59.
    7. Kraft, Matthew A. & Rogers, Todd, 2015. "The underutilized potential of teacher-to-parent communication: Evidence from a field experiment," Economics of Education Review, Elsevier, vol. 47(C), pages 49-63.
    8. Justine S. Hastings & Jeffrey M. Weinstein, 2008. "Information, School Choice, and Academic Achievement: Evidence from Two Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(4), pages 1373-1414.
    9. Meredith Fowlie & Catherine Wolfram & C. Anna Spurlock & Annika Todd & Patrick Baylis & Peter Cappers, 2017. "Default Effects and Follow-On Behavior: Evidence from an Electricity Pricing Program," NBER Working Papers 23553, National Bureau of Economic Research, Inc.
    10. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    11. Hendrik Bruns & Elena Kantorowicz-Reznichenko & Katharina Klement & Marijane Luistro Jonsson & Bilel Rahali, 2018. "Can nudges be transparent and yet effective?," Post-Print hal-01824076, HAL.
    12. Stefano DellaVigna & Devin Pope, 2018. "What Motivates Effort? Evidence and Expert Forecasts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 1029-1069.
    13. Todd Rogers & Avi Feller, 2018. "Reducing student absences at scale by targeting parents’ misbeliefs," Nature Human Behaviour, Nature, vol. 2(5), pages 335-342, May.
    14. Nava Ashraf & James Berry & Jesse M. Shapiro, 2010. "Can Higher Prices Stimulate Product Use? Evidence from a Field Experiment in Zambia," American Economic Review, American Economic Association, vol. 100(5), pages 2383-2413, December.
    15. Maya Escueta & Vincent Quan & Andre Joshua Nickow & Philip Oreopoulos, 2017. "Education Technology: An Evidence-Based Review," NBER Working Papers 23744, National Bureau of Economic Research, Inc.
    16. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2012. "The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1205-1242.
    17. Rebecca Dizon-Ross, 2019. "Parents' Beliefs about Their Children's Academic Ability: Implications for Educational Investments," American Economic Review, American Economic Association, vol. 109(8), pages 2728-2765, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Samuel Berlinski & Matias Busso & Taryn Dinkelman & Claudia Martínez A., 2021. "Reducing Parent-School Information Gaps and Improving Education Outcomes: Evidence from High-Frequency Text Messages," NBER Working Papers 28581, National Bureau of Economic Research, Inc.
    2. Southwick, Daniel A. & Liu, Zhaoying V. & Baldwin, Chayce & Quirk, Abigail L. & Ungar, Lyle H. & Tsay, Chia-Jung & Duckworth, Angela L., 2023. "The trouble with talent: Semantic ambiguity in the workplace," Organizational Behavior and Human Decision Processes, Elsevier, vol. 174(C).
    3. Behlen, Lars & Himmler, Oliver & Jaeckle, Robert, 2022. "Can defaults change behavior when post-intervention effort is required? Evidence from education," MPRA Paper 112962, University Library of Munich, Germany.
    4. Wagner, Valentin, 2022. "Heterogeneous effects of grade framing," Labour Economics, Elsevier, vol. 74(C).
    5. Angelucci, Manuela & Bennett, Daniel M, 2022. "Depression, Pharmacotherapy, and the Demand for a Novel Health Product," IZA Discussion Papers 15832, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    2. Bergman, Peter & Rogers, Todd, 2017. "The Impact of Defaults on Technology Adoption, and Its Underappreciation by Pollicymakers," Working Paper Series rwp17-021, Harvard University, John F. Kennedy School of Government.
    3. Barrera-Osorio, Felipe & Gonzalez, Kathryn & Lagos, Francisco & Deming, David J., 2020. "Providing performance information in education: An experimental evaluation in Colombia," Journal of Public Economics, Elsevier, vol. 186(C).
    4. Ha Trong Nguyen & Huong Thu Le & Luke B Connelly, 2021. "Who's declining the “free lunch”? New evidence from the uptake of public child dental benefits," Health Economics, John Wiley & Sons, Ltd., vol. 30(2), pages 270-288, February.
    5. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    6. Kalena E. Cortes & Hans D.U. Fricke & Susanna Loeb & David S. Song & Benjamin N. York, 2019. "When Behavioral Barriers are Too High or Low – How Timing Matters for Parenting Interventions," NBER Working Papers 25964, National Bureau of Economic Research, Inc.
    7. Brigitte C. Madrian, 2014. "Applying Insights from Behavioral Economics to Policy Design," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 663-688, August.
    8. Justine Hastings & Christopher A. Neilson & Seth D. Zimmerman, 2015. "The Effects of Earnings Disclosure on College Enrollment Decisions," Working Papers 2015-1, Princeton University. Economics Department..
    9. Castleman, Benjamin L. & Patterson, Richard & Skimmyhorn, William, 2020. "Benefits left on the table: Evidence from the Servicemembers’ Civil Relief Act," Economics of Education Review, Elsevier, vol. 78(C).
    10. Peter Bergman, 2020. "Nudging Technology Use: Descriptive and Experimental Evidence from School Information Systems," Education Finance and Policy, MIT Press, vol. 15(4), pages 623-647, Fall.
    11. Damien de Walque & Christine Valente, 2023. "Incentivizing School Attendance in the Presence of Parent-Child Information Frictions," American Economic Journal: Economic Policy, American Economic Association, vol. 15(3), pages 256-285, August.
    12. Kalena E. Cortes & Hans Fricke & Susanna Loeb & David S. Song, 2018. "Too little or too much? Actionable Advice in an Early-Childhood Text Messaging Experiment," NBER Working Papers 24827, National Bureau of Economic Research, Inc.
    13. Castleman, Benjamin L. & Page, Lindsay C., 2015. "Summer nudging: Can personalized text messages and peer mentor outreach increase college going among low-income high school graduates?," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 144-160.
    14. Altmann, Steffen & Cairo, Sofie & Mahlstedt, Robert & Sebald, Alexander, 2022. "Do Job Seekers Understand the UI Benefit System (And Does It Matter)?," IZA Discussion Papers 15747, Institute of Labor Economics (IZA).
    15. Elisa Gambetti & Micaela Maria Zucchelli & Raffaella Nori & Fiorella Giusberti, 2022. "Default rules in investment decision-making: trait anxiety and decision-making styles," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-26, December.
    16. Cortes, Kalena E. & Fricke, Hans & Loeb, Susanna & Song, David S. & York, Benjamin N., 2023. "When behavioral barriers are too high or low – How timing matters for text-based parenting interventions," Economics of Education Review, Elsevier, vol. 92(C).
    17. Barrera-Osorio, Felipe & Gertler,Paul J. & Nakajima,Nozomi & Patrinos,Harry Anthony, 2020. "Promoting Parental Involvement in Schools : Evidence from Two Randomized Experiments," Policy Research Working Paper Series 9462, The World Bank.
    18. French, Robert & Oreopoulos, Philip, 2017. "Behavioral barriers transitioning to college," Labour Economics, Elsevier, vol. 47(C), pages 48-63.
    19. Doss, Christopher & Fricke, Hans & Loeb, Susanna & Doromal, Justin B., 2022. "Engaging girls in math: The unequal effects of text messaging to help parents support early math development," Economics of Education Review, Elsevier, vol. 88(C).
    20. Martin F. Koppensteiner & Jesse Matheson & Réka Plugor, 2019. "Understanding Access Barriers to Public Services: Lessons from a Randomized Domestic Violence Intervention," School of Economics Discussion Papers 1319, School of Economics, University of Surrey.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jobhdp:v:158:y:2020:i:c:p:66-79. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/obhdp .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.