IDEAS home Printed from https://ideas.repec.org/a/adr/anecst/y2022i147p3-50.html
   My bibliography  Save this article

Hit or Miss? Test Taking Behavior in Multiple Choice Exams

Author

Listed:
  • Pelin Akyol
  • James Key
  • Kala Krishna

Abstract

This paper is the first to structurally model how a test taker answers questions in a multiple choice exam. We allow for the possibility of a penalty for a wrong answer which makes risk averse examinees more likely to skip questions. Despite the lack of item response data, we can estimate the model by using the insight that skipping behavior, together with penalties for wrong answers, makes certain scores much more likely than others. Using data from the Turkish University Entrance Exam, we estimate the model and find that candidates' attitudes towards risk differ according to their gender and ability with females and those with high ability being significantly more risk-averse. However, the impact of differences in risk aversion on scores is small. As a result, a higher guessing penalty increases the precision of the exam, and does so with a minimal impact on gender bias.

Suggested Citation

  • Pelin Akyol & James Key & Kala Krishna, 2022. "Hit or Miss? Test Taking Behavior in Multiple Choice Exams," Annals of Economics and Statistics, GENES, issue 147, pages 3-50.
    • Handle: RePEc:adr:anecst:y:2022:i:147:p:3-50
    DOI: https://doi.org/10.2307/48684785
    as

    Download full text from publisher

    File URL: https://www.jstor.org/stable/48684785
    Download Restriction: no
    File URL: https://libkey.io/https://doi.org/10.2307/48684785?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    3. Eckel, Catherine C. & Grossman, Philip J., 2008. "Men, Women and Risk Aversion: Experimental Evidence," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.), Handbook of Experimental Economics Results, edition 1, volume 1, chapter 113, pages 1061-1073, Elsevier.
    4. María Paz Espinosa & Javier Gardeazabal, 2013. "Do Students Behave Rationally in Multiple Choice Tests? Evidence from a Field Experiment," Journal of Economics and Management, College of Business, Feng Chia University, Taiwan, vol. 9(2), pages 107-135, July.
    5. Albert Burgos, 2004. "Guessing and gambling," Economics Bulletin, AccessEcon, vol. 4(4), pages 1-10.
    6. Pekkarinen, Tuomas, 2014. "Gender Differences in Strategic Behaviour under Competitive Pressure: Evidence on Omission Patterns in University Entrance Examinations," IZA Discussion Papers 8018, Institute of Labor Economics (IZA).
    7. repec:ebl:ecbull:v:4:y:2004:i:4:p:1-10 is not listed on IDEAS
    8. Gourieroux, Christian & Monfort, Alain, 1997. "Simulation-based Econometric Methods," OUP Catalogue, Oxford University Press, number 9780198774754.
    9. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Riener, Gerhard & Wagner, Valentin, 2017. "Shying away from demanding tasks? Experimental evidence on gender differences in answering multiple-choice questions," Economics of Education Review, Elsevier, vol. 59(C), pages 43-62.
    2. J. Ignacio Conde-Ruiz & Juan José Ganuza & Manuel García, 2020. "Gender Gap and Multiple Choice Exams in Public Selection Processes," Hacienda Pública Española / Review of Public Economics, IEF, vol. 235(4), pages 11-28, December.
    3. Graetz, Georg & Karimi, Arizo, 2019. "Explaining gender gap variation across assessment forms," Working Paper Series 2019:8, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    4. Heiko Karle & Dirk Engelmann & Martin Peitz, 2022. "Student performance and loss aversion," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(2), pages 420-456, April.
    5. Iriberri, Nagore & Rey-Biel, Pedro, 2021. "Brave boys and play-it-safe girls: Gender differences in willingness to guess in a large scale natural field experiment," European Economic Review, Elsevier, vol. 131(C).
    6. Montolio, Daniel & Taberner, Pere A., 2021. "Gender differences under test pressure and their impact on academic performance: A quasi-experimental design," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 1065-1090.
    7. Jef Vanderoost & Rianne Janssen & Jan Eggermont & Riet Callens & Tinne De Laet, 2018. "Elimination testing with adapted scoring reduces guessing and anxiety in multiple-choice assessments, but does not increase grade average in comparison with negative marking," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-27, October.
    8. Alexis DIRER, 2020. "Efficient scoring of multiple-choice tests," LEO Working Papers / DR LEO 2752, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    9. Anaya, Lina & Iriberri, Nagore & Rey-Biel, Pedro & Zamarro, Gema, 2022. "Understanding performance in test taking: The role of question difficulty order," Economics of Education Review, Elsevier, vol. 90(C).
    10. Maddalena Davoli, 2023. "A, B, or C? Question Format and the Gender Gap in Financial Literacy," Economics of Education Working Paper Series 0206, University of Zurich, Department of Business Administration (IBW).
    11. Saygin, Perihan O. & Atwater, Ann, 2021. "Gender differences in leaving questions blank on high-stakes standardized tests," Economics of Education Review, Elsevier, vol. 84(C).
    12. Graetz, Georg & Karimi, Arizo, 2022. "Gender gap variation across assessment types: Explanations and implications," Economics of Education Review, Elsevier, vol. 91(C).
    13. Claire Duquennois, 2022. "Fictional Money, Real Costs: Impacts of Financial Salience on Disadvantaged Students," American Economic Review, American Economic Association, vol. 112(3), pages 798-826, March.
    14. Pau Balart & Lara Ezquerra & Iñigo Hernandez-Arenaz, 2022. "Framing effects on risk-taking behavior: evidence from a field experiment in multiple-choice tests," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1268-1297, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Iriberri, Nagore & Rey-Biel, Pedro, 2021. "Brave boys and play-it-safe girls: Gender differences in willingness to guess in a large scale natural field experiment," European Economic Review, Elsevier, vol. 131(C).
    2. Pau Balart & Lara Ezquerra & Iñigo Hernandez-Arenaz, 2022. "Framing effects on risk-taking behavior: evidence from a field experiment in multiple-choice tests," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1268-1297, September.
    3. Caliendo, Marco & Lee, Wang-Sheng & Mahlstedt, Robert, 2017. "The gender wage gap and the role of reservation wages: New evidence for unemployed workers," Journal of Economic Behavior & Organization, Elsevier, vol. 136(C), pages 161-173.
    4. Alexander Tsyplakov, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models (in Russian)," Quantile, Quantile, issue 8, pages 69-122, July.
    5. Tsyplakov, Alexander, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models," MPRA Paper 25511, University Library of Munich, Germany.
    6. Saygin, Perihan O. & Atwater, Ann, 2021. "Gender differences in leaving questions blank on high-stakes standardized tests," Economics of Education Review, Elsevier, vol. 84(C).
    7. Boggio, Cecilia & Coda Moscarola, Flavia & Gallice, Andrea, 2020. "What is good for the goose is good for the gander?," Economics of Education Review, Elsevier, vol. 75(C).
    8. Marie-Laure Cabon-Dhersin & Nathalie Etchart-Vincent, 2013. "Cooperation: The Power Of A Single Word? Some Experimental Evidence On Wording And Gender Effects In A Game Of Chicken," Bulletin of Economic Research, Wiley Blackwell, vol. 65(1), pages 43-64, January.
    9. Paolo Crosetto & Antonio Filippin, 2013. "The “bomb” risk elicitation task," Journal of Risk and Uncertainty, Springer, vol. 47(1), pages 31-65, August.
    10. Hansen, Lars Peter & Heaton, John & Luttmer, Erzo G J, 1995. "Econometric Evaluation of Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 8(2), pages 237-274.
    11. Ludwig, Sandra & Fellner-Röhling, Gerlinde & Thoma, Carmen, 2017. "Do women have more shame than men? An experiment on self-assessment and the shame of overestimating oneself," European Economic Review, Elsevier, vol. 92(C), pages 31-46.
    12. Ertac, Seda & Gurdal, Mehmet Y., 2012. "Deciding to decide: Gender, leadership and risk-taking in groups," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 24-30.
    13. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2018. "Gender & Collaboration," Working Papers 856, Queen Mary University of London, School of Economics and Finance.
    14. Clements, Kenneth W. & Fry, Renée, 2008. "Commodity currencies and currency commodities," Resources Policy, Elsevier, vol. 33(2), pages 55-73, June.
    15. Béatrice Boulu-Reshef & Constance Monnier-Schlumberger, 2019. "Lutte contre les cartels : comment dissuader les têtes brûlées ?," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 1187-1199.
    16. Ruge-Murcia, Francisco, 2012. "Estimating nonlinear DSGE models by the simulated method of moments: With an application to business cycles," Journal of Economic Dynamics and Control, Elsevier, vol. 36(6), pages 914-938.
    17. Oege Dijk, 2017. "For whom does social comparison induce risk-taking?," Theory and Decision, Springer, vol. 82(4), pages 519-541, April.
    18. Josep Amer-Mestre and Agnès Charpin, 2022. "Gender Differences in Early Occupational Choices: Evidence from Medical Specialty Selection," Economics Working Papers EUI ECO 2022/01, European University Institute.
    19. Müge Süer, 2023. "Are Women in Science Less Ambitious than Men? Experimental Evidence on the Role of Gender and STEM in Promotion Applications," Rationality and Competition Discussion Paper Series 483, CRC TRR 190 Rationality and Competition.
    20. Eva Ranehill & Roberto A. Weber, 2022. "Gender preference gaps and voting for redistribution," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 845-875, June.

    More about this item

    Keywords

    Multiple-Choice Exams; Guessing Penalty; Risk Aversion;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • D61 - Microeconomics - - Welfare Economics - - - Allocative Efficiency; Cost-Benefit Analysis
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:adr:anecst:y:2022:i:147:p:3-50. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General or Laurent Linnemer (email available below). General contact details of provider: https://edirc.repec.org/data/ensaefr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.