IDEAS home Printed from https://ideas.repec.org/a/sae/jocore/v50y2006i5p757-776.html
   My bibliography  Save this article

Can We Generalize from Student Experiments to the Real World in Political Science, Military Affairs, and International Relations?

Author

Listed:
  • Alex Mintz

    (Department of Political Science, Texas A&M University, Interdisciplinary Center-Herzliya, Israel)

  • Steven B. Redd

    (Department of Political Science, University of Wisconsin-Milwaukee)

  • Arnold Vedlitz

    (Institute for Science, Technology and Public Policy, George Bush School of Government and Public Service, Texas A&M University)

Abstract

The authors conducted an experiment with a group of military officers and replicated it with a group of students at a public university in the United States. The experimental scenario dealt with a decision problem in the area of counterterrorism. The authors found that while more than one-third of students recommended doing nothing, the overwhelming majority of military officers (more than 90 percent) recommended doing something. Also, military officers exhibited less maximizing and more satisfacing decision making than students. The results show that relying on experiments with students “playing†the role of real-world national security policy makers may bias the results. The two groups are, in fact, very different. Based on student samples, it is possible to accept propositions that would not be found with samples of elite decision makers and reject propositions that may be right. However, it is possible that students can be assigned to experiments where they represent the “public†and not elites.

Suggested Citation

  • Alex Mintz & Steven B. Redd & Arnold Vedlitz, 2006. "Can We Generalize from Student Experiments to the Real World in Political Science, Military Affairs, and International Relations?," Journal of Conflict Resolution, Peace Science Society (International), vol. 50(5), pages 757-776, October.
    • Handle: RePEc:sae:jocore:v:50:y:2006:i:5:p:757-776
    DOI: 10.1177/0022002706291052
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0022002706291052
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0022002706291052?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Herbert A. Simon, 1955. "A Behavioral Model of Rational Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 69(1), pages 99-118.
    2. Forsythe, Robert & Forrest Nelson & George R. Neumann & Jack Wright, 1992. "Anatomy of an Experimental Political Stock Market," American Economic Review, American Economic Association, vol. 82(5), pages 1142-1161, December.
    3. Mintz, Alex & Geva, Nehemia & Redd, Steven B. & Carnes, Amy, 1997. "The Effect of Dynamic and Static Choice Sets on Political Decision Making: An Analysis Using the Decision Board Platform," American Political Science Review, Cambridge University Press, vol. 91(3), pages 553-566, September.
    4. Frisch, Deborah, 1993. "Reasons for Framing Effects," Organizational Behavior and Human Decision Processes, Elsevier, vol. 54(3), pages 399-429, April.
    5. Rose McDermott & Jonathan A. Cowden, 2001. "The effects of uncertainty and sex in a crisis simulation game," International Interactions, Taylor & Francis Journals, vol. 27(4), pages 353-380, June.
    6. Palfrey, Thomas R. & Rosenthal, Howard, 1985. "Voter Participation and Strategic Uncertainty," American Political Science Review, Cambridge University Press, vol. 79(1), pages 62-78, March.
    7. Ford, J. Kevin & Schmitt, Neal & Schechtman, Susan L. & Hults, Brian M. & Doherty, Mary L., 1989. "Process tracing methods: Contributions, problems, and neglected research questions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(1), pages 75-117, February.
    8. McDermott, Rose, 2002. "Experimental Methodology in Political Science," Political Analysis, Cambridge University Press, vol. 10(4), pages 325-342.
    9. Ostrom, Charles W. & Job, Brian L., 1986. "The President and the Political Use of Force," American Political Science Review, Cambridge University Press, vol. 80(2), pages 541-566, June.
    10. Billings, Robert S. & Scherer, Lisa L., 1988. "The effects of response mode and importance on decision-making strategies: Judgment versus choice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 41(1), pages 1-19, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Iain Hardie & Dominic Johnson & Dominic Tierney, 2011. "Psychological Aspects of War," Chapters, in: Christopher J. Coyne & Rachel L. Mathers (ed.), The Handbook on the Political Economy of War, chapter 5, Edward Elgar Publishing.
    2. Sean Nicholson-Crotty & Jill Nicholson-Crotty & Sean Webeck, 2019. "Are public managers more risk averse? Framing effects and status quo bias across the sectors," Journal of Behavioral Public Administration, Center for Experimental and Behavioral Public Administration, vol. 2(1).
    3. A. Burcu Bayram & Erin R. Graham, 2017. "Financing the United Nations: Explaining variation in how donors provide funding to the UN," The Review of International Organizations, Springer, vol. 12(3), pages 421-459, September.
    4. Heidi Hardt, 2018. "Who matters for memory: Sources of institutional memory in international organization crisis management," The Review of International Organizations, Springer, vol. 13(3), pages 457-482, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven B. Redd, 2002. "The Influence of Advisers on Foreign Policy Decision Making," Journal of Conflict Resolution, Peace Science Society (International), vol. 46(3), pages 335-364, June.
    2. Alex Mintz, 2004. "Foreign Policy Decision Making in Familiar and Unfamiliar Settings," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 91-104, February.
    3. Carlson, Kurt A. & Guha, Abhijit, 2011. "Leader-focused search: The impact of an emerging preference on information search," Organizational Behavior and Human Decision Processes, Elsevier, vol. 115(1), pages 133-141, May.
    4. Costel Andonie & Daniel Diermeier, 2022. "Electoral Institutions with impressionable voters," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 59(3), pages 683-733, October.
    5. Alex Mintz, 2004. "How Do Leaders Make Decisions?," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 3-13, February.
    6. Eben J. Christensen & Steven B. Redd, 2004. "Bureaucrats Versus the Ballot Box in Foreign Policy Decision Making," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 69-90, February.
    7. Hámori, Balázs, 2003. "Kísérletek és kilátások Daniel Kahneman [Experiments and prospects - in connection with Daniel Kahneman’s Nobel Prize]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(9), pages 779-799.
    8. Zuschke, Nick, 2020. "The impact of task complexity and task motivation on in-store marketing effectiveness: An eye tracking analysis," Journal of Business Research, Elsevier, vol. 116(C), pages 337-350.
    9. Mark Heitmann & Andreas Herrmann & Christian Kaiser, 2007. "The effect of product variety on purchase probability," Review of Managerial Science, Springer, vol. 1(2), pages 111-131, August.
    10. Macintosh, Gerrard & Gentry, James W., 1995. "Cognitive process differences between discrete and relational exchange," International Business Review, Elsevier, vol. 4(4), pages 435-446.
    11. Nehemia Geva & James Mayhar & J. Mark Skorick, 2000. "The Cognitive Calculus of Foreign Policy Decision Making," Journal of Conflict Resolution, Peace Science Society (International), vol. 44(4), pages 447-471, August.
    12. repec:cup:judgdm:v:4:y:2009:i:3:p:200-213 is not listed on IDEAS
    13. Gilliland, Stephen W. & Benson, Lehman & Schepers, Donald H., 1998. "A Rejection Threshold in Justice Evaluations: Effects on Judgment and Decision-Making, , ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 76(2), pages 113-131, November.
    14. Hedesstrom, Ted Martin & Svedsater, Henrik & Garling, Tommy, 2007. "Determinants of the use of heuristic choice rules in the Swedish Premium Pension Scheme: An Internet-based survey," Journal of Economic Psychology, Elsevier, vol. 28(1), pages 113-126, January.
    15. Sebastian Garmann, 2020. "Political efficacy and the persistence of turnout shocks," Economics and Politics, Wiley Blackwell, vol. 32(3), pages 411-429, November.
    16. Huizenga, Hilde M. & Wetzels, Ruud & van Ravenzwaaij, Don & Wagenmakers, Eric-Jan, 2012. "Four empirical tests of Unconscious Thought Theory," Organizational Behavior and Human Decision Processes, Elsevier, vol. 117(2), pages 332-340.
    17. Karl DeRouen Jr. & Christopher Sprecher, 2004. "Initial Crisis Reaction and Poliheuristic Theory," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 56-68, February.
    18. Jonathan W. Keller & Yi Edward Yang, 2008. "Leadership Style, Decision Context, and the Poliheuristic Theory of Decision Making: An Experimental Analysis," Journal of Conflict Resolution, Peace Science Society (International), vol. 52(5), pages 687-712, October.
    19. Karaliopoulos, Merkouris & Katsikopoulos, Konstantinos & Lambrinos, Lambros, 2017. "Bounded rationality can make parking search more efficient: The power of lexicographic heuristics," Transportation Research Part B: Methodological, Elsevier, vol. 101(C), pages 28-50.
    20. Yulian Ding & Michele M. Veeman & Wiktor L. Adamowicz, 2012. "The influence of attribute cutoffs on consumers' choices of a functional food," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 39(5), pages 745-769, December.
    21. Alex Mintz, 1993. "The Decision to Attack Iraq," Journal of Conflict Resolution, Peace Science Society (International), vol. 37(4), pages 595-618, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jocore:v:50:y:2006:i:5:p:757-776. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://pss.la.psu.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.