IDEAS home Printed from https://ideas.repec.org/a/spr/jesaex/v2y2016i2d10.1007_s40881-016-0028-4.html
   My bibliography  Save this article

Simulating power of economic experiments: the powerBBK package

Author

Listed:
  • Charles Bellemare

    (Laval University)

  • Luc Bissonnette

    (Laval University)

  • Sabine Kröger

    (Laval University)

Abstract

In this article, we highlight how simulation methods can be used to analyze power of economic experiments. We provide the powerBBK package programmed for experimental economists, that can be used to perform simulations in STATA. Power can be simulated using a single command line for various statistical tests (nonparametric and parametric), estimation methods (linear, binary, and censored regression models), treatment variables (binary, continuous, time-invariant or time varying), sample sizes, experimental periods, and other design features (within or between-subjects design). The package can be used to predict minimum sample sizes required to reach a user-specific level of power, to maximize power of a design given the researcher supplied a budget constraint, or to compute power to detect a user-specified treatment order effect in within-subjects designs. The package can also be used to compute the probability of sign errors—the probability of rejecting the null hypothesis in the wrong direction as well as the share of rejections pointing in the wrong direction. The powerBBK package is provided as an .ado file along with a help file, both of which can be downloaded here ( http://www.bbktools.org ).

Suggested Citation

  • Charles Bellemare & Luc Bissonnette & Sabine Kröger, 2016. "Simulating power of economic experiments: the powerBBK package," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 2(2), pages 157-168, November.
    • Handle: RePEc:spr:jesaex:v:2:y:2016:i:2:d:10.1007_s40881-016-0028-4
    DOI: 10.1007/s40881-016-0028-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40881-016-0028-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40881-016-0028-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 439-457, November.
    2. Bellemare, Charles & Shearer, Bruce, 2009. "Gift giving and worker productivity: Evidence from a firm-level experiment," Games and Economic Behavior, Elsevier, vol. 67(1), pages 233-244, September.
    3. Uri Gneezy & John A List, 2006. "Putting Behavioral Economics to Work: Testing for Gift Exchange in Labor Markets Using Field Experiments," Econometrica, Econometric Society, vol. 74(5), pages 1365-1384, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Czibor, Eszter & Onderstal, Sander & Sloof, Randolph & van Praag, C. Mirjam, 2020. "Does relative grading help male students? Evidence from a field experiment in the classroom," Economics of Education Review, Elsevier, vol. 75(C).
    2. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    3. Kathryn N. Vasilaky & J. Michelle Brock, 2020. "Power(ful) guidelines for experimental economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 189-212, December.
    4. Leah H. Palm-Forster & Paul J. Ferraro & Nicholas Janusch & Christian A. Vossler & Kent D. Messer, 2019. "Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 719-742, July.
    5. Heggedal, Tom-Reiel & Helland, Leif & Morton, Rebecca, 2022. "Can paying politicians well reduce corruption? The effects of wages and uncertainty on electoral competition," Games and Economic Behavior, Elsevier, vol. 135(C), pages 60-73.
    6. Castro, Massimo Finocchiaro & Ferrara, Paolo Lorenzo & Guccio, Calogero & Lisi, Domenico, 2019. "Medical malpractice liability and physicians’ behavior: Experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 646-666.
    7. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2019. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics," Research Memorandum 029, Maastricht University, Graduate School of Business and Economics (GSBE).
    8. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    9. Thibaut Arpinon & Romain Espinosa, 2023. "A practical guide to Registered Reports for economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 9(1), pages 90-122, June.
    10. Heggedal, Tom-Reiel & Helland, Leif & Neset Joslin, Knut-Eric, 2018. "Should I Stay or should I Go? Bandwagons in the lab," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 86-97.
    11. Vladasel, Theodor & Parker, Simon C. & Sloof, Randolph & van Praag, Mirjam C., 2022. "Revenue Drift, Incentives, and Effort Allocation in Social Enterprises," IZA Discussion Papers 15716, Institute of Labor Economics (IZA).
    12. Thibaut Arpinon & Romain Espinosa, 2023. "A Practical Guide to Registered Reports for Economists," Post-Print halshs-03897719, HAL.
    13. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2021. "Editorial favoritism in the field of laboratory experimental economics (RM/20/014-revised-)," Research Memorandum 005, Maastricht University, Graduate School of Business and Economics (GSBE).
    14. Nickolas Gagnon & Riccardo D. Saulle & Henrik W. Zaunbrecher, 2021. "Decreasing Incomes Increase Selfishness," Papers 2107.02888, arXiv.org.
    15. Zaunbrecher, Henrik & Gagnon, Nickolas, 2020. "Declining Wages Increase Selfish Redistribution in an Environment with Fixed Income Inequality," Research Memorandum 023, Maastricht University, Graduate School of Business and Economics (GSBE).
    16. Heggedal, Tom-Reiel & Helland, Leif & Våge Knutsen, Magnus, 2022. "The power of outside options in the presence of obstinate types," Games and Economic Behavior, Elsevier, vol. 136(C), pages 454-468.
    17. Liu, Zhaoyang & Banerjee, Simanti & Cason, Timothy N. & Hanley, Nick & Liu, Qi & Xu, Jintao & Kontoleon, Andreas, 2023. "Spatially Coordinated Conservation Auctions: A Framed Field Experiment Focusing on Farmland Wildlife Conservation in China," 97th Annual Conference, March 27-29, 2023, Warwick University, Coventry, UK 334572, Agricultural Economics Society - AES.
    18. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," GREDEG Working Papers 2017-20, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    19. Iavor Bojinov & Ashesh Rambachan & Neil Shephard, 2021. "Panel experiments and dynamic causal effects: A finite population perspective," Quantitative Economics, Econometric Society, vol. 12(4), pages 1171-1196, November.
    20. Nicolas Vallois & Dorian Jullien, 2018. "A history of statistical methods in experimental economics," The European Journal of the History of Economic Thought, Taylor & Francis Journals, vol. 25(6), pages 1455-1492, November.
    21. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    22. Sebastian Jobjörnsson & Henning Schaak & Oliver Musshoff & Tim Friede, 2023. "Improving the statistical power of economic experiments using adaptive designs," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 357-382, April.
    23. Veronica Rattini, 2023. "Worker autonomy and performance: Evidence from a real‐effort experiment," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 32(2), pages 300-327, April.
    24. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," Working Papers halshs-01651070, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charles Bellemare & Luc Bissonnette & Sabine Kröger, 2014. "Statistical Power of Within and Between-Subjects Designs in Economic Experiments," CESifo Working Paper Series 5055, CESifo.
    2. da Silveira, Jaylson Jair & Lima, Gilberto Tadeu, 2021. "Wage inequality as a source of endogenous macroeconomic fluctuations," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 35-52.
    3. Faralla, Valeria & Borà, Guido & Innocenti, Alessandro & Novarese, Marco, 2020. "Promises in group decision making," Research in Economics, Elsevier, vol. 74(1), pages 1-11.
    4. Elliott Ash & W. Bentley MacLeod, 2015. "Intrinsic Motivation in Public Service: Theory and Evidence from State Supreme Courts," Journal of Law and Economics, University of Chicago Press, vol. 58(4).
    5. Omar Al-Ubaydli & John A. List, 2019. "How natural field experiments have enhanced our understanding of unemployment," Nature Human Behaviour, Nature, vol. 3(1), pages 33-39, January.
    6. Sliwka, Dirk & Werner, Peter, 2016. "How Do Agents React to Dynamic Wage Increases? An Experimental Study," IZA Discussion Papers 9855, Institute of Labor Economics (IZA).
    7. Craig Landry & Andreas Lange & John List & Michael Price & Nicholas Rupp, 2011. "Is There a 'Hidden Cost of Control' in Naturally-Occurring Markets? Evidence from a Natural Field Experiment," Natural Field Experiments 00593, The Field Experiments Website.
    8. Bogliacino, Francesco & Grimalda, Gianluca & Pipke, David, 2021. "Kind or contented? An investigation of the gift exchange hypothesis in a natural field experiment in Colombia," OSF Preprints xmjaq, Center for Open Science.
    9. Omar Al-Ubaydli & John List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," Artefactual Field Experiments j0001, The Field Experiments Website.
    10. Regner, Tobias, 2014. "Social preferences? Google Answers!," Games and Economic Behavior, Elsevier, vol. 85(C), pages 188-209.
    11. Greiner, Ben & Ockenfels, Axel & Werner, Peter, 2011. "Wage transparency and performance: A real-effort experiment," Economics Letters, Elsevier, vol. 111(3), pages 236-238, June.
    12. Maximiano, Sandra & Sloof, Randolph & Sonnemans, Joep, 2013. "Gift exchange and the separation of ownership and control," Games and Economic Behavior, Elsevier, vol. 77(1), pages 41-60.
    13. Sebastian Kube & Michel André Maréchal & Clemens Puppe, 2013. "Do Wage Cuts Damage Work Morale? Evidence From A Natural Field Experiment," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 853-870, August.
    14. Tanjim Hossain & John A. List, 2012. "The Behavioralist Visits the Factory: Increasing Productivity Using Simple Framing Manipulations," Management Science, INFORMS, vol. 58(12), pages 2151-2167, December.
    15. Fahn, Matthias, 2019. "Reciprocity in Dynamic Employment Relationships," Rationality and Competition Discussion Paper Series 198, CRC TRR 190 Rationality and Competition.
    16. Constança Esteves-Sorenson, 2018. "Gift Exchange in the Workplace: Addressing the Conflicting Evidence with a Careful Test," Management Science, INFORMS, vol. 64(9), pages 4365-4388, September.
    17. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    18. Gerard J. Van den Berg & Iris Kesternich & Gerrit Müller & Bettina Siflinger, 2019. "Reciprocity and the Interaction between the Unemployed and the Caseworker," CESifo Working Paper Series 7947, CESifo.
    19. Simon Gächter & Daniele Nosenzo & Martin Sefton, 2012. "The Impact of Social Comparisons on Reciprocity," Scandinavian Journal of Economics, Wiley Blackwell, vol. 114(4), pages 1346-1367, December.
    20. Sautua, Santiago I., 2023. "Disentangling the influences of positive reciprocity and mood on gift exchange at work," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 102(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jesaex:v:2:y:2016:i:2:d:10.1007_s40881-016-0028-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.