IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp11867.html

Some (Maybe) Unpleasant Arithmetic in Minimum Wage Evaluations: The Role of Power, Significance and Sample Size

Author

Listed:
  • Bachmann, Ronald

    (RWI)

  • Felder, Rahel

    (Ruhr University Bochum)

  • Schaffner, Sandra

    (RWI)

  • Tamm, Marcus

    (Hochschule der Bundesagentur für Arbeit (HdBA))

Abstract

In this paper, we discuss the importance of sample size in the evaluation of minimum wage effects. We first show which sample sizes are necessary to make reliable statements about the effects of minimum wages on binary outcomes, and second how to determine these sample sizes. This is particularly important when interpreting statistically insignificant effects, which could be due to (i) the absence of a true effect or (ii) lack of statistical power, which makes it impossible to detect an effect even though it exists. We illustrate this for the analysis of labour market transitions using two data sets which are particularly important in the minimum wage research for Germany, the Integrated Labour Market Biographies (IEB) and the Socio-Economic Panel (SOEP).

Suggested Citation

  • Bachmann, Ronald & Felder, Rahel & Schaffner, Sandra & Tamm, Marcus, 2018. "Some (Maybe) Unpleasant Arithmetic in Minimum Wage Evaluations: The Role of Power, Significance and Sample Size," IZA Discussion Papers 11867, IZA Network @ LISER.
    • Handle: RePEc:iza:izadps:dp11867
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp11867.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bachmann, Ronald & Penninger, Marion & Schaffner, Sandra, 2015. "The effect of minimum wages on labour market flows: Evidence from Germany," Ruhr Economic Papers 598, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    2. Bonin, Holger & Isphording, Ingo E. & Krause-Pilatus, Annabelle & Lichter, Andreas & Pestel, Nico & Rinne, Ulf & al., et, 2018. "Auswirkungen des gesetzlichen Mindestlohns auf Beschäftigung, Arbeitszeit und Arbeitslosigkeit," IZA Research Reports 83, Institute of Labor Economics (IZA).
    3. Pierre Brochu & David A. Green, 2013. "The Impact of Minimum Wages on Labour Market Transitions," Economic Journal, Royal Economic Society, vol. 123(12), pages 1203-1235, December.
    4. Neumark David, 2019. "The Econometrics and Economics of the Employment Effects of Minimum Wages: Getting from Known Unknowns to Known Knowns," German Economic Review, De Gruyter, vol. 20(3), pages 293-329, August.
    5. Patrick Burauel & Marco Caliendo & Alexandra Fedorets & Markus M. Grabka & Carsten Schröder & Jürgen Schupp & Linda Wittbrodt, 2017. "Mindestlohn noch längst nicht für alle – Zur Entlohnung anspruchsberechtigter Erwerbstätiger vor und nach der Mindestlohnreform aus der Perspektive Beschäftigter," DIW Wochenbericht, DIW Berlin, German Institute for Economic Research, vol. 84(49), pages 1109-1123.
    6. Aretz Bodo & Gregory Terry & Arntz Melanie, 2013. "The Minimum Wage Affects Them All: Evidence on Employment Spillovers in the Roofing Sector," German Economic Review, De Gruyter, vol. 14(3), pages 282-315, August.
    7. Kluve, Jochen & Schaffner, Sandra & Schmidt, Christoph M., 2006. "Labor Force Status Dynamics in the German Labor Market: Individual Heterogeneity and Cyclical Sensitivity," Technical Reports 2006,20, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    8. Eric W. Djimeu & Deo-Gracias Houndolo, 2016. "Power calculation for causal inference in social science: sample size and minimum detectable effect determination," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(4), pages 508-527, October.
    9. Frings Hanna, 2013. "The Employment Effect of Industry- Specific, Collectively Bargained Minimum Wages," German Economic Review, De Gruyter, vol. 14(3), pages 258-281, August.
    10. Bachmann, Ronald & Schaffner, Sandra, 2009. "Biases in the measurement of labour market dynamics," Technical Reports 2009,12, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    11. Michael Zibrowius, 2012. "Convergence or Divergence?: Immigrant Wage Assimilation Patterns in Germany," SOEPpapers on Multidisciplinary Panel Data Research 479, DIW Berlin, The German Socio-Economic Panel (SOEP).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bachmann, Ronald & Boockmann, Bernhard & Cim, Merve & Felder, Rahel & Frings, Hanna & Janisch, Laura M. & Schaffner, Sandra & Späth, Jochen & Tamm, Marcus, 2018. "Vergleich von Datenquellen für eine Analyse von Übergängen am Arbeitsmarkt: Studie im Auftrag der Mindestlohnkommission," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 180217.
    2. Bossler, Mario & Gürtzgen, Nicole & Lochner, Benjamin & Betzl, Ute & Feist, Lisa & Wegmann, Jakob, 2018. "Auswirkungen des gesetzlichen Mindestlohns auf Betriebe und Unternehmen," IAB-Forschungsbericht 201804, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    3. Mario Bossler & Hans-Dieter Gerner, 2020. "Employment Effects of the New German Minimum Wage: Evidence from Establishment-Level Microdata," ILR Review, Cornell University, ILR School, vol. 73(5), pages 1070-1094, October.
    4. Caliendo Marco & Wittbrodt Linda & Schröder Carsten, 2019. "The Causal Effects of the Minimum Wage Introduction in Germany – An Overview," German Economic Review, De Gruyter, vol. 20(3), pages 257-292, August.
    5. Blömer, Maximilian J. & Guertzgen, Nicole & Pohlan, Laura & Stichnoth, Holger & van den Berg, Gerard J., 2024. "Unemployment effects of the German minimum wage in an equilibrium job search model," Labour Economics, Elsevier, vol. 91(C).
    6. Bossler, Mario & Gürtzgen, Nicole & Lochner, Benjamin & Betzl, Ute & Feist, Lisa, 2018. "The German minimum wage: Effects on business expectations, profitability, and investments," FAU Discussion Papers in Economics 13/2018, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    7. Bachmann, Ronald & Boockmann, Bernhard & Gonschor, Myrielle & Kalweit, René & Klauser, Roman & Laub, Natalie & Rulff, Christian & Vonnahme, Christina, 2022. "Auswirkungen des gesetzlichen Mindestlohns auf Löhne und Arbeitszeiten," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 264288.
    8. Schumann, Mathias, 2017. "The effects of minimum wages on firm-financed apprenticeship training," Labour Economics, Elsevier, vol. 47(C), pages 163-181.
    9. Burauel Patrick & Caliendo Marco & Grabka Markus M. & Obst Cosima & Preuss Malte & Schröder Carsten & Shupe Cortnie, 2020. "The Impact of the German Minimum Wage on Individual Wages and Monthly Earnings," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 240(2-3), pages 201-231, April.
    10. Bachmann, Ronald & Bonin, Holger & Boockmann, Bernhard & Demir, Gökay & Felder, Rahel & Isphording, Ingo & Kalweit, René & Laub, Natalie & Vonnahme, Christina & Zimpelmann, Christian, 2020. "Auswirkungen des gesetzlichen Mindestlohns auf Löhne und Arbeitszeiten: Studie im Auftrag der Mindestlohnkommission," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 222998.
    11. Oliver Bruttel, 2019. "The effects of the new statutory minimum wage in Germany: a first assessment of the evidence," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 53(1), pages 1-13, December.
    12. Monika Köppl-Turyna & Michael Christl & Dénes Kucsera, 2019. "Beschäftigungseffekte von Mindestlöhnen: Die Dosis macht das Gift," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 72(02), pages 40-46, January.
    13. Koch, Andreas & Kirchmann, Andrea & Reiner, Marcel & Scheu, Tobias & Boockmann, Bernhard & Bonin, Holger, 2018. "Verhaltensmuster von Betrieben und Beschäftigten im Zuge der Einführung des gesetzlichen Mindestlohns," IZA Research Reports 84, Institute of Labor Economics (IZA).
    14. Philipp Berge & Hanna Frings, 2020. "High-impact minimum wages and heterogeneous regions," Empirical Economics, Springer, vol. 59(2), pages 701-729, August.
    15. Tobler, Lina & Fervers, Lukas & Reiff, Annika, 2025. "Does more money help? The impact of the apprenticeship minimum wage on training offers and take-ups," SocArXiv hjb74_v1, Center for Open Science.
    16. Pestel, Nico & Bonin, Holger & Isphording, Ingo E. & Gregory, Terry & Caliendo, Marco, 2020. "Auswirkungen des gesetzlichen Mindestlohns auf Beschäftigung und Arbeitslosigkeit," IZA Research Reports 95, Institute of Labor Economics (IZA).
    17. Mario Bossler, 2017. "Employment expectations and uncertainties ahead of the new German minimum wage," Scottish Journal of Political Economy, Scottish Economic Society, vol. 64(4), pages 327-348, September.
    18. Lei Xu & Yu Zhu, 2023. "Does the employment effect of national minimum wage vary by non‐employment rate? A regression discontinuity approach," Manchester School, University of Manchester, vol. 91(1), pages 18-36, January.
    19. Marco Caliendo & Alexandra Fedorets & Malte Preuss & Carsten Schröder & Linda Wittbrodt, 2023. "The short- and medium-term distributional effects of the German minimum wage reform," Empirical Economics, Springer, vol. 64(3), pages 1149-1175, March.
    20. Nordmeier, Daniela, 2014. "Worker flows in Germany: Inspecting the time aggregation bias," Labour Economics, Elsevier, vol. 28(C), pages 70-83.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • J38 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp11867. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Fallak (email available below). General contact details of provider: https://edirc.repec.org/data/izaaalu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.