IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v68y2015i8p1772-1784.html
   My bibliography  Save this article

The bias bias

Author

Listed:
  • Brighton, Henry
  • Gigerenzer, Gerd

Abstract

In marketing and finance, surprisingly simple models sometimes predict more accurately than more complex, sophisticated models. Here, we address the question of when and why simple models succeed — or fail — by framing the forecasting problem in terms of the bias–variance dilemma. Controllable error in forecasting consists of two components, the “bias” and the “variance”. We argue that the benefits of simplicity are often overlooked because of a pervasive “bias bias”: the importance of the bias component of prediction error is inflated, and the variance component of prediction error, which reflects an oversensitivity of a model to different samples from the same population, is neglected. Using the study of cognitive heuristics, we discuss how to reduce variance by ignoring weights, attributes, and dependencies between attributes, and thus make better decisions. Bias and variance, we argue, offer a more insightful perspective on the benefits of simplicity than Occam’'s razor.

Suggested Citation

  • Brighton, Henry & Gigerenzer, Gerd, 2015. "The bias bias," Journal of Business Research, Elsevier, vol. 68(8), pages 1772-1784.
  • Handle: RePEc:eee:jbrese:v:68:y:2015:i:8:p:1772-1784
    DOI: 10.1016/j.jbusres.2015.01.061
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S014829631500154X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jbusres.2015.01.061?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Thomas Åstebro & Samir Elhedhli, 2006. "The Effectiveness of Simple Decision Heuristics: Forecasting Commercial Success for Early-Stage Ventures," Management Science, INFORMS, vol. 52(3), pages 395-409, March.
    2. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    3. Wright, Malcolm J. & Stern, Philip, 2015. "Forecasting new product trial with analogous series," Journal of Business Research, Elsevier, vol. 68(8), pages 1732-1738.
    4. Scheibehenne, Benjamin & Broder, Arndt, 2007. "Predicting Wimbledon 2005 tennis results by mere player name recognition," International Journal of Forecasting, Elsevier, vol. 23(3), pages 415-426.
    5. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    6. Michael Yee & Ely Dahan & John R. Hauser & James Orlin, 2007. "Greedoid-Based Noncompensatory Inference," Marketing Science, INFORMS, vol. 26(4), pages 532-549, 07-08.
    7. Andrew G. Haldane & Vasileios Madouros, 2012. "The dog and the frisbee," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, pages 109-159.
    8. Daria Dzyabura & John R. Hauser, 2011. "Active Machine Learning for Consideration Heuristics," Marketing Science, INFORMS, vol. 30(5), pages 801-819, September.
    9. J. Scott Armstrong, 2005. "The Forecasting Canon: Nine Generalizations to Improve Forecast Accuracy," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 1, pages 29-35, June.
    10. Peter S. Fader & Bruce G. S. Hardie & Ka Lok Lee, 2005. "“Counting Your Customers” the Easy Way: An Alternative to the Pareto/NBD Model," Marketing Science, INFORMS, vol. 24(2), pages 275-284, August.
    11. Graefe, Andreas & Armstrong, J. Scott & Jones, Randall J. & Cuzán, Alfred G., 2014. "Combining forecasts: An application to elections," International Journal of Forecasting, Elsevier, vol. 30(1), pages 43-54.
    12. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1684, August.
    13. Chater, Nick & Oaksford, Mike & Nakisa, Ramin & Redington, Martin, 2003. "Fast, frugal, and rational: How rational norms explain behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 90(1), pages 63-86, January.
    14. Eirik G. Furubotn, 2009. "Heuristics, The Non‐Maximizing Firm And Efficient Allocation," Metroeconomica, Wiley Blackwell, vol. 60(1), pages 1-23, February.
    15. John D. C. Little, 1970. "Models and Managers: The Concept of a Decision Calculus," Management Science, INFORMS, vol. 16(8), pages 466-485, April.
    16. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    17. Tomaso Poggio & Ryan Rifkin & Sayan Mukherjee & Partha Niyogi, 2004. "General conditions for predictivity in learning theory," Nature, Nature, vol. 428(6981), pages 419-422, March.
    18. Goldstein, Daniel G. & Gigerenzer, Gerd, 2009. "Fast and frugal forecasting," International Journal of Forecasting, Elsevier, vol. 25(4), pages 760-772, October.
    19. repec:cup:judgdm:v:6:y:2011:i:1:p:73-88 is not listed on IDEAS
    20. Laura Martignon & Ulrich Hoffrage, 2002. "Fast, frugal, and fit: Simple heuristics for paired comparison," Theory and Decision, Springer, vol. 52(1), pages 29-71, February.
    21. David C. Schmittlein & Donald G. Morrison & Richard Colombo, 1987. "Counting Your Customers: Who-Are They and What Will They Do Next?," Management Science, INFORMS, vol. 33(1), pages 1-24, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Blanc, Sebastian M. & Setzer, Thomas, 2016. "When to choose the simple average in forecast combination," Journal of Business Research, Elsevier, vol. 69(10), pages 3951-3962.
    2. Gregory Gadzinski & Alessio Castello, 2022. "Combining white box models, black box machines and human interventions for interpretable decision strategies," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 17(3), pages 598-627, May.
    3. Green, Kesten C. & Armstrong, J. Scott, 2015. "Simple versus complex forecasting: The evidence," Journal of Business Research, Elsevier, vol. 68(8), pages 1678-1685.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Hallberg, Niklas L., 2017. "The micro-foundations of pricing strategy in industrial markets: A case study in the European packaging industry," Journal of Business Research, Elsevier, vol. 76(C), pages 179-188.
    6. Guercini, Simone & Milanesi, Matilde, 2020. "Heuristics in international business: A systematic literature review and directions for future research," Journal of International Management, Elsevier, vol. 26(4).
    7. Forbes, William & Hudson, Robert & Skerratt, Len & Soufian, Mona, 2015. "Which heuristics can aid financial-decision-making?," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 199-210.
    8. Wright, Malcolm J. & Stern, Philip, 2015. "Forecasting new product trial with analogous series," Journal of Business Research, Elsevier, vol. 68(8), pages 1732-1738.
    9. Brighton, Henry, 2020. "Statistical foundations of ecological rationality," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 14, pages 1-32.
    10. Woike, Jan K. & Hoffrage, Ulrich & Petty, Jeffrey S., 2015. "Picking profitable investments: The success of equal weighting in simulated venture capitalist decision making," Journal of Business Research, Elsevier, vol. 68(8), pages 1705-1716.
    11. Katsikopoulos, Konstantinos V. & Durbach, Ian N. & Stewart, Theodor J., 2018. "When should we use simple decision models? A synthesis of various research strands," Omega, Elsevier, vol. 81(C), pages 17-25.
    12. Huddleston, Samuel H. & Porter, John H. & Brown, Donald E., 2015. "Improving forecasts for noisy geographic time series," Journal of Business Research, Elsevier, vol. 68(8), pages 1810-1818.
    13. Rodolfo Garcia Sierra & Álvaro Zerda Sarmiento, 2017. "Caracterización de la función de valor empleada en las decisiones ambientales por las grandes organizaciones: Estudio de los grandes proyectos hidroeléctricos en Colombia," Revista Facultad de Ciencias Económicas, Universidad Militar Nueva Granada, vol. 26(1), pages 69-91, December.
    14. Rodolfo Garcia Sierra & Alvaro Zerda Sarmiento, 2016. "Hydropower Megaprojects in Colombia and the Influence of Local Communities: A View from Prospect Theory to Decision Making Process based on Expert Judgment used in Large Organizations," International Journal of Energy Economics and Policy, Econjournals, vol. 6(3), pages 408-420.
    15. Colin Small & J. Eric Bickel, 2022. "Model Complexity and Accuracy: A COVID-19 Case Study," Decision Analysis, INFORMS, vol. 19(4), pages 354-383, December.
    16. Ville A. Satopää & Marat Salikhov & Philip E. Tetlock & Barbara Mellers, 2021. "Bias, Information, Noise: The BIN Model of Forecasting," Management Science, INFORMS, vol. 67(12), pages 7599-7618, December.
    17. repec:cup:judgdm:v:17:y:2022:i:3:p:598-627 is not listed on IDEAS
    18. Jeffrey R. Stevens & Alexis Polzkill Saltzman & Tanner Rasmussen & Leen-Kiat Soh, 2021. "Improving measurements of similarity judgments with machine-learning algorithms," Journal of Computational Social Science, Springer, vol. 4(2), pages 613-629, November.
    19. Riedl, Anna & Vervaeke, John, 2022. "Rationality and Relevance Realization," OSF Preprints vymwu, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brighton, Henry, 2020. "Statistical foundations of ecological rationality," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 14, pages 1-32.
    2. Forbes, William & Hudson, Robert & Skerratt, Len & Soufian, Mona, 2015. "Which heuristics can aid financial-decision-making?," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 199-210.
    3. Woike, Jan K. & Hoffrage, Ulrich & Petty, Jeffrey S., 2015. "Picking profitable investments: The success of equal weighting in simulated venture capitalist decision making," Journal of Business Research, Elsevier, vol. 68(8), pages 1705-1716.
    4. Katsikopoulos, Konstantinos V. & Şimşek, Özgür & Buckmann, Marcus & Gigerenzer, Gerd, 2022. "Transparent modeling of influenza incidence: Big data or a single data point from psychological theory?," International Journal of Forecasting, Elsevier, vol. 38(2), pages 613-619.
    5. Goldstein, Daniel G. & Gigerenzer, Gerd, 2009. "Fast and frugal forecasting," International Journal of Forecasting, Elsevier, vol. 25(4), pages 760-772, October.
    6. Mousavi, Shabnam & Gigerenzer, Gerd, 2014. "Risk, uncertainty, and heuristics," Journal of Business Research, Elsevier, vol. 67(8), pages 1671-1678.
    7. Konstantinos V. Katsikopoulos, 2011. "Psychological Heuristics for Making Inferences: Definition, Performance, and the Emerging Theory and Practice," Decision Analysis, INFORMS, vol. 8(1), pages 10-29, March.
    8. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    9. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    10. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    11. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2019. "Cross-validated covariance estimators for high-dimensional minimum-variance portfolios," Papers 1910.13960, arXiv.org, revised Oct 2020.
    12. Jacobs, Heiko & Müller, Sebastian & Weber, Martin, 2014. "How should individual investors diversify? An empirical evaluation of alternative asset allocation policies," Journal of Financial Markets, Elsevier, vol. 19(C), pages 62-85.
    13. Yu‐Sheng Lai, 2022. "High‐frequency data and stock–bond investing," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1623-1638, December.
    14. Ammann, Manuel & Coqueret, Guillaume & Schade, Jan-Philip, 2016. "Characteristics-based portfolio choice with leverage constraints," Journal of Banking & Finance, Elsevier, vol. 70(C), pages 23-37.
    15. Karstanje, Dennis & Sojli, Elvira & Tham, Wing Wah & van der Wel, Michel, 2013. "Economic valuation of liquidity timing," Journal of Banking & Finance, Elsevier, vol. 37(12), pages 5073-5087.
    16. Lassance, Nathan & Vrins, Frédéric, 2021. "Portfolio selection with parsimonious higher comoments estimation," Journal of Banking & Finance, Elsevier, vol. 126(C).
    17. Allen, D.E. & McAleer, M.J. & Powell, R.J. & Singh, A.K., 2015. "Down-side Risk Metrics as Portfolio Diversification Strategies across the GFC," Econometric Institute Research Papers EI2015-32, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    18. Mainik, Georg & Mitov, Georgi & Rüschendorf, Ludger, 2015. "Portfolio optimization for heavy-tailed assets: Extreme Risk Index vs. Markowitz," Journal of Empirical Finance, Elsevier, vol. 32(C), pages 115-134.
    19. Rui Pedro Brito & Hélder Sebastião & Pedro Godinho, 2016. "Efficient skewness/semivariance portfolios," Journal of Asset Management, Palgrave Macmillan, vol. 17(5), pages 331-346, September.
    20. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:68:y:2015:i:8:p:1772-1784. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.