IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v290y2021i1p196-209.html
   My bibliography  Save this article

Maximum entropy distributions with quantile information

Author

Listed:
  • Bajgiran, Amirsaman H.
  • Mardikoraem, Mahsa
  • Soofi, Ehsan S.

Abstract

Quantiles are available in various problems for developing probability distributions. In some problems quantiles are elicited from experts and used for fitting parametric models, which induce non-elicited information. In some other problems comparisons are made with a quantile of an assumed model which is noncommittal to the quantile information. The maximum entropy (ME) principle provides models that avoid these issues. However, the information theory literature has been mainly concerned about models based on moment information. This paper explores the ME models that are the minimum elaborations of the uniform and moment-based ME models by quantiles. This property provides diagnostics for the utility of elaboration in terms of the information value of each type of information over the other. The ME model with quantiles and moments is represented as the mixture of truncated distributions on consecutive intervals whose shapes and existence are determined by the moments. Elaborations of several ME distributions by quantiles are presented. The ME model based only on quantiles elicited by the fixed interval method possesses a useful property for pooling information elicited from multiple experts. The elaboration of Laplace distribution is an extension of the information theory connection with minimum risk under symmetric loss functions to the asymmetric linear loss. This extension produces a new Asymmetric Laplace distribution. Application examples compare ME priors with a parametric model fitted to elicited quantiles, illustrate measuring uncertainty and disagreement of economic forecasters based on elicited probabilities, and adjust ME models for a fundamental quantile in an inventory management problem.

Suggested Citation

  • Bajgiran, Amirsaman H. & Mardikoraem, Mahsa & Soofi, Ehsan S., 2021. "Maximum entropy distributions with quantile information," European Journal of Operational Research, Elsevier, vol. 290(1), pages 196-209.
  • Handle: RePEc:eee:ejores:v:290:y:2021:i:1:p:196-209
    DOI: 10.1016/j.ejor.2020.07.052
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221720306780
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2020.07.052?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    2. Andersson, Jonas & Jörnsten, Kurt & Nonås, Sigrid Lise & Sandal, Leif & Ubøe, Jan, 2013. "A maximum entropy approach to the newsvendor problem with partial information," European Journal of Operational Research, Elsevier, vol. 228(1), pages 190-200.
    3. Alwan, Layth C. & Ebrahimi, Nader & Soofi, Ehsan S., 1998. "Information theoretic framework for process control," European Journal of Operational Research, Elsevier, vol. 111(3), pages 526-542, December.
    4. Asadi, Majid & Ebrahimi, Nader & Soofi, Ehsan S., 2018. "Optimal hazard models based on partial information," European Journal of Operational Research, Elsevier, vol. 270(2), pages 723-733.
    5. Zellner, Arnold & Highfield, Richard A., 1988. "Calculation of maximum entropy distributions and approximation of marginalposterior distributions," Journal of Econometrics, Elsevier, vol. 37(2), pages 195-209, February.
    6. Bera Anil K. & Galvao Antonio F. & Montes-Rojas Gabriel V. & Park Sung Y., 2016. "Asymmetric Laplace Regression: Maximum Likelihood, Maximum Entropy and Quantile Regression," Journal of Econometric Methods, De Gruyter, vol. 5(1), pages 79-101, January.
    7. Soroush Saghafian & Brian Tomlin, 2016. "The Newsvendor under Demand Ambiguity: Combining Data with Moment and Tail Information," Operations Research, INFORMS, vol. 64(1), pages 167-185, February.
    8. Ebrahimi, Nader & Soofi, Ehsan S. & Soyer, Refik, 2008. "Multivariate maximum entropy identification, transformation, and dependence," Journal of Multivariate Analysis, Elsevier, vol. 99(6), pages 1217-1231, July.
    9. Robert Rich & Joseph Tracy, 2010. "The Relationships among Expected Inflation, Disagreement, and Uncertainty: Evidence from Matched Point and Density Forecasts," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 200-207, February.
    10. Fleischhacker, Adam J. & Fok, Pak-Wing, 2015. "On the relationship between entropy, demand uncertainty, and expected loss," European Journal of Operational Research, Elsevier, vol. 245(2), pages 623-628.
    11. Garthwaite, Paul H. & Kadane, Joseph B. & O'Hagan, Anthony, 2005. "Statistical Methods for Eliciting Probability Distributions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 680-701, June.
    12. Poiraud-Casanova, Sandrine & Thomas-Agnan, Christine, 2000. "About monotone regression quantiles," Statistics & Probability Letters, Elsevier, vol. 48(1), pages 101-104, May.
    13. Georgia Perakis & Guillaume Roels, 2008. "Regret in the Newsvendor Model with Partial Information," Operations Research, INFORMS, vol. 56(1), pages 188-203, February.
    14. Majid Asadi & Nader Ebrahimi & Ehsan S. Soofi & Somayeh Zarezadeh, 2014. "New maximum entropy methods for modeling lifetime distributions," Naval Research Logistics (NRL), John Wiley & Sons, vol. 61(6), pages 427-434, September.
    15. Omid M. Ardakani & Nader Ebrahimi & Ehsan S. Soofi, 2018. "Ranking Forecasts by Stochastic Error Distance, Information and Reliability Measures," International Statistical Review, International Statistical Institute, vol. 86(3), pages 442-468, December.
    16. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    17. Kajal Lahiri & Wuwei Wang, 2019. "Estimating macroeconomic uncertainty and discord using info-metrics," CESifo Working Paper Series 7674, CESifo.
    18. Mehdi Shoja & Ehsan S. Soofi, 2017. "Uncertainty, information, and disagreement of economic forecasters," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 796-817, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Majid Asadi & Karthik Devarajan & Nader Ebrahimi & Ehsan Soofi & Lauren Spirko‐Burns, 2022. "Elaboration Models with Symmetric Information Divergence," International Statistical Review, International Statistical Institute, vol. 90(3), pages 499-524, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Asadi, Majid & Ebrahimi, Nader & Soofi, Ehsan S., 2018. "Optimal hazard models based on partial information," European Journal of Operational Research, Elsevier, vol. 270(2), pages 723-733.
    2. Anh Ninh, 2021. "Robust newsvendor problems with compound Poisson demands," Annals of Operations Research, Springer, vol. 302(1), pages 327-338, July.
    3. Bai, Qingguo & Xu, Jianteng & Gong, Yeming & Chauhan, Satyaveer S., 2022. "Robust decisions for regulated sustainable manufacturing with partial demand information: Mandatory emission capacity versus emission tax," European Journal of Operational Research, Elsevier, vol. 298(3), pages 874-893.
    4. Svetlana Makarova, 2014. "Risk and Uncertainty: Macroeconomic Perspective," UCL SSEES Economics and Business working paper series 129, UCL School of Slavonic and East European Studies (SSEES).
    5. Qiu, Ruozhen & Sun, Minghe & Lim, Yun Fong, 2017. "Optimizing (s, S) policies for multi-period inventory models with demand distribution uncertainty: Robust dynamic programing approaches," European Journal of Operational Research, Elsevier, vol. 261(3), pages 880-892.
    6. Geoff Kenny & Thomas Kostka & Federico Masera, 2015. "Density characteristics and density forecast performance: a panel analysis," Empirical Economics, Springer, vol. 48(3), pages 1203-1231, May.
    7. Boylan, John E. & Babai, M. Zied, 2022. "Estimating the cumulative distribution function of lead-time demand using bootstrapping with and without replacement," International Journal of Production Economics, Elsevier, vol. 252(C).
    8. Federico Bassetti & Roberto Casarin & Marco Del Negro, 2022. "A Bayesian Approach to Inference on Probabilistic Surveys," Staff Reports 1025, Federal Reserve Bank of New York.
    9. Suh, Sangwon & Kim, Daehwan, 2021. "Inflation targeting and expectation anchoring: Evidence from developed and emerging market economies," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    10. Guanghua Han & Xujin Pu & Bo Fan, 2017. "Sustainable Governance of Organic Food Production When Market Forecast Is Imprecise," Sustainability, MDPI, vol. 9(6), pages 1-20, June.
    11. Wojciech Charemza & Carlos Diaz Vela & Svetlana Makarova, 2013. "Inflation fan charts, monetary policy and skew normal distribution," Discussion Papers in Economics 13/06, Division of Economics, School of Business, University of Leicester.
    12. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    13. Li, You & Tay, Anthony, 2021. "The role of macroeconomic and policy uncertainty in density forecast dispersion," Journal of Macroeconomics, Elsevier, vol. 67(C).
    14. Glas, Alexander, 2020. "Five dimensions of the uncertainty–disagreement linkage," International Journal of Forecasting, Elsevier, vol. 36(2), pages 607-627.
    15. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    16. Xi Chen & Simai He & Bo Jiang & Christopher Thomas Ryan & Teng Zhang, 2021. "The Discrete Moment Problem with Nonconvex Shape Constraints," Operations Research, INFORMS, vol. 69(1), pages 279-296, January.
    17. Anh Ninh & Honggang Hu & David Allen, 2019. "Robust newsvendor problems: effect of discrete demands," Annals of Operations Research, Springer, vol. 275(2), pages 607-621, April.
    18. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    19. Krüger, Fabian & Pavlova, Lora, 2019. "Quantifying subjective oncertainty in survey expectations," Working Papers 0664, University of Heidelberg, Department of Economics.
    20. Glas, Alexander & Hartmann, Matthias, 2016. "Inflation uncertainty, disagreement and monetary policy: Evidence from the ECB Survey of Professional Forecasters," Journal of Empirical Finance, Elsevier, vol. 39(PB), pages 215-228.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:290:y:2021:i:1:p:196-209. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/eor .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.