IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v272y2019i3p803-815.html
   My bibliography  Save this article

Revealed preference theory: An algorithmic outlook

Author

Listed:
  • Smeulders, Bart
  • Crama, Yves
  • Spieksma, Frits C.R.

Abstract

Revealed preference theory is a domain within economics that studies rationalizability of behavior by (certain types of) utility functions. Given observed behavior in the form of choice data, testing whether certain conditions are satisfied gives rise to a variety of computational problems that can be analyzed using operations research techniques. In this survey, we provide an overview of these problems, their theoretical complexity, and available algorithms for tackling them. We focus on consumer choice settings, in particular individual choice, collective choice and stochastic choice settings.

Suggested Citation

  • Smeulders, Bart & Crama, Yves & Spieksma, Frits C.R., 2019. "Revealed preference theory: An algorithmic outlook," European Journal of Operational Research, Elsevier, vol. 272(3), pages 803-815.
    • Handle: RePEc:eee:ejores:v:272:y:2019:i:3:p:803-815
    DOI: 10.1016/j.ejor.2018.04.026
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221718303291
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2018.04.026?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2007. "The Collective Model of Household Consumption: A Nonparametric Characterization," Econometrica, Econometric Society, vol. 75(2), pages 553-574, March.
    2. Syngjoo Choi & Shachar Kariv & Wieland M?ller & Dan Silverman, 2014. "Who Is (More) Rational?," American Economic Review, American Economic Association, vol. 104(6), pages 1518-1550, June.
    3. Sam Cosaert & Thomas Demuynck, 2015. "Revealed preference theory for finite choice sets," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 59(1), pages 169-200, May.
    4. Varian, Hal R, 1982. "The Nonparametric Approach to Demand Analysis," Econometrica, Econometric Society, vol. 50(4), pages 945-973, July.
    5. Fleissig, Adrian R. & Whitney, Gerald A., 2005. "Testing for the Significance of Violations of Afriat's Inequalities," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 355-362, July.
    6. Forges, Françoise & Minelli, Enrico, 2009. "Afriat's theorem for general budget sets," Journal of Economic Theory, Elsevier, vol. 144(1), pages 135-145, January.
    7. Griffith, Rachel & O'Connell, Martin & Smith, Kate & Cherchye, Laurens & De Rock, Bram & Vermeulen, Frederic, 2017. "A new year, a new you? Heterogeneity and self-control in food purchases," CEPR Discussion Papers 12499, C.E.P.R. Discussion Papers.
    8. Jan Heufer, 2012. "Testing for Utility Maximization with Error and the Loss of Power," German Economic Review, Verein für Socialpolitik, vol. 13(2), pages 161-173, May.
    9. Cherchye, Laurens & De Rock, Bram & Sabbe, Jeroen & Vermeulen, Frederic, 2008. "Nonparametric tests of collectively rational consumption behavior: An integer programming procedure," Journal of Econometrics, Elsevier, vol. 147(2), pages 258-265, December.
    10. John Quah, 2014. "A test for weakly separable preferences," Economics Series Working Papers 708, University of Oxford, Department of Economics.
    11. Richard Blundell, 2005. "Presidential Address: How Revealing Is Revealed Preference?," Journal of the European Economic Association, MIT Press, vol. 3(2-3), pages 211-235, 04/05.
    12. Cherchye, Laurens & De Rock, Bram & Vermeulen, Frederic, 2010. "An Afriat Theorem for the collective model of household consumption," Journal of Economic Theory, Elsevier, vol. 145(3), pages 1142-1163, May.
    13. Sam Cosaert, 2019. "What Types are There?," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 533-554, February.
    14. Laurens Cherchye & Thomas Demuynck & Bram De Rock & Frederic Vermeulen, 2017. "Household Consumption When the Marriage Is Stable," American Economic Review, American Economic Association, vol. 107(6), pages 1507-1534, June.
    15. Federico Echenique & Sangmok Lee & Matthew Shum, 2011. "The Money Pump as a Measure of Revealed Preference Violations," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1201-1223.
    16. Fabrice Talla Nobibon & Laurens Cherchye & Yves Crama & Thomas Demuynck & Bram De Rock & Frits C. R. Spieksma, 2016. "Revealed Preference Tests of Collectively Rational Consumption Behavior: Formulations and Algorithms," Operations Research, INFORMS, vol. 64(6), pages 1197-1216, December.
    17. Ian Crawford & Bram De Rock, 2014. "Empirical Revealed Preference," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 503-524, August.
    18. Cherchye, Laurens & Demuynck, Thomas & De Rock, Bram & Hjertstrand, Per, 2015. "Revealed preference tests for weak separability: An integer programming approach," Journal of Econometrics, Elsevier, vol. 186(1), pages 129-141.
    19. Fabrice Talla Nobibon & Laurens Cherchye & Bram De Rock & Jeroen Sabbe & Frits Spieksma, 2011. "Heuristics for Deciding Collectively Rational Consumption Behavior," Computational Economics, Springer;Society for Computational Economics, vol. 38(2), pages 173-204, August.
    20. Varian, Hal R., 1990. "Goodness-of-fit in optimizing models," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 125-140.
    21. Satoru Fujishige & Zaifu Yang, 2012. "On Revealed Preference and Indivisibilities," Discussion Papers 12/02, Department of Economics, University of York.
    22. Philippe de Peretti, 2005. "Testing The Significance Of The Departures From Utility Maximization," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00646801, HAL.
    23. Fleissig, Adrian R. & Whitney, Gerald A., 2008. "A nonparametric test of weak separability and consumer preferences," Journal of Econometrics, Elsevier, vol. 147(2), pages 275-281, December.
    24. Heufer, Jan & Hjertstrand, Per, 2015. "Consistent subsets: Computationally feasible methods to compute the Houtman–Maks-index," Economics Letters, Elsevier, vol. 128(C), pages 87-89.
    25. Cherchye, Laurens & Demuynck, Thomas & De Rock, Bram, 2014. "Revealed preference analysis for convex rationalizations on nonlinear budget sets," Journal of Economic Theory, Elsevier, vol. 152(C), pages 224-236.
    26. Jose Apesteguia & Miguel A. Ballester, 2015. "A Measure of Rationality and Welfare," Journal of Political Economy, University of Chicago Press, vol. 123(6), pages 1278-1310.
    27. Tsur, Yacov, 1989. "On testing for revealed preference conditions," Economics Letters, Elsevier, vol. 31(4), pages 359-362, December.
    28. Diewert, W. E. & Parkan, C., 1985. "Tests for the consistency of consumer data," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 127-147.
    29. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2009. "Opening the Black Box of Intrahousehold Decision Making: Theory and Nonparametric Empirical Tests of General Collective Consumption Models," Journal of Political Economy, University of Chicago Press, vol. 117(6), pages 1074-1104, December.
    30. Denis Bouyssou & Marc Pirlot, 2016. "Conjoint Measurement Tools for MCDM," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 97-151, Springer.
    31. Bart Smeulders & Laurens Cherchye & Bram De Rock & Frits C. R. Spieksma, 2013. "The Money Pump as a Measure of Revealed Preference Violations: A Comment," Journal of Political Economy, University of Chicago Press, vol. 121(6), pages 1248-1258.
    32. Fabrice Talla Nobibon & Bart Smeulders & Frits C. R. Spieksma, 2015. "A Note on Testing Axioms of Revealed Preference," Journal of Optimization Theory and Applications, Springer, vol. 166(3), pages 1063-1070, September.
    33. Kohei Shiozawa, 2015. "Revealed Preference Test and Shortest Path Problem; Graph Theoretic Structure of the Rationalizability Test," Discussion Papers in Economics and Business 15-17-Rev.2, Osaka University, Graduate School of Economics, revised Aug 2016.
    34. Kawaguchi, Kohei, 2017. "Testing rationality without restricting heterogeneity," Journal of Econometrics, Elsevier, vol. 197(1), pages 153-171.
    35. Mark Dean & Daniel Martin, 2016. "Measuring Rationality with the Minimum Cost of Revealed Preference Violations," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 524-534, July.
    36. James S. Dyer, 2016. "Multiattribute Utility Theory (MAUT)," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 285-314, Springer.
    37. Hausman, Daniel M., 2000. "Revealed preference, belief, and game theory," Economics and Philosophy, Cambridge University Press, vol. 16(1), pages 99-115, April.
    38. Fleissig, Adrian R & Whitney, Gerald A, 2003. "A New PC-Based Test for Varian's Weak Separability Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 133-144, January.
    39. Hjertstrand, Per & L. Swofford, James & Whitney, Gerald A., 2013. "Revealed Preference Tests of Utility Maximization and Weak Separability of Consumption, Leisure and Money with Incomplete Adjustment," Working Paper Series 971, Research Institute of Industrial Economics.
    40. Francoise Forges & Enrico Minelli, 2009. "Afriat's theorem for generalized budget sets," Post-Print hal-00360726, HAL.
    41. Ian Crawford & Krishna Pendakur, 2013. "How many types are there?," Economic Journal, Royal Economic Society, vol. 123, pages 77-95, March.
    42. Stanley Zionts & Jyrki Wallenius, 1983. "An Interactive Multiple Objective Linear Programming Method for a Class of Underlying Nonlinear Utility Functions," Management Science, INFORMS, vol. 29(5), pages 519-529, May.
    43. Matthew Polisson & John K.-H. Quah, 2013. "Revealed Preference in a Discrete Consumption Space," American Economic Journal: Microeconomics, American Economic Association, vol. 5(1), pages 28-34, February.
    44. Sidney N. Afriat, 1972. "The Theory of International Comparisons of Real Income and Prices," NBER Chapters, in: International Comparisons of Prices and Output, pages 13-84, National Bureau of Economic Research, Inc.
    45. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency, Heterogeneity, and Granularity of Individual Behavior under Uncertainty," Economics Working Papers 0076, Institute for Advanced Study, School of Social Science.
    46. Fabrice Talla Nobibon & Laurens Cherchye & Yves Crama & Thomas Demuynck & Bram De Rock & Frits C. R. Spieksma, 2016. "Revealed Preference Tests of Collectively Rational Consumption Behavior: Formulations and Algorithms," Operations Research, INFORMS, vol. 64(6), pages 1197-1216, December.
    47. Hal R. Varian, 1983. "Non-parametric Tests of Consumer Behaviour," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 50(1), pages 99-110.
    48. Fleissig, Adrian R. & Whitney, Gerald A., 2007. "Testing additive separability," Economics Letters, Elsevier, vol. 96(2), pages 215-220, August.
    49. Salvatore Corrente & Salvatore Greco & Benedetto Matarazzo & Roman Słowiński, 2016. "Robust ordinal regression for decision under risk and uncertainty," Journal of Business Economics, Springer, vol. 86(1), pages 55-83, January.
    50. Shiozawa, Kohei, 2016. "Revealed preference test and shortest path problem; graph theoretic structure of the rationalizability test," Journal of Mathematical Economics, Elsevier, vol. 67(C), pages 38-48.
    51. Bandyopadhyay, Taradas & Dasgupta, Indraneel & Pattanaik, Prasanta K., 1999. "Stochastic Revealed Preference and the Theory of Demand," Journal of Economic Theory, Elsevier, vol. 84(1), pages 95-110, January.
    52. Chiappori, Pierre-Andre, 1988. "Rational Household Labor Supply," Econometrica, Econometric Society, vol. 56(1), pages 63-90, January.
    53. Talla Nobibon, Fabrice & Spieksma, Frits C.R., 2010. "On the complexity of testing the Collective Axiom of Revealed Preference," Mathematical Social Sciences, Elsevier, vol. 60(2), pages 123-136, September.
    54. Timothy K. M. Beatty & Ian A. Crawford, 2011. "How Demanding Is the Revealed Preference Approach to Demand?," American Economic Review, American Economic Association, vol. 101(6), pages 2782-2795, October.
    55. William A. Barnett & Seungmook Choi, 2004. "A Monte Carlo Study of Tests of Blockwise Weak Separability," Contributions to Economic Analysis, in: Functional Structure and Approximation in Econometrics, pages 257-287, Emerald Group Publishing Limited.
    56. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2011. "The revealed preference approach to collective consumption behavior: nonparametric testing and sharing rule recovery," ULB Institutional Repository 2013/98560, ULB -- Universite Libre de Bruxelles.
    57. Afriat, S N, 1973. "On a System of Inequalities in Demand Analysis: An Extension of the Classical Method," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 14(2), pages 460-472, June.
    58. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency and Heterogeneity of Individual Behavior under Uncertainty," American Economic Review, American Economic Association, vol. 97(5), pages 1921-1938, December.
    59. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2011. "The Revealed Preference Approach to Collective Consumption Behaviour: Testing and Sharing Rule Recovery," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(1), pages 176-198.
    60. Kenneth J. Arrow, 1950. "A Difficulty in the Concept of Social Welfare," Journal of Political Economy, University of Chicago Press, vol. 58, pages 328-328.
    61. Susan K. Snyder, 2000. "Nonparametric Testable Restrictions of Household Behavior," Southern Economic Journal, John Wiley & Sons, vol. 67(1), pages 171-185, July.
    62. Stanley Zionts & Jyrki Wallenius, 1976. "An Interactive Programming Method for Solving the Multiple Criteria Problem," Management Science, INFORMS, vol. 22(6), pages 652-663, February.
    63. Swofford, James L. & Whitney, Gerald A., 1994. "A revealed preference test for weakly separable utility maximization with incomplete adjustment," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 235-249.
    64. W. E. Diewert, 1973. "Afriat and Revealed Preference Theory," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 40(3), pages 419-425.
    65. repec:dau:papers:123456789/4099 is not listed on IDEAS
    66. Smeulders, Bart & Cherchye, Laurens & De Rock, Bram & Spieksma, Frits C.R. & Talla Nobibon, Fabrice, 2015. "Complexity results for the weak axiom of revealed preference for collective consumption models," Journal of Mathematical Economics, Elsevier, vol. 58(C), pages 82-91.
    67. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2011. "The Revealed Preference Approach to Collective Consumption Behaviour: Testing and Sharing Rule Recovery," Review of Economic Studies, Oxford University Press, vol. 78(1), pages 176-198.
    68. de PERETTI, PHILIPPE, 2005. "Testing The Significance Of The Departures From Utility Maximization," Macroeconomic Dynamics, Cambridge University Press, vol. 9(3), pages 372-397, June.
    69. Daniel McFadden, 2005. "Revealed stochastic preference: a synthesis," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 26(2), pages 245-264, August.
    70. Jan Heufer, 2011. "Stochastic revealed preference and rationalizability," Theory and Decision, Springer, vol. 71(4), pages 575-592, October.
    71. Jyrki Wallenius & James S. Dyer & Peter C. Fishburn & Ralph E. Steuer & Stanley Zionts & Kalyanmoy Deb, 2008. "Multiple Criteria Decision Making, Multiattribute Utility Theory: Recent Accomplishments and What Lies Ahead," Management Science, INFORMS, vol. 54(7), pages 1336-1349, July.
    72. Per Hjertstrand & James L. Swofford & Gerald A. Whitney, 2016. "Mixed Integer Programming Revealed Preference Tests of Utility Maximization and Weak Separability of Consumption, Leisure, and Money," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 48(7), pages 1547-1561, October.
    73. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    74. Alcantud, José Carlos R. & Matos, Daniel L. & Palmero, Carlos R., 2009. "Goodness of fit in optimizing consumer's model," MPRA Paper 20134, University Library of Munich, Germany.
    75. Varian, Hal R., 1985. "Non-parametric analysis of optimizing behavior with measurement error," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 445-458.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    2. Koşar, Gizem & Ransom, Tyler & van der Klaauw, Wilbert, 2022. "Understanding migration aversion using elicited counterfactual choice probabilities," Journal of Econometrics, Elsevier, vol. 231(1), pages 123-147.
    3. Fancello, Giovanna & Congiu, Tanja & Tsoukiàs, Alexis, 2020. "Mapping walkability. A subjective value theory approach," Socio-Economic Planning Sciences, Elsevier, vol. 72(C).
    4. Mike G. Tsionas & Valentin Zelenyuk, 2022. "Testing for Optimization Behavior in Production when Data is with Measurement Errors: A Bayesian Approach," CEPA Working Papers Series WP012022, School of Economics, University of Queensland, Australia.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ian Crawford & Bram De Rock, 2014. "Empirical Revealed Preference," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 503-524, August.
    2. Demuynck, Thomas & Hjertstrand, Per, 2019. "Samuelson's Approach to Revealed Preference Theory: Some Recent Advances," Working Paper Series 1274, Research Institute of Industrial Economics.
    3. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    4. Dieter Saelens, 2022. "Unitary or collective households? A nonparametric rationality and separability test using detailed data on consumption expenditures and time use," Empirical Economics, Springer, vol. 62(2), pages 637-677, February.
    5. Cherchye, Laurens & Demuynck, Thomas & De Rock, Bram & Hjertstrand, Per, 2015. "Revealed preference tests for weak separability: An integer programming approach," Journal of Econometrics, Elsevier, vol. 186(1), pages 129-141.
    6. Dziewulski, Paweł, 2020. "Just-noticeable difference as a behavioural foundation of the critical cost-efficiency index," Journal of Economic Theory, Elsevier, vol. 188(C).
    7. Matthew Polisson, 2018. "A lattice test for additive separability," IFS Working Papers W18/08, Institute for Fiscal Studies.
    8. Yoram Halevy & Dotan Persitz & Lanny Zrill, 2018. "Parametric Recoverability of Preferences," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1558-1593.
    9. Pawel Dziewulski, 2018. "Just-noticeable difference as a behavioural foundation of the critical cost-efficiency," Economics Series Working Papers 848, University of Oxford, Department of Economics.
    10. Laurens Cherchye & Sam Cosaert & Thomas Demuynck & Bram De Rock, 2020. "Group Consumption with Caring Individuals," The Economic Journal, Royal Economic Society, vol. 130(627), pages 587-622.
    11. Sam Cosaert & Veerle Hennebel, 2023. "Parental Childcare with Process Benefits," Economica, London School of Economics and Political Science, vol. 90(357), pages 339-371, January.
    12. Shiozawa, Kohei, 2016. "Revealed preference test and shortest path problem; graph theoretic structure of the rationalizability test," Journal of Mathematical Economics, Elsevier, vol. 67(C), pages 38-48.
    13. Heufer, Jan & Hjertstrand, Per, 2019. "Homothetic preferences revealed," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 602-614.
    14. Laurens CHERCHYE & Ian CRAWFORD & Bram DE ROCK & Frederic VERMEULEN, 2011. "Aggregation without the aggravation? Nonparametric analysis of the representative consumer," Working Papers of Department of Economics, Leuven ces11.36, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    15. Avner Seror, 2022. "The Priced Survey Methodology," AMSE Working Papers 2224, Aix-Marseille School of Economics, France.
    16. Donni, Olivier & Molina, José Alberto, 2018. "Household Collective Models: Three Decades of Theoretical Contributions and Empirical Evidence," IZA Discussion Papers 11915, Institute of Labor Economics (IZA).
    17. Kohei Shiozawa, 2015. "Revealed Preference Test and Shortest Path Problem; Graph Theoretic Structure of the Rationalizability Test," Discussion Papers in Economics and Business 15-17-Rev.2, Osaka University, Graduate School of Economics, revised Aug 2016.
    18. Pawel Dziewulski, 2021. "A comprehensive revealed preference approach to approximate utility maximisation," Working Paper Series 0621, Department of Economics, University of Sussex Business School.
    19. Sam Cosaert & Thomas Demuynck, 2015. "Revealed preference theory for finite choice sets," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 59(1), pages 169-200, May.
    20. Khushboo Surana, 2022. "How different are we? Identifying the degree of revealed preference heterogeneity," Discussion Papers 22/09, Department of Economics, University of York.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:272:y:2019:i:3:p:803-815. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.