IDEAS home Printed from
   My bibliography  Save this paper

Model Selection in an Information Economy : Choosing what to Learn



As online markets for the exchange of goods and services become more common, the study of markets composed at least in part of autonomous agents has taken on increasing importance. In contrast to traditional completeinformation economic scenarios, agents that are operating in an electronic marketplace often do so under considerable uncertainty. In order to reduce their uncertainty, these agents must learn about the world around them. When an agent producer is engaged in a learning task in which data collection is costly, such as learning the preferences of a consumer population, it is faced with a classic decision problem: when to explore and when to exploit. If the agent has a limited number of chances to experiment, it must explicitly consider the cost of learning (in terms of foregone profit) against the value of the information acquired. Information goods add an additional dimension to this problem; due to their flexibility, they can be bundled and priced according to a number of different price schedules. An optimizing producer should consider the profit each price schedule can extract, as well as the difficulty of learning of this schedule. In this paper, we demonstrate the tradeoff between complexity and profitability for a number of common price schedules. We begin with a one-shot decision as to which schedule to learn. Schedules with moderate complexity are preferred in the short and medium term, as they are learned quickly, yet extract a significant fraction of the available profit. We then turn to the repeated version of this one-shot decision and show that moderate complexity schedules, in particular two-part tariff, perform well when the producer must adapt to nonstationarity in the consumer population. When a producer can dynamically change schedules as it learns, it can use an explicit decision-theoretic formulation to greedily select the schedule which appears to yield the greatest profit in the next period. By explicitly considering the both the learnability and the profit extracted by different price schedules, a producer can extract more profit as it learns than if it naively chose models that are accurate once learned.

Suggested Citation

  • Christopher Brooks & Robert Gazzale & Rajarshi Das & Jeffrey Kephart & Jeffrey MacKie-Mason & Edmund Durfee, 2002. "Model Selection in an Information Economy : Choosing what to Learn," Department of Economics Working Papers 2002-01, Department of Economics, Williams College.
  • Handle: RePEc:wil:wileco:2002-01

    Download full text from publisher

    File URL:
    File Function: Full text
    Download Restriction: no

    References listed on IDEAS

    1. Robert B. Barsky & Miles S. Kimball & F. Thomas Juster & Matthew D. Shapiro, 1995. "Preference Parameters and Behavioral Heterogeneity: An Experimental Approach in the Health and Retirement Survey," NBER Working Papers 5213, National Bureau of Economic Research, Inc.
    2. Bound, John & Burkhauser, Richard V., 1999. "Economic analysis of transfer programs targeted on people with disabilities," Handbook of Labor Economics,in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 51, pages 3417-3528 Elsevier.
    3. Richard V. Burkhauser & Robert H. Haveman & Barbara L. Wolfe, 1993. "How people with disabilities fare when public policies change," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 12(2), pages 251-269.
    4. John Bound & Timothy Waidmann, 1992. "Disability Transfers, Self-Reported Health, and the Labor Force Attachment of Older Men: Evidence from the Historical Record," The Quarterly Journal of Economics, Oxford University Press, vol. 107(4), pages 1393-1419.
    5. Currie, Janet & Madrian, Brigitte C., 1999. "Health, health insurance and the labor market," Handbook of Labor Economics,in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 50, pages 3309-3416 Elsevier.
    6. David H. Autor & Mark G. Duggan, 2001. "The Rise in Disability Recipiency and the Decline in Unemployment," JCPR Working Papers 226, Northwestern University/University of Chicago Joint Center for Poverty Research.
    7. Edward J. Bird, 1996. "Repairing the safety net: Is the EITC the right patch?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 15(1), pages 1-31.
    8. Patricia M. Anderson & Bruce D. Meyer, "undated". "The Incidence of a Firm-Varying Payroll Tax: The Case of Unemployment Insurance," IPR working papers 95-23, Institute for Policy Resarch at Northwestern University.
    9. John Bound & Timothy Waidmann, 2000. "Accounting for Recent Declines in Employment Rates among the Working-Aged Disabled," NBER Working Papers 7975, National Bureau of Economic Research, Inc.
    10. Helen Levy, 2004. "Employer-Sponsored Disability Insurance: Where are the Gaps in Coverage?," NBER Working Papers 10382, National Bureau of Economic Research, Inc.
    11. Robert Haveman & Barbara Wolfe, 1990. "The Economic Well-Being of the Disabled: 1962-84," Journal of Human Resources, University of Wisconsin Press, vol. 25(1), pages 32-54.
    12. Kreider, Brent, 1999. "Social Security Disability Insurance: Applications, Awards, and Lifetime Income Flows," Journal of Labor Economics, University of Chicago Press, vol. 17(4), pages 784-827, October.
    13. Timothy Waidmann & John Bound & Michael Schoenbaum, 1995. "The Illusion of Failure: Trends in the Self-Reported Health of the U.S. Elderly," NBER Working Papers 5017, National Bureau of Economic Research, Inc.
    14. Jonathan Gruber, 2000. "Disability Insurance Benefits and Labor Supply," Journal of Political Economy, University of Chicago Press, vol. 108(6), pages 1162-1183, December.
    15. Gruber, Jonathan, 1994. "The Incidence of Mandated Maternity Benefits," American Economic Review, American Economic Association, vol. 84(3), pages 622-641, June.
    16. Daniel Feenberg & Elisabeth Coutts, 1993. "An introduction to the TAXSIM model," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 12(1), pages 189-194.
    17. Diamond, P. A. & Mirrlees, J. A., 1978. "A model of social insurance with variable retirement," Journal of Public Economics, Elsevier, vol. 10(3), pages 295-336, December.
    18. John Bound & Timothy Waidmann, 2002. "Accounting for Recent Declines in Employment Rates among Working-Aged Men and Women with Disabilities," Journal of Human Resources, University of Wisconsin Press, vol. 37(2), pages 231-250.
    19. Varian, Hal R., 1980. "Redistributive taxation as social insurance," Journal of Public Economics, Elsevier, vol. 14(1), pages 49-68, August.
    20. Diamond, Peter & Sheshinski, Eytan, 1995. "Economic aspects of optimal disability benefits," Journal of Public Economics, Elsevier, vol. 57(1), pages 1-23, May.
    21. Cullen, Julie Berry & Gruber, Jonathan, 2000. "Does Unemployment Insurance Crowd Out Spousal Labor Supply?," Journal of Labor Economics, University of Chicago Press, vol. 18(3), pages 546-572, July.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. Ehtamo, Harri & Berg, Kimmo & Kitti, Mitri, 2010. "An adjustment scheme for nonlinear pricing problem with two buyers," European Journal of Operational Research, Elsevier, vol. 201(1), pages 259-266, February.
    2. Kimmo Berg & Harri Ehtamo, 2012. "Continuous learning methods in two-buyer pricing problem," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 75(3), pages 287-304, June.
    3. repec:spr:compst:v:75:y:2012:i:3:p:287-304 is not listed on IDEAS


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wil:wileco:2002-01. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Stephen Sheppard). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.