IDEAS home Printed from https://ideas.repec.org/a/inm/ordeca/v7y2010i4p358-365.html
   My bibliography  Save this article

Eliciting Patients' Revealed Preferences: An Inverse Markov Decision Process Approach

Author

Listed:
  • Zeynep Erkin

    (Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15261)

  • Matthew D. Bailey

    (School of Management, Bucknell University, Lewisburg, Pennsylvania 17837)

  • Lisa M. Maillart

    (Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15261)

  • Andrew J. Schaefer

    (Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15261)

  • Mark S. Roberts

    (Department of Health Policy and Management, University of Pittsburgh, Pittsburgh, Pennsylvania 15261)

Abstract

Estimating patient preferences over various health states is an important problem in health care decision modeling. Direct approaches, which involve asking patients various abstract questions, have significant drawbacks. We propose a new approach that infers patient preferences based on observed decisions via inverse optimization techniques. We illustrate our methods on the timing of a living-donor liver transplant.

Suggested Citation

  • Zeynep Erkin & Matthew D. Bailey & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2010. "Eliciting Patients' Revealed Preferences: An Inverse Markov Decision Process Approach," Decision Analysis, INFORMS, vol. 7(4), pages 358-365, December.
    • Handle: RePEc:inm:ordeca:v:7:y:2010:i:4:p:358-365
    DOI: 10.1287/deca.1100.0185
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/deca.1100.0185
    Download Restriction: no
    File URL: https://libkey.io/10.1287/deca.1100.0185?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stratton C. Jaquette, 1976. "A Utility Criterion for Markov Decision Processes," Management Science, INFORMS, vol. 23(1), pages 43-49, September.
    2. Oguzhan Alagoz & Cindy L. Bryce & Steven Shechter & Andrew Schaefer & Chung-Chou H. Chang & Derek C. Angus & Mark S. Roberts, 2005. "Incorporating Biological Natural History in Simulation Models: Empirical Estimates of the Progression of End-Stage Liver Disease," Medical Decision Making, , vol. 25(6), pages 620-632, November.
    3. Ravindra K. Ahuja & James B. Orlin, 2001. "Inverse Optimization," Operations Research, INFORMS, vol. 49(5), pages 771-783, October.
    4. Garber, Alan M. & Phelps, Charles E., 1997. "Economic foundations of cost-effectiveness analysis," Journal of Health Economics, Elsevier, vol. 16(1), pages 1-31, February.
    5. Burhaneddin Sandıkçı & Lisa M. Maillart & Andrew J. Schaefer & Oguzhan Alagoz & Mark S. Roberts, 2008. "Estimating the Patient's Price of Privacy in Liver Transplantation," Operations Research, INFORMS, vol. 56(6), pages 1393-1410, December.
    6. Bleichrodt, Han & Wakker, Peter & Johannesson, Magnus, 1997. "Characterizing QALYs by Risk Neutrality," Journal of Risk and Uncertainty, Springer, vol. 15(2), pages 107-114, November.
    7. Oguzhan Alagoz & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2004. "The Optimal Timing of Living-Donor Liver Transplantation," Management Science, INFORMS, vol. 50(10), pages 1420-1430, October.
    8. Evan L. Porteus, 1975. "On the Optimality of Structured Policies in Countable Stage Decision Processes," Management Science, INFORMS, vol. 22(2), pages 148-157, October.
    9. Dennis Vrecko & Alexander Klos & Thomas Langer, 2009. "Impact of Presentation Format and Self-Reported Risk Aversion on Revealed Skewness Preferences," Decision Analysis, INFORMS, vol. 6(2), pages 57-74, June.
    10. Culyer, A J, 1989. "The Normative Economics of Health Care Finance and Provision," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 5(1), pages 34-58, Spring.
    11. Scott Carr & William Lovejoy, 2000. "The Inverse Newsvendor Problem: Choosing an Optimal Demand Portfolio for Capacitated Resources," Management Science, INFORMS, vol. 46(7), pages 912-927, July.
    12. Ronald A. Howard & James E. Matheson, 1972. "Risk-Sensitive Markov Decision Processes," Management Science, INFORMS, vol. 18(7), pages 356-369, March.
    13. Dial, Robert B., 1999. "Minimal-revenue congestion pricing part I: A fast algorithm for the single-origin case," Transportation Research Part B: Methodological, Elsevier, vol. 33(3), pages 189-202, April.
    14. Oguzhan Alagoz & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2007. "Choosing Among Living-Donor and Cadaveric Livers," Management Science, INFORMS, vol. 53(11), pages 1702-1715, November.
    15. Torrance, George W., 1976. "Social preferences for health states: An empirical evaluation of three measurement techniques," Socio-Economic Planning Sciences, Elsevier, vol. 10(3), pages 129-136.
    16. Clemens Heuberger, 2004. "Inverse Combinatorial Optimization: A Survey on Problems, Methods, and Results," Journal of Combinatorial Optimization, Springer, vol. 8(3), pages 329-361, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abdullah Gökçınar & Metin Çakanyıldırım & Theodore Price & Meredith C. B. Adams, 2022. "Balanced Opioid Prescribing via a Clinical Trade-Off: Pain Relief vs. Adverse Effects of Discomfort, Dependence, and Tolerance/Hypersensitivity," Decision Analysis, INFORMS, vol. 19(4), pages 297-318, December.
    2. Timothy C. Y. Chan & Tim Craig & Taewoo Lee & Michael B. Sharpe, 2014. "Generalized Inverse Multiobjective Optimization with Application to Cancer Therapy," Operations Research, INFORMS, vol. 62(3), pages 680-695, June.
    3. L. Robin Keller & Ali Abbas & J. Eric Bickel & Vicki M. Bier & David V. Budescu & John C. Butler & Enrico Diecidue & Robin L. Dillon-Merrill & Raimo P. Hämäläinen & Kenneth C. Lichtendahl & Jason R. W, 2012. "From the Editors ---Brainstorming, Multiplicative Utilities, Partial Information on Probabilities or Outcomes, and Regulatory Focus," Decision Analysis, INFORMS, vol. 9(4), pages 297-302, December.
    4. L. Robin Keller & Ali Abbas & Manel Baucells & Vicki M. Bier & David Budescu & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Ahti Salo & George Wu, 2010. "From the Editors..," Decision Analysis, INFORMS, vol. 7(4), pages 327-330, December.
      • L. Robin Keller & Manel Baucells & Kevin F. McCardle & Gregory S. Parnell & Ahti Salo, 2007. "From the Editors..," Decision Analysis, INFORMS, vol. 4(4), pages 173-175, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2008. "From the Editors..," Decision Analysis, INFORMS, vol. 5(4), pages 173-176, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2009. "From the Editors ..," Decision Analysis, INFORMS, vol. 6(4), pages 199-201, December.
    5. Merve Bodur & Timothy C. Y. Chan & Ian Yihang Zhu, 2022. "Inverse Mixed Integer Optimization: Polyhedral Insights and Trust Region Methods," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1471-1488, May.
    6. Zhou, Mo, 2017. "Valuing environmental amenities through inverse optimization: Theory and case study," Journal of Environmental Economics and Management, Elsevier, vol. 83(C), pages 217-230.
    7. Turgay Ayer, 2015. "Inverse optimization for assessing emerging technologies in breast cancer screening," Annals of Operations Research, Springer, vol. 230(1), pages 57-85, July.
    8. Vusal Babashov & Antoine Sauré & Onur Ozturk & Jonathan Patrick, 2023. "Setting wait time targets in a multi‐priority patient setting," Production and Operations Management, Production and Operations Management Society, vol. 32(6), pages 1958-1974, June.
    9. Ghobadi, Kimia & Mahmoudzadeh, Houra, 2021. "Inferring linear feasible regions using inverse optimization," European Journal of Operational Research, Elsevier, vol. 290(3), pages 829-843.
    10. L. Robin Keller & Kelly M. Kophazi, 2011. "From the Editors---Deterrence, Multiattribute Utility, and Probability and Bayes' Updating," Decision Analysis, INFORMS, vol. 8(2), pages 83-87, June.
    11. Wenjuan Fan & Yang Zong & Subodha Kumar, 2022. "Optimal treatment of chronic kidney disease with uncertainty in obtaining a transplantable kidney: an MDP based approach," Annals of Operations Research, Springer, vol. 316(1), pages 269-302, September.
    12. Ashish K. Rathore & Arpan K. Kar & P. Vigneswara Ilavarasan, 2017. "Social Media Analytics: Literature Review and Directions for Future Research," Decision Analysis, INFORMS, vol. 14(4), pages 229-249, December.
    13. Timothy C. Y. Chan & Taewoo Lee & Daria Terekhov, 2019. "Inverse Optimization: Closed-Form Solutions, Geometry, and Goodness of Fit," Management Science, INFORMS, vol. 65(3), pages 1115-1135, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sakine Batun & Andrew J. Schaefer & Atul Bhandari & Mark S. Roberts, 2018. "Optimal Liver Acceptance for Risk-Sensitive Patients," Service Science, INFORMS, vol. 10(3), pages 320-333, September.
    2. Sen Lin & Bo Li & Antonio Arreola-Risa & Yiwei Huang, 2023. "Optimizing a single-product production-inventory system under constant absolute risk aversion," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(3), pages 510-537, October.
    3. Kevin Haninger & James K. Hammitt, 2011. "Diminishing Willingness to Pay per Quality‐Adjusted Life Year: Valuing Acute Foodborne Illness," Risk Analysis, John Wiley & Sons, vol. 31(9), pages 1363-1380, September.
    4. Lucy Gongtao Chen & Daniel Zhuoyu Long & Melvyn Sim, 2015. "On Dynamic Decision Making to Meet Consumption Targets," Operations Research, INFORMS, vol. 63(5), pages 1117-1130, October.
    5. Timothy C. Y. Chan & Tim Craig & Taewoo Lee & Michael B. Sharpe, 2014. "Generalized Inverse Multiobjective Optimization with Application to Cancer Therapy," Operations Research, INFORMS, vol. 62(3), pages 680-695, June.
    6. Mustafa Akan & Oguzhan Alagoz & Baris Ata & Fatih Safa Erenay & Adnan Said, 2012. "A Broader View of Designing the Liver Allocation System," Operations Research, INFORMS, vol. 60(4), pages 757-770, August.
    7. Monahan, George E. & Sobel, Matthew J., 1997. "Risk-Sensitive Dynamic Market Share Attraction Games," Games and Economic Behavior, Elsevier, vol. 20(2), pages 149-160, August.
    8. Oguzhan Alagoz & Heather Hsu & Andrew J. Schaefer & Mark S. Roberts, 2010. "Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty," Medical Decision Making, , vol. 30(4), pages 474-483, July.
    9. Burhaneddin Sandıkçı & Lisa M. Maillart & Andrew J. Schaefer & Oguzhan Alagoz & Mark S. Roberts, 2008. "Estimating the Patient's Price of Privacy in Liver Transplantation," Operations Research, INFORMS, vol. 56(6), pages 1393-1410, December.
    10. Sepehr Nemati & Zeynep G. Icten & Lisa M. Maillart & Andrew J. Schaefer, 2020. "Mitigating Information Asymmetry in Liver Allocation," INFORMS Journal on Computing, INFORMS, vol. 32(2), pages 234-248, April.
    11. Bleichrodt, Han & Quiggin, John, 1999. "Life-cycle preferences over consumption and health: when is cost-effectiveness analysis equivalent to cost-benefit analysis?," Journal of Health Economics, Elsevier, vol. 18(6), pages 681-708, December.
    12. Burhaneddin Sandıkçı & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2013. "Alleviating the Patient's Price of Privacy Through a Partially Observable Waiting List," Management Science, INFORMS, vol. 59(8), pages 1836-1854, August.
    13. Oguzhan Alagoz & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2007. "Determining the Acceptance of Cadaveric Livers Using an Implicit Model of the Waiting List," Operations Research, INFORMS, vol. 55(1), pages 24-36, February.
    14. Mason, J.E. & Denton, B.T. & Shah, N.D. & Smith, S.A., 2014. "Optimizing the simultaneous management of blood pressure and cholesterol for type 2 diabetes patients," European Journal of Operational Research, Elsevier, vol. 233(3), pages 727-738.
    15. Zhang, Jianzhong & Xu, Chengxian, 2010. "Inverse optimization for linearly constrained convex separable programming problems," European Journal of Operational Research, Elsevier, vol. 200(3), pages 671-679, February.
    16. Bennet Gebken & Sebastian Peitz, 2021. "Inverse multiobjective optimization: Inferring decision criteria from data," Journal of Global Optimization, Springer, vol. 80(1), pages 3-29, May.
    17. Abumoslem Mohammadi & Javad Tayyebi, 2019. "Maximum Capacity Path Interdiction Problem with Fixed Costs," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 36(04), pages 1-21, August.
    18. Oguzhan Alagoz & Jagpreet Chhatwal & Elizabeth S. Burnside, 2013. "Optimal Policies for Reducing Unnecessary Follow-Up Mammography Exams in Breast Cancer Diagnosis," Decision Analysis, INFORMS, vol. 10(3), pages 200-224, September.
    19. Nguyen, Kien Trung & Hung, Nguyen Thanh, 2021. "The minmax regret inverse maximum weight problem," Applied Mathematics and Computation, Elsevier, vol. 407(C).
    20. Liqun Liu & Andrew J. Rettenmaier & Thomas R. Saving, 2008. "Longevity bias in cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 17(4), pages 523-534, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ordeca:v:7:y:2010:i:4:p:358-365. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.