IDEAS home Printed from https://ideas.repec.org/p/zbw/dicedp/285371.html
   My bibliography  Save this paper

Human-machine interactions in pricing: Evidence from two large-scale field experiments

Author

Listed:
  • Huelden, Tobias
  • Jascisens, Vitalijs
  • Roemheld, Lars
  • Werner, Tobias

Abstract

While many companies use algorithms to optimize their pricing, additional human oversight and price interventions are widespread. Human intervention can correct algorithmic flaws and introduce private information into the pricing process, but it may also be based on less sophisticated pricing strategies or suffer from behavioral biases. Using fine-grained data from one of Europe's largest e-commerce companies, we examine the impact of human intervention on the company's commercial performance in two field experiments with around 700,000 products. We show that sizeable heterogeneity exists and present evidence of interventions that harmed commercial performance and interventions that improved firm outcomes. We show that the quality of human interventions can be predicted with algorithmic tools, which allows us to exploit expert knowledge while blocking inefficient interventions.

Suggested Citation

  • Huelden, Tobias & Jascisens, Vitalijs & Roemheld, Lars & Werner, Tobias, 2024. "Human-machine interactions in pricing: Evidence from two large-scale field experiments," DICE Discussion Papers 412, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    • Handle: RePEc:zbw:dicedp:285371
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/285371/1/1883092809.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nikhil Agarwal & Alex Moehring & Pranav Rajpurkar & Tobias Salz, 2023. "Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology," NBER Working Papers 31422, National Bureau of Economic Research, Inc.
    2. Diego Aparicio & Zachary Metzman & Roberto Rigobon, 2021. "The Pricing Strategies of Online Grocery Retailers," NBER Working Papers 28639, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rhodes, Andrew & Zhou, Jidong, 2022. "Personalized Pricing and Competition," MPRA Paper 112988, University Library of Munich, Germany.
    2. David Almog & Romain Gauriot & Lionel Page & Daniel Martin, 2024. "AI Oversight and Human Mistakes: Evidence from Centre Court," Papers 2401.16754, arXiv.org, revised Feb 2024.
    3. Diego Aparicio & Duncan Simester, 2022. "Price Frictions and the Success of New Products," Marketing Science, INFORMS, vol. 41(6), pages 1057-1073, November.
    4. Benjamin R. Shiller, 2022. "Discreet Personalized Pricing," CESifo Working Paper Series 10025, CESifo.
    5. Vladimir Fedoseev & Svetlana Fedoseeva, 2022. "Same DNA, same location, same price? Price differences across distribution e‐channels of a single online retailer," Agribusiness, John Wiley & Sons, Ltd., vol. 38(4), pages 874-884, October.
    6. Sullivan, Tom, 2022. "Price dispersion in the rideshare industry : a study of the Mexico City market," Warwick-Monash Economics Student Papers 40, Warwick Monash Economics Student Papers.
    7. Yuhao Fu & Nobuyuki Hanaki, 2024. "Do people rely on ChatGPT more than their peers to detect fake news?," ISER Discussion Paper 1233, Institute of Social and Economic Research, Osaka University.
    8. Chen, I-Ju & Hsu, Po-Hsuan & Wang, Yanzhi, 2022. "Staggered boards and product innovations: Evidence from Massachusetts State Bill HB 5640," Research Policy, Elsevier, vol. 51(4).
    9. Strasser, Georg & Wieland, Elisabeth & Macias, Paweł & Błażejowska, Aneta & Szafranek, Karol & Wittekopf, David & Franke, Jörn & Henkel, Lukas & Osbat, Chiara, 2023. "E-commerce and price setting: evidence from Europe," Occasional Paper Series 320, European Central Bank.
    10. Andrei Iakovlev & Annie Liang, 2024. "The Value of Context: Human versus Black Box Evaluators," Papers 2402.11157, arXiv.org.
    11. Felix Chopra & Ingar Haaland, 2023. "Conducting qualitative interviews with AI," CEBI working paper series 23-06, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    12. Yang, Nanyin & Palma, Marco & Drichoutis, Andreas C., 2023. "Humanization of Virtual Assistants and Delegation Choices," MPRA Paper 119275, University Library of Munich, Germany.
    13. Kooli, Maher & Zhang, Aoran & Zhao, Yunfei, 2022. "How IPO firms' product innovation strategy affects the likelihood of post-IPO acquisitions?," Journal of Corporate Finance, Elsevier, vol. 72(C).
    14. Aparicio, Diego & Rigobon, Roberto, 2023. "Quantum prices," Journal of International Economics, Elsevier, vol. 143(C).
    15. Jung, Jinho & Kim, Yong J. & Kim, Sanghyo, 2022. "Sales-Weighted Online Agricultural Commodity Price Index: Using Sales and Price Data web-scraped from Online Grocery Stores in South Korea," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322525, Agricultural and Applied Economics Association.
    16. Macias, Paweł & Stelmasiak, Damian & Szafranek, Karol, 2023. "Nowcasting food inflation with a massive amount of online prices," International Journal of Forecasting, Elsevier, vol. 39(2), pages 809-826.
    17. Hannes Ullrich & Michael Allan Ribers, 2023. "Machine predictions and human decisions with variation in payoffs and skill: the case of antibiotic prescribing," Berlin School of Economics Discussion Papers 0027, Berlin School of Economics.
    18. Marie Obidzinski & Yves Oytana, 2024. "Artificial intelligence, inattention and liability rules," Working Papers 2024-08, CRESE.

    More about this item

    Keywords

    Artificial Intelligence; Human-Computer-Interaction; Uniform pricing;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D22 - Microeconomics - - Production and Organizations - - - Firm Behavior: Empirical Analysis
    • L2 - Industrial Organization - - Firm Objectives, Organization, and Behavior
    • L81 - Industrial Organization - - Industry Studies: Services - - - Retail and Wholesale Trade; e-Commerce

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:dicedp:285371. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/diduede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.