IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v62y2023i3d10.1007_s10614-022-10276-0.html
   My bibliography  Save this article

Boosting the Scalability of Farm-Level Models: Efficient Surrogate Modeling of Compositional Simulation Output

Author

Listed:
  • Christian Troost

    (Hans-Ruthenberg-Institute, University of Hohenheim)

  • Julia Parussis-Krech

    (Hans-Ruthenberg-Institute, University of Hohenheim)

  • Matías Mejaíl

    (Hans-Ruthenberg-Institute, University of Hohenheim)

  • Thomas Berger

    (Hans-Ruthenberg-Institute, University of Hohenheim)

Abstract

Surrogate modeling can overcome computational and data-privacy constraints of micro-scale economic models and support their incorporation into large-scale simulations and interactive simulation experiments. We compare four data-driven methods to reproduce the aggregated crop area response simulated by farm-level modeling in response to price variation. We use the isometric log-ratio transformation to accommodate the compositional nature of the output and sequential sampling with stability analysis for efficient model selection. Extreme gradient boosting outperforms multivariate adaptive regressions splines, random forest regression, and classical multinomial-logistic regression and achieves high goodness-of-fit from moderately sized samples. Explicitly including ratio terms between price input variables considerably improved prediction, even for highly automatic machine learning methods that should in principle be able to detect such input variable interaction automatically. The presented methodology provides a solid basis for the use of surrogate modeling to support the incorporation of micro-scale models into large-scale integrated simulations and interactive simulation experiments with stakeholders.

Suggested Citation

  • Christian Troost & Julia Parussis-Krech & Matías Mejaíl & Thomas Berger, 2023. "Boosting the Scalability of Farm-Level Models: Efficient Surrogate Modeling of Compositional Simulation Output," Computational Economics, Springer;Society for Computational Economics, vol. 62(3), pages 721-759, October.
  • Handle: RePEc:kap:compec:v:62:y:2023:i:3:d:10.1007_s10614-022-10276-0
    DOI: 10.1007/s10614-022-10276-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-022-10276-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-022-10276-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    2. Sander Hoog, 2019. "Surrogate Modelling in (and of) Agent-Based Models: A Prospectus," Computational Economics, Springer;Society for Computational Economics, vol. 53(3), pages 1245-1263, March.
    3. Isabelle Salle & Murat Yıldızoğlu, 2014. "Efficient Sampling and Meta-Modeling for Computational Economic Models," Computational Economics, Springer;Society for Computational Economics, vol. 44(4), pages 507-536, December.
    4. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    5. Hugo Storm & Kathy Baylis & Thomas Heckelei, 2020. "Machine learning in agricultural and applied economics," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 47(3), pages 849-892.
    6. Bernd Lengers & Wolfgang Britz & Karin Holm-Müller, 2014. "What Drives Marginal Abatement Costs of Greenhouse Gases on Dairy Farms? A Meta-modelling Approach," Journal of Agricultural Economics, Wiley Blackwell, vol. 65(3), pages 579-599, September.
    7. Kremmydas, Dimitris & Athanasiadis, Ioannis N. & Rozakis, Stelios, 2018. "A review of Agent Based Modeling for agricultural policy evaluation," Agricultural Systems, Elsevier, vol. 164(C), pages 95-106.
    8. Friedman, Jerome H., 2002. "Stochastic gradient boosting," Computational Statistics & Data Analysis, Elsevier, vol. 38(4), pages 367-378, February.
    9. John M Antle, 2019. "Data, Economics and Computational Agricultural Science," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 101(2), pages 365-382.
    10. Mössinger, Johannes & Troost, Christian & Berger, Thomas, 2022. "Bridging the gap between models and users: A lightweight mobile interface for optimized farming decisions in interactive modeling sessions," Agricultural Systems, Elsevier, vol. 195(C).
    11. Thomas Berger & Christian Troost, 2014. "Agent-based Modelling of Climate Adaptation and Mitigation Options in Agriculture," Journal of Agricultural Economics, Wiley Blackwell, vol. 65(2), pages 323-348, June.
    12. Christian Troost & Thomas Berger, 2015. "Dealing with Uncertainty in Agent-Based Simulation: Farm-Level Modeling of Adaptation to Climate Change in Southwest Germany," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(3), pages 833-854.
    13. repec:hal:spmain:info:hdl:2441/13thfd12aa8rmplfudlgvgahff is not listed on IDEAS
    14. Lee, Ju-Sung & Filatova, Tatiana & Ligmann-Zielinska, Arika & Hassani-Mahmooei, Behrooz & Stonedahl, Forrest & Lorscheid, Iris & Voinov, Alexey & Polhill, J. Gareth & Sun, Zhanli & Parker, Dawn C., 2015. "The complexities of agent-based modeling output analysis," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 18(4).
    15. Reidsma, Pytrik & Janssen, Sander & Jansen, Jacques & van Ittersum, Martin K., 2018. "On the development and use of farm models for policy impact assessment in the European Union – A review," Agricultural Systems, Elsevier, vol. 159(C), pages 111-125.
    16. van Wijk, Mark T., 2014. "From global economic modelling to household level analyses of food security and sustainability: How big is the gap and can we bridge it?," Food Policy, Elsevier, vol. 49(P2), pages 378-388.
    17. Happe, Kathrin & Kellermann, Konrad & Balmann, Alfons, 2006. "Agent-based analysis of agricultural policies: An illustration of the agricultural policy simulator AgriPoliS, its adaptation and behavior," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 11(1).
    18. Isabelle Salle & Murat Yıldızoğlu, 2014. "Efficient Sampling and Meta-Modeling for Computational Economic Models," Computational Economics, Springer;Society for Computational Economics, vol. 44(4), pages 507-536, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert Huber & Hang Xiong & Kevin Keller & Robert Finger, 2022. "Bridging behavioural factors and standard bio‐economic modelling in an agent‐based modelling framework," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(1), pages 35-63, February.
    2. Huber, Robert & Bakker, Martha & Balmann, Alfons & Berger, Thomas & Bithell, Mike & Brown, Calum & Grêt-Regamey, Adrienne & Xiong, Hang & Le, Quang Bao & Mack, Gabriele & Meyfroidt, Patrick & Millingt, 2018. "Representation of decision-making in European agricultural agent-based models," Agricultural Systems, Elsevier, vol. 167(C), pages 143-160.
    3. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    4. Zila, Eric & Kukacka, Jiri, 2023. "Moment set selection for the SMM using simple machine learning," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 366-391.
    5. Coronese, Matteo & Occelli, Martina & Lamperti, Francesco & Roventini, Andrea, 2023. "AgriLOVE: Agriculture, land-use and technical change in an evolutionary, agent-based model," Ecological Economics, Elsevier, vol. 208(C).
    6. Carauta, Marcelo & Troost, Christian & Guzman-Bustamante, Ivan & Hampf, Anna & Libera, Affonso & Meurer, Katharina & Bönecke, Eric & Franko, Uwe & Ribeiro Rodrigues, Renato de Aragão & Berger, Thomas, 2021. "Climate-related land use policies in Brazil: How much has been achieved with economic incentives in agriculture?," Land Use Policy, Elsevier, vol. 109(C).
    7. Kremmydas, Dimitris & Athanasiadis, Ioannis N. & Rozakis, Stelios, 2018. "A review of Agent Based Modeling for agricultural policy evaluation," Agricultural Systems, Elsevier, vol. 164(C), pages 95-106.
    8. Utomo, Dhanan Sarwo & Onggo, Bhakti Stephan & Eldridge, Stephen, 2018. "Applications of agent-based modelling and simulation in the agri-food supply chains," European Journal of Operational Research, Elsevier, vol. 269(3), pages 794-805.
    9. Mössinger, Johannes & Troost, Christian & Berger, Thomas, 2022. "Bridging the gap between models and users: A lightweight mobile interface for optimized farming decisions in interactive modeling sessions," Agricultural Systems, Elsevier, vol. 195(C).
    10. Schaefer, David & Britz, Wolfgang & Kuhn, Till, 2020. "Modelling policy induced manure transports at large scale using an agent-based simulation model," Discussion Papers 305270, University of Bonn, Institute for Food and Resource Economics.
    11. Matteo Coronese & Davide Luzzati, 2022. "Economic impacts of natural hazards and complexity science: a critical review," LEM Papers Series 2022/13, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    12. Lamperti, Francesco & Roventini, Andrea & Sani, Amir, 2018. "Agent-based model calibration using machine learning surrogates," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 366-389.
    13. Sylvain Barde & Sander Van Der Hoog, 2017. "An empirical validation protocol for large-scale agent-based models," Sciences Po publications 17/12, Sciences Po.
    14. Troost, Christian & Huber, Robert & Bell, Andrew R. & van Delden, Hedwig & Filatova, Tatiana & Le, Quang Bao & Lippe, Melvin & Niamir, Leila & Polhill, J. Gareth & Sun, Zhanli & Berger, Thomas, 2023. "How to keep it adequate: A protocol for ensuring validity in agent-based simulation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 159, pages 1-21.
    15. repec:hal:spmain:info:hdl:2441/20hflp7eqn97boh50no50tv67n is not listed on IDEAS
    16. Delli Gatti, Domenico & Grazzini, Jakob, 2020. "Rising to the challenge: Bayesian estimation and forecasting techniques for macroeconomic Agent Based Models," Journal of Economic Behavior & Organization, Elsevier, vol. 178(C), pages 875-902.
    17. Vandin, Andrea & Giachini, Daniele & Lamperti, Francesco & Chiaromonte, Francesca, 2022. "Automated and distributed statistical analysis of economic agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    18. Seidel, Claudia & Shang, Linmei & Britz, Wolfgang, 2023. "A critical assessment of neural networks as meta-model of a farm optimization model," Discussion Papers 338200, University of Bonn, Institute for Food and Resource Economics.
    19. Lisa Baldi & Arfini, Filippo & Calzolai, Sara & Donati, Michele, 2023. "CAP reform and GHG emissions: policy assessment using a PMP agent-based model," 97th Annual Conference, March 27-29, 2023, Warwick University, Coventry, UK 334520, Agricultural Economics Society - AES.
    20. Donovan Platt, 2019. "A Comparison of Economic Agent-Based Model Calibration Methods," Papers 1902.05938, arXiv.org.
    21. Yi Zhang & Zhe Li & Yongchao Zhang, 2020. "Validation and Calibration of an Agent-Based Model: A Surrogate Approach," Discrete Dynamics in Nature and Society, Hindawi, vol. 2020, pages 1-9, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:62:y:2023:i:3:d:10.1007_s10614-022-10276-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.