IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v16y2024i12p480-d1550566.html
   My bibliography  Save this article

A Survey of Scenario Generation for Automated Vehicle Testing and Validation

Author

Listed:
  • Ziyu Wang

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

  • Jing Ma

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

  • Edmund M-K Lai

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

Abstract

This survey explores the evolution of test scenario generation for autonomous vehicles (AVs), distinguishing between non-adaptive and adaptive scenario approaches. Non-adaptive scenarios, where dynamic objects follow predetermined scripts, provide repeatable and reliable tests but fail to capture the complexity and unpredictability of real-world traffic interactions. In contrast, adaptive scenarios, which adapt in real time to environmental changes, offer a more realistic simulation of traffic conditions, enabling the assessment of an AV system’s adaptability, safety, and robustness. The shift from non-adaptive to adaptive scenarios is increasingly emphasized in AV research, to better evaluate system performance in complex environments. However, generating adaptive scenario is more complex and faces challenges. These include the limited diversity in behaviors, low model interpretability, and high resource requirements. Future research should focus on enhancing the efficiency of adaptive scenario generation and developing comprehensive evaluation metrics to improve the realism and effectiveness of AV testing.

Suggested Citation

  • Ziyu Wang & Jing Ma & Edmund M-K Lai, 2024. "A Survey of Scenario Generation for Automated Vehicle Testing and Validation," Future Internet, MDPI, vol. 16(12), pages 1-17, December.
  • Handle: RePEc:gam:jftint:v:16:y:2024:i:12:p:480-:d:1550566
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/16/12/480/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1999-5903/16/12/480/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    2. Peter W. Glynn & Donald L. Iglehart, 1989. "Importance Sampling for Stochastic Simulations," Management Science, INFORMS, vol. 35(11), pages 1367-1392, November.
    3. Shuo Feng & Xintao Yan & Haowei Sun & Yiheng Feng & Henry X. Liu, 2021. "Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment," Nature Communications, Nature, vol. 12(1), pages 1-14, December.
    4. Kalra, Nidhi & Paddock, Susan M., 2016. "Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 94(C), pages 182-193.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Henry X. Liu & Shuo Feng, 2024. "Curse of rarity for autonomous vehicles," Nature Communications, Nature, vol. 15(1), pages 1-5, December.
    2. Wei, Cheng & Hui, Fei & Khattak, Asad J. & Zhao, Xiangmo & Jin, Shaojie, 2023. "Batch human-like trajectory generation for multi-motion-state NPC-vehicles in autonomous driving virtual simulation testing," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 616(C).
    3. Demin Nalic & Aleksa Pandurevic & Arno Eichberger & Martin Fellendorf & Branko Rogic, 2021. "Software Framework for Testing of Automated Driving Systems in the Traffic Environment of Vissim," Energies, MDPI, vol. 14(11), pages 1-9, May.
    4. Gisèle Umbhauer, 2015. "Almost common value auctions and discontinuous equilibria," Post-Print hal-01735849, HAL.
    5. Philippe Jehiel & Jakub Steiner, 2020. "Selective Sampling with Information-Storage Constraints [On interim rationality, belief formation and learning in decision problems with bounded memory]," The Economic Journal, Royal Economic Society, vol. 130(630), pages 1753-1781.
    6. Hitoshi Matsushima, 2017. "Framing Game Theory," CARF F-Series CARF-F-425, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    7. Vincent P. Crawford & Nagore Iriberri, 2004. "Fatal Attraction: Focality, Naivete, and Sophistication in Experimental Hide-and-Seek Games," Levine's Bibliography 122247000000000316, UCLA Department of Economics.
    8. Andrea Bertolini & Massimo Riccaboni, 2021. "Grounding the case for a European approach to the regulation of automated driving: the technology-selection effect of liability rules," European Journal of Law and Economics, Springer, vol. 51(2), pages 243-284, April.
    9. Strzalecki, Tomasz, 2014. "Depth of reasoning and higher order beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 108-122.
    10. Quement, Mark T. Le & Marcin, Isabel, 2020. "Communication and voting in heterogeneous committees: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 174(C), pages 449-468.
    11. Willemien Kets, 2014. "Finite Depth of Reasoning and Equilibrium Play in Games with Incomplete Information," Discussion Papers 1569, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    12. Sylvain Chassang & Christian Zehnder, 2019. "Secure Survey Design in Organizations: Theory and Experiments," Working Papers 2019-22, Princeton University. Economics Department..
    13. Philippe Jehiel & Laurent Lamy, 2015. "On absolute auctions and secret reserve prices," RAND Journal of Economics, RAND Corporation, vol. 46(2), pages 241-270, June.
    14. Dengler, Sebastian & Prüfer, Jens, 2021. "Consumers' privacy choices in the era of big data," Games and Economic Behavior, Elsevier, vol. 130(C), pages 499-520.
    15. Alaoui, Larbi & Janezic, Katharina A. & Penta, Antonio, 2020. "Reasoning about others' reasoning," Journal of Economic Theory, Elsevier, vol. 189(C).
    16. Prusty, B Rajanarayan & Jena, Debashisha, 2017. "A critical review on probabilistic load flow studies in uncertainty constrained power systems with photovoltaic generation and a new approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 1286-1302.
    17. Choo, Lawrence C.Y & Kaplan, Todd R., 2014. "Explaining Behavior in the "11-20" Game," MPRA Paper 52808, University Library of Munich, Germany.
    18. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    19. Philippe Jehiel & Laurent Lamy, 2011. "Absolute auctions and secret reserve prices: Why are they used?," Levine's Working Paper Archive 786969000000000316, David K. Levine.
    20. Miettinen, Topi, 2008. "Analogy-based Expectations and the Partially Cursed Equilibrium," SSE/EFI Working Paper Series in Economics and Finance 708, Stockholm School of Economics, revised 12 Dec 2008.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:16:y:2024:i:12:p:480-:d:1550566. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.