IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v16y2024i12p480-d1550566.html

A Survey of Scenario Generation for Automated Vehicle Testing and Validation

Author

Listed:
  • Ziyu Wang

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

  • Jing Ma

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

  • Edmund M-K Lai

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

Abstract

This survey explores the evolution of test scenario generation for autonomous vehicles (AVs), distinguishing between non-adaptive and adaptive scenario approaches. Non-adaptive scenarios, where dynamic objects follow predetermined scripts, provide repeatable and reliable tests but fail to capture the complexity and unpredictability of real-world traffic interactions. In contrast, adaptive scenarios, which adapt in real time to environmental changes, offer a more realistic simulation of traffic conditions, enabling the assessment of an AV system’s adaptability, safety, and robustness. The shift from non-adaptive to adaptive scenarios is increasingly emphasized in AV research, to better evaluate system performance in complex environments. However, generating adaptive scenario is more complex and faces challenges. These include the limited diversity in behaviors, low model interpretability, and high resource requirements. Future research should focus on enhancing the efficiency of adaptive scenario generation and developing comprehensive evaluation metrics to improve the realism and effectiveness of AV testing.

Suggested Citation

  • Ziyu Wang & Jing Ma & Edmund M-K Lai, 2024. "A Survey of Scenario Generation for Automated Vehicle Testing and Validation," Future Internet, MDPI, vol. 16(12), pages 1-17, December.
  • Handle: RePEc:gam:jftint:v:16:y:2024:i:12:p:480-:d:1550566
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/16/12/480/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1999-5903/16/12/480/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Peter W. Glynn & Donald L. Iglehart, 1989. "Importance Sampling for Stochastic Simulations," Management Science, INFORMS, vol. 35(11), pages 1367-1392, November.
    2. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    3. Shuo Feng & Xintao Yan & Haowei Sun & Yiheng Feng & Henry X. Liu, 2021. "Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment," Nature Communications, Nature, vol. 12(1), pages 1-14, December.
    4. Kalra, Nidhi & Paddock, Susan M., 2016. "Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 94(C), pages 182-193.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ali Louati & Hassen Louati & Elham Kariri, 2025. "Harmonized Autonomous–Human Vehicles via Simulation for Emissions Reduction in Riyadh City," Future Internet, MDPI, vol. 17(8), pages 1-17, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen Qian & Jingbin Xu & Xin Xing & Feng Guo, 2026. "Test case sampling optimization for safety validation of automated driving systems," Nature Communications, Nature, vol. 17(1), pages 1-13, December.
    2. Henry X. Liu & Shuo Feng, 2024. "Curse of rarity for autonomous vehicles," Nature Communications, Nature, vol. 15(1), pages 1-5, December.
    3. Wang, Tao & Cheng, Yuanle & Chen, Bin & Cao, Feng & Chen, Shukai & Tang, Tie-Qiao, 2026. "Replacing experts by machine in determining the test road grade of autonomous vehicles: Case study in Hefei and policy implications," Transport Policy, Elsevier, vol. 175(C).
    4. Wei, Cheng & Hui, Fei & Khattak, Asad J. & Zhao, Xiangmo & Jin, Shaojie, 2023. "Batch human-like trajectory generation for multi-motion-state NPC-vehicles in autonomous driving virtual simulation testing," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 616(C).
    5. Demin Nalic & Aleksa Pandurevic & Arno Eichberger & Martin Fellendorf & Branko Rogic, 2021. "Software Framework for Testing of Automated Driving Systems in the Traffic Environment of Vissim," Energies, MDPI, vol. 14(11), pages 1-9, May.
    6. Gisèle Umbhauer, 2015. "Almost common value auctions and discontinuous equilibria," Post-Print hal-01735849, HAL.
    7. Wei, Cheng & Mu, Kenan & Hui, Fei & Jan Khattak, Asad, 2025. "Data-driven configurable scenario generation for testing autonomous driving systems in highway environments," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 677(C).
    8. Nichole Szembrot, 2017. "Are voters cursed when politicians conceal policy preferences?," Public Choice, Springer, vol. 173(1), pages 25-41, October.
    9. Hitoshi Matsushima, 2017. "Framing Game Theory," CARF F-Series CARF-F-425, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    10. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," Working Papers halshs-03735680, HAL.
    11. Andrea Bertolini & Massimo Riccaboni, 2021. "Grounding the case for a European approach to the regulation of automated driving: the technology-selection effect of liability rules," European Journal of Law and Economics, Springer, vol. 51(2), pages 243-284, April.
    12. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Conceptual structure and computational organization of the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 223-248.
    13. Kerim Keskin, 2016. "Inverse S-shaped probability weighting functions in first-price sealed-bid auctions," Review of Economic Design, Springer;Society for Economic Design, vol. 20(1), pages 57-67, March.
    14. Quement, Mark T. Le & Marcin, Isabel, 2020. "Communication and voting in heterogeneous committees: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 174(C), pages 449-468.
    15. Luca Corazzini & Stefano Galavotti & Rupert Sausgruber & Paola Valbonesi, 2017. "Allotment in first-price auctions: an experimental investigation," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 70-99, March.
    16. Helland, Leif & Iachan, Felipe S. & Juelsrud, Ragnar E. & Nenov, Plamen T., 2021. "Information quality and regime change: Evidence from the lab," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 538-554.
    17. Willemien Kets, 2014. "Finite Depth of Reasoning and Equilibrium Play in Games with Incomplete Information," Discussion Papers 1569, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    18. Michela Tincani & Fabian Kosse & Enrico Miglino, 2022. "The Effect of Preferential Admissions on the College Participation of Disadvantaged Students: The Role of Pre-College Choices," Working Papers 2022-034, Human Capital and Economic Opportunity Working Group.
    19. Sylvain Chassang & Christian Zehnder, 2024. "Secure Survey Design in Organizations: Theory and Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 16(4), pages 371-405, November.
    20. Moser, Johannes, 2018. "Hypothetical thinking and the winner's curse: An experimental investigation," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181506, Verein für Socialpolitik / German Economic Association.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:16:y:2024:i:12:p:480-:d:1550566. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.