IDEAS home Printed from https://ideas.repec.org/a/wsi/acsxxx/v23y2020i04ns0219525920500113.html
   My bibliography  Save this article

How Hard Is For Agents To Learn The User Equilibrium? Characterizing Traffic Networks By Means Of Entropy

Author

Listed:
  • CAMIL S. Z. REDWAN

    (Instituto de Informática, UFRGS, C.P. 15064, 91501-970 P. Alegre, RS, Brazil)

  • ANA L. C. BAZZAN

    (Instituto de Informática, UFRGS, C.P. 15064, 91501-970 P. Alegre, RS, Brazil)

Abstract

Traffic assignment is an important stage in the task of modeling a transportation system. Several methods for solving the traffic assignment problem (TAP) were proposed, mostly based on iterative procedures. However, little was done in the direction of analyzing the difficulty of such procedures. For instance, why is it that some networks require orders of magnitude more iterations than others? What matters in this task? Clearly, the topology of the network can only give hints up to a certain level; the assignment task is fundamentally tied to how the demand is distributed (among other characteristics of the problem). This means that methods to estimate the complexity of a network (e.g. those based on centrality measures) can only help up to a certain level. The motivation for this work is to, a priori, estimate how hard will the effort underlying solving the TAP be (i.e. without doing the actual assignment). It arose from the fact that after performing assignment in several different networks, we noted that finding the solution for the problem was much easier for some networks than for others. Specifically, the more complex the network, the more difficulty it is to setup the parameters underlying the procedure for solving the TAP. In this work, we propose a new measure of how coupled routes in a network are, based on an estimation of the demand distribution. Our approach involves three main steps: (i) sampling the universe of all possible assignments, (ii) creating a model that gives the incentive a road user has for changing routes, as well as the asymptotic distribution of preference for routes, and (iii) computing the entropy of this distribution. This approach is experimentally validated using several networks of different natures. We then solve the TAP by letting road users use reinforcement learning to learn the user equilibrium. With this, we are able to make important relationships between the entropy values and how hard are the learning tasks. Results suggest that it is possible to use both the entropy values as well as the asymptotic distribution of preferences of the road users to gain important information that guides the traffic expert. For instance, the higher the entropy, the higher the indication that more than one route is perceived as preferable and, hence, the more difficult the learning task.

Suggested Citation

  • Camil S. Z. Redwan & Ana L. C. Bazzan, 2020. "How Hard Is For Agents To Learn The User Equilibrium? Characterizing Traffic Networks By Means Of Entropy," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 23(04), pages 1-32, June.
  • Handle: RePEc:wsi:acsxxx:v:23:y:2020:i:04:n:s0219525920500113
    DOI: 10.1142/S0219525920500113
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S0219525920500113
    Download Restriction: Access to full text is restricted to subscribers

    File URL: https://libkey.io/10.1142/S0219525920500113?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:acsxxx:v:23:y:2020:i:04:n:s0219525920500113. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/acs/acs.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.