IDEAS home Printed from https://ideas.repec.org/a/wsi/jeapmx/v18y2016i01ns1464333216500083.html
   My bibliography  Save this article

An International Review of Ex-Post Project Evaluation Schemes in the Transport Sector

Author

Listed:
  • Morten Skou Nicolaisen

    (Department of Development and Planning, Aalborg University, Skibbrogade 3, 9000 Aalborg, Denmark)

  • Patrick A. Driscoll

    (Department of Development and Planning, Aalborg University, Skibbrogade 3, 9000 Aalborg, Denmark)

Abstract

There are a number of ex-post (or post-opening) project evaluation schemes used by national transportation authorities in, among others, England, Scotland, France, Australia, New Zealand, Japan, Norway and the US. Additionally, many of the multilateral and bilateral lending institutions, such as the World Bank, the European Bank for Reconstruction and Development, the Inter-American Development Bank and the Asian Development Bank conduct ex-post project reviews of transport projects in the rail and road sectors. This paper presents a literature review of the various ex-post evaluation schemes in order to establish a state-of-the-art in ex-post road and rail project evaluation, develops an analytic typology of ex-post evaluation schemes and finally presents an in-depth case study of two ex-post evaluation schemes in Norway and England in order to provide a more detailed analysis of the process, structure and policy learning potential within ex-post project evaluation. In comparison to the extensive focus on ex-ante project appraisal, ex-post evaluations have received significantly less attention from academics and practitioners alike. The main findings are as follows: (1) Despite the widespread use globally of ex-post evaluation schemes in the transport sector, there remain significant differences in quality, coverage and comprehensiveness of the schemes. There is a striking lack of standardised methods of conducting ex-post evaluations at the national level, inhibiting the comparability and learning potential; (2) Even with legal mandates and decades of practice, data archiving and retrieval is a widespread problem for national transport planning agencies and (3) How to handle the counter-factual option (i.e. do-nothing/do-minimum/null option) is still very much an open question, which has significant impacts upon the forecasted and outturn benefit/cost ratios and environmental/social impacts.

Suggested Citation

  • Morten Skou Nicolaisen & Patrick A. Driscoll, 2016. "An International Review of Ex-Post Project Evaluation Schemes in the Transport Sector," Journal of Environmental Assessment Policy and Management (JEAPM), World Scientific Publishing Co. Pte. Ltd., vol. 18(01), pages 1-33, March.
  • Handle: RePEc:wsi:jeapmx:v:18:y:2016:i:01:n:s1464333216500083
    DOI: 10.1142/S1464333216500083
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S1464333216500083
    Download Restriction: Access to full text is restricted to subscribers

    File URL: https://libkey.io/10.1142/S1464333216500083?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Parthasarathi, Pavithra & Levinson, David, 2010. "Post-construction evaluation of traffic forecast accuracy," Transport Policy, Elsevier, vol. 17(6), pages 428-443, November.
    2. Cantarelli, C.C. & Molin, E.J.E. & van Wee, B. & Flyvbjerg, B., 2012. "Characteristics of cost overruns for Dutch transport infrastructure projects and the importance of the decision to build and project phases," Transport Policy, Elsevier, vol. 22(C), pages 49-56.
    3. Adam Millard‐Ball & Lee Schipper, 2011. "Are We Reaching Peak Travel? Trends in Passenger Transport in Eight Industrialized Countries," Transport Reviews, Taylor & Francis Journals, vol. 31(3), pages 357-378.
    4. Moshe Givoni & Frédéric Dobruszkes, 2013. "A Review of Ex-Post Evidence for Mode Substitution and Induced Demand Following the Introduction of High-Speed Rail," ULB Institutional Repository 2013/152140, ULB -- Universite Libre de Bruxelles.
    5. Bristow, A. L. & Nellthorp, J., 2000. "Transport project appraisal in the European Union," Transport Policy, Elsevier, vol. 7(1), pages 51-60, January.
    6. Sanko, Nobuhiro & Morikawa, Takayuki & Nagamatsu, Yoshitaka, 2013. "Post-project evaluation of travel demand forecasts: Implications from the case of a Japanese railway," Transport Policy, Elsevier, vol. 27(C), pages 209-218.
    7. Pohl, Gerhard & Mihaljek, Dubravko, 1992. "Project Evaluation and Uncertainty in Practice: A Statistical Analysis of Rate-of-Return Divergences of 1,015 World Bank Projects," The World Bank Economic Review, World Bank, vol. 6(2), pages 255-277, May.
    8. Olsson, Nils O.E. & Krane, Hans Petter & Rolstadås, Asbjørn & Veiseth, Mads, 2010. "Influence of reference points in ex post evaluations of rail infrastructure projects," Transport Policy, Elsevier, vol. 17(4), pages 251-258, August.
    9. Vickerman, R., 2000. "Evaluation methodologies for transport projects in the United Kingdom," Transport Policy, Elsevier, vol. 7(1), pages 7-16, January.
    10. Jos Arts & Hens A. C. Runhaar & Thomas B. Fischer & Urmila Jha-Thakur & Frank Van Laerhoven & Peter P. J. Driessen & Vincent Onyango, 2012. "The Effectiveness Of Eia As An Instrument For Environmental Governance: Reflecting On 25 Years Of Eia Practice In The Netherlands And The Uk," Journal of Environmental Assessment Policy and Management (JEAPM), World Scientific Publishing Co. Pte. Ltd., vol. 14(04), pages 1-40.
    11. Gerard Jong & Andrew Daly & Marits Pieters & Stephen Miller & Ronald Plasmeijer & Frank Hofman, 2007. "Uncertainty in traffic forecasts: literature review and new results for The Netherlands," Transportation, Springer, vol. 34(4), pages 375-395, July.
    12. Marsden, Greg & Stead, Dominic, 2011. "Policy transfer and learning in the field of transport: A review of concepts and evidence," Transport Policy, Elsevier, vol. 18(3), pages 492-500, May.
    13. Marsden, G. & Frick, K.T. & May, A.D. & Deakin, E., 2011. "How do cities approach policy innovation and policy learning? A study of 30 policies in Northern Europe and North America," Transport Policy, Elsevier, vol. 18(3), pages 501-512, May.
    14. Li, Zheng & Hensher, David A. & Rose, John M., 2010. "Willingness to pay for travel time reliability in passenger transport: A review and some new empirical evidence," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 46(3), pages 384-403, May.
    15. Anguera, Ricard, 2006. "The Channel Tunnel--an ex post economic evaluation," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(4), pages 291-315, May.
    16. Odeck, James, 2004. "Cost overruns in road construction--what are their sizes and determinants?," Transport Policy, Elsevier, vol. 11(1), pages 43-53, January.
    17. Moshe Givoni & Frédéric Dobruszkes, 2013. "A Review of Ex-Post Evidence for Mode Substitution and Induced Demand Following the Introduction of High-Speed Rail," Transport Reviews, Taylor & Francis Journals, vol. 33(6), pages 720-742, November.
    18. Yves Crozet, 2013. "High-Speed Rail Performance in France: From Appraisal Methodologies to Ex-post Evaluation," International Transport Forum Discussion Papers 2013/26, OECD Publishing.
    19. Robert Bain, 2009. "Error and optimism bias in toll road traffic forecasts," Transportation, Springer, vol. 36(5), pages 469-482, September.
    20. Welde, Morten, 2011. "Demand and operating cost forecasting accuracy for toll road projects," Transport Policy, Elsevier, vol. 18(5), pages 765-771, September.
    21. María de los Ángeles Baeza & José Manuel Vassallo, 2010. "Private concession contracts for toll roads in Spain: analysis and recommendations," Public Money & Management, Taylor & Francis Journals, vol. 30(5), pages 299-304, September.
    22. Hayashi, Y. & Morisugi, H., 2000. "International comparison of background concept and methodology of transportation project appraisal," Transport Policy, Elsevier, vol. 7(1), pages 73-88, January.
    23. Banister, David, 2008. "The sustainable mobility paradigm," Transport Policy, Elsevier, vol. 15(2), pages 73-80, March.
    24. Morten Skou Nicolaisen & Patrick Arthur Driscoll, 2014. "Ex-Post Evaluations of Demand Forecast Accuracy: A Literature Review," Transport Reviews, Taylor & Francis Journals, vol. 34(4), pages 540-557, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chiara Pancotti & Matteo Pedralli & Geert Smit & Silvia Vignetti, 2020. "Understanding transport project appraisal in its institutional dimension," Working Papers 201902, CSIL Centre for Industrial Studies.
    2. Petr Halámek & Radka Matuszková & Michal Radimský, 2021. "Modernisation of Regional Roads Evaluated Using Ex-Post CBA," Sustainability, MDPI, vol. 13(4), pages 1-20, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlos Oliveira Cruz & Joaquim Miranda Sarmento, 2020. "Traffic forecast inaccuracy in transportation: a literature review of roads and railways projects," Transportation, Springer, vol. 47(4), pages 1571-1606, August.
    2. Maria Börjesson & Jonas Eliasson & Mattias Lundberg, 2014. "Is CBA Ranking of Transport Investments Robust?," Journal of Transport Economics and Policy, University of Bath, vol. 48(2), pages 189-204, May.
    3. Andersson, Matts & Brundell-Freij, Karin & Eliasson, Jonas, 2017. "Validation of aggregate reference forecasts for passenger transport," Transportation Research Part A: Policy and Practice, Elsevier, vol. 96(C), pages 101-118.
    4. West, Jens & Börjesson, Maria & Engelson, Leonid, 2016. "Accuracy of the Gothenburg congestion charges forecast," Transportation Research Part A: Policy and Practice, Elsevier, vol. 94(C), pages 266-277.
    5. Andersson, Matts & Brundell-Freij, Karin & Eliasson, Jonas, 2016. "Validation of reference forecasts for passenger transport," Working papers in Transport Economics 2016:15, CTS - Centre for Transport Studies Stockholm (KTH and VTI), revised 07 Jul 2016.
    6. Holz-Rau, Christian & Scheiner, Joachim, 2011. "Safety and travel time in cost-benefit analysis: A sensitivity analysis for North Rhine-Westphalia," Transport Policy, Elsevier, vol. 18(2), pages 336-346, March.
    7. Walker, Joan L. & Chatman, Daniel & Daziano, Ricardo & Erhardt, Gregory & Gao, Song & Mahmassani, Hani & Ory, David & Sall, Elizabeth & Bhat, Chandra & Chim, Nicholas & Daniels, Clint & Gardner, Brian, 2019. "Advancing the Science of Travel Demand Forecasting," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt0v1906ts, Institute of Transportation Studies, UC Berkeley.
    8. Odeck, James, 2019. "Estimating and predicting the operational costs of road tolls: An econometric assessment using panel data," Transportation Research Part A: Policy and Practice, Elsevier, vol. 130(C), pages 466-478.
    9. Asplund, Disa & Eliasson, Jonas, 2016. "Does uncertainty make cost-benefit analyses pointless?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 92(C), pages 195-205.
    10. Carl Koopmans & Piet Rietveld, 2013. "Long-term impacts of mega-projects: the discount rate," Chapters, in: Hugo Priemus & Bert van Wee (ed.), International Handbook on Mega-Projects, chapter 14, pages 313-332, Edward Elgar Publishing.
    11. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2019. "A review of cost–benefit analysis and multicriteria decision analysis from the perspective of sustainable transport in project evaluation," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 7(3), pages 327-358, November.
    12. Canitez, Fatih, 2020. "Transferring sustainable urban mobility policies: An institutional perspective," Transport Policy, Elsevier, vol. 90(C), pages 1-12.
    13. Li, Zheng & Hensher, David A., 2012. "Estimating values of travel time savings for toll roads: Avoiding a common error," Transport Policy, Elsevier, vol. 24(C), pages 60-66.
    14. Sanko, Nobuhiro & Morikawa, Takayuki & Nagamatsu, Yoshitaka, 2013. "Post-project evaluation of travel demand forecasts: Implications from the case of a Japanese railway," Transport Policy, Elsevier, vol. 27(C), pages 209-218.
    15. Nicolaisen, Morten Skou & Næss, Petter, 2015. "Roads to nowhere: The accuracy of travel demand forecasts for do-nothing alternatives," Transport Policy, Elsevier, vol. 37(C), pages 57-63.
    16. Dejan Makovšek & Marian Moszoro, 2018. "Risk pricing inefficiency in public–private partnerships," Transport Reviews, Taylor & Francis Journals, vol. 38(3), pages 298-321, May.
    17. Salling, Kim Bang & Leleur, Steen, 2015. "Accounting for the inaccuracies in demand forecasts and construction cost estimations in transport project evaluation," Transport Policy, Elsevier, vol. 38(C), pages 8-18.
    18. Catalão, Francisco Pinheiro & Cruz, Carlos Oliveira & Sarmento, Joaquim Miranda, 2019. "The determinants of cost deviations and overruns in transport projects, an endogenous models approach," Transport Policy, Elsevier, vol. 74(C), pages 224-238.
    19. Welde, Morten, 2011. "Demand and operating cost forecasting accuracy for toll road projects," Transport Policy, Elsevier, vol. 18(5), pages 765-771, September.
    20. David Gray & Richard Laing & Iain Docherty, 2017. "Delivering lower carbon urban transport choices: European ambition meets the reality of institutional (mis)alignment," Environment and Planning A, , vol. 49(1), pages 226-242, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:jeapmx:v:18:y:2016:i:01:n:s1464333216500083. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/jeapm/jeapm.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.