IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v56y2022i5d10.1007_s11135-021-01267-8.html
   My bibliography  Save this article

Qualitative reasoning or quantitative aggregation rules for impact assessment of policy options? A multiple criteria framework

Author

Listed:
  • Giuseppe Munda

    (European Commission Joint Research Centre (JRC))

Abstract

When a public administration wishes to implement policies, there is a previous need of comparing different options to assess their social attractiveness. A fair policy assessment process should consider the ethical obligation of taking a plurality of social values, perspectives and interests into account; there is no doubt that Impact Assessment (IA) is then multidimensional in nature. For example, the European Commission current practice on IA considers three main objectives i.e. efficiency, effectiveness (including proportionality) and coherence and it is based on the assessment of various broad impacts such as economic, environmental and social ones. In empirical assessment of public policies and publicly provided goods, Multiple Criteria Decision Analysis is an appropriate policy tool, since it allows taking into account a wide range of assessment criteria (e.g. environmental impact, income distribution, social inclusion, and so on) and not simply profit maximization, as a private economic agent might do. This paper deals with the importance of using appropriate multi-criteria mathematical aggregation rules to guarantee consistency and transparency of results. An illustrative example dealing with a recent EC IA on modernising VAT for cross-border B2C e-Commerce is presented too.

Suggested Citation

  • Giuseppe Munda, 2022. "Qualitative reasoning or quantitative aggregation rules for impact assessment of policy options? A multiple criteria framework," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(5), pages 3259-3277, October.
  • Handle: RePEc:spr:qualqt:v:56:y:2022:i:5:d:10.1007_s11135-021-01267-8
    DOI: 10.1007/s11135-021-01267-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-021-01267-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-021-01267-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Edwin Hinloopen & Peter Nijkamp, 1990. "Qualitative multiple criteria choice analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 24(1), pages 37-56, February.
    2. Bell, Michelle L. & Hobbs, Benjamin F. & Ellis, Hugh, 2003. "The use of multi-criteria decision-making methods in the integrated assessment of climate change: implications for IA practitioners," Socio-Economic Planning Sciences, Elsevier, vol. 37(4), pages 289-316, December.
    3. Podinovskii, Vladislav V., 1994. "Criteria importance theory," Mathematical Social Sciences, Elsevier, vol. 27(3), pages 237-252, June.
    4. Munda, Giuseppe, 2004. "Social multi-criteria evaluation: Methodological foundations and operational consequences," European Journal of Operational Research, Elsevier, vol. 158(3), pages 662-677, November.
    5. Jacopo Torriti, 2010. "Impact Assessment and the Liberalization of the EU Energy Markets: Evidence‐Based Policy‐Making or Policy‐Based Evidence‐Making?," Journal of Common Market Studies, Wiley Blackwell, vol. 48(4), pages 1065-1081, September.
    6. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    7. Kenneth J. Arrow & Herve Raynaud, 1986. "Social Choice and Multicriterion Decision-Making," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262511754, December.
    8. Giuseppe Munda, 2008. "Social Multi-Criteria Evaluation for a Sustainable Economy," Springer Books, Springer, number 978-3-540-73703-2, December.
    9. Jacopo Torriti, 2010. "Impact Assessment and the Liberalization of the EU Energy Markets: Evidence-Based Policy-Making or Policy-Based Evidence-Making?," Journal of Common Market Studies, Wiley Blackwell, vol. 48, pages 1065-1081, September.
    10. Giuseppe Munda, 2012. "Intensity of preference and related uncertainty in non-compensatory aggregation rules," Theory and Decision, Springer, vol. 73(4), pages 649-669, October.
    11. Azzini, Ivano & Munda, Giuseppe, 2020. "A new approach for identifying the Kemeny median ranking," European Journal of Operational Research, Elsevier, vol. 281(2), pages 388-401.
    12. Giuseppe Munda, 2016. "Beyond welfare economics: some methodological issues," Journal of Economic Methodology, Taylor & Francis Journals, vol. 23(2), pages 185-202, June.
    13. Bertrand Mareschal & Jean Pierre Brans & Philippe Vincke, 1986. "How to select and how to rank projects: the Prométhée method," ULB Institutional Repository 2013/9307, ULB -- Universite Libre de Bruxelles.
    14. Brans, J. P. & Vincke, Ph. & Mareschal, B., 1986. "How to select and how to rank projects: The method," European Journal of Operational Research, Elsevier, vol. 24(2), pages 228-238, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giuseppe Munda, 2012. "Intensity of preference and related uncertainty in non-compensatory aggregation rules," Theory and Decision, Springer, vol. 73(4), pages 649-669, October.
    2. Giuseppe Munda, 2015. "Beyond Gdp: An Overview Of Measurement Issues In Redefining ‘Wealth’," Journal of Economic Surveys, Wiley Blackwell, vol. 29(3), pages 403-422, July.
    3. Giuseppe Munda, 2012. "Choosing Aggregation Rules for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 337-354, December.
    4. Szántó, Richárd, 2012. "Több szempontú részvételi döntések a fenntarthatósági értékelésekben. A legnépszerűbb módszerek összehasonlítása [Participatory multi-criteria decision analysis. A comparison of methodologies]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(12), pages 1336-1355.
    5. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    6. Ruiz, Francisco & El Gibari, Samira & Cabello, José M. & Gómez, Trinidad, 2020. "MRP-WSCI: Multiple reference point based weak and strong composite indicators," Omega, Elsevier, vol. 95(C).
    7. Azzini, Ivano & Munda, Giuseppe, 2020. "A new approach for identifying the Kemeny median ranking," European Journal of Operational Research, Elsevier, vol. 281(2), pages 388-401.
    8. Munda, Giuseppe, 2009. "A conflict analysis approach for illuminating distributional issues in sustainability policy," European Journal of Operational Research, Elsevier, vol. 194(1), pages 307-322, April.
    9. Shmelev, Stanislav E. & Rodríguez-Labajos, Beatriz, 2009. "Dynamic multidimensional assessment of sustainability at the macro level: The case of Austria," Ecological Economics, Elsevier, vol. 68(10), pages 2560-2573, August.
    10. Patrícia Bernardes & Petr Iakovlevitch Ekel & Sérgio Fernando Loureiro Rezende & Joel Gomes Pereira Júnior & Angélica Cidália Gouveia Santos & Maurício Andrade Rodrigues Costa & Rafael Lopes Carvalhai, 2022. "Cost of doing business index in Latin America," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(4), pages 2233-2252, August.
    11. Lars Carlsen & Rainer Bruggemann, 2020. "Environmental perception in 33 European countries: an analysis based on partial order," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 22(3), pages 1873-1896, March.
    12. Fusco, Elisa, 2015. "Enhancing non-compensatory composite indicators: A directional proposal," European Journal of Operational Research, Elsevier, vol. 242(2), pages 620-630.
    13. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "The Ordinal Input for Cardinal Output Approach of Non-compensatory Composite Indicators: The PROMETHEE Scoring Method," MPRA Paper 95816, University Library of Munich, Germany.
    14. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
    15. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    16. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    17. Sebastian Schär & Jutta Geldermann, 2021. "Adopting Multiactor Multicriteria Analysis for the Evaluation of Energy Scenarios," Sustainability, MDPI, vol. 13(5), pages 1-19, March.
    18. Dias, Luis C. & Lamboray, Claude, 2010. "Extensions of the prudence principle to exploit a valued outranking relation," European Journal of Operational Research, Elsevier, vol. 201(3), pages 828-837, March.
    19. Walther Zeug & Alberto Bezama & Urs Moesenfechtel & Anne Jähkel & Daniela Thrän, 2019. "Stakeholders’ Interests and Perceptions of Bioeconomy Monitoring Using a Sustainable Development Goal Framework," Sustainability, MDPI, vol. 11(6), pages 1-24, March.
    20. Marta Bottero & Chiara D’Alpaos & Alessandra Oppio, 2019. "Ranking of Adaptive Reuse Strategies for Abandoned Industrial Heritage in Vulnerable Contexts: A Multiple Criteria Decision Aiding Approach," Sustainability, MDPI, vol. 11(3), pages 1-18, February.

    More about this item

    Keywords

    Public policy; Multiple Criteria Decision Analysis; Robustness analysis; Ex-ante impact assessment; Qualitative and quantitative information; SOCRATES;
    All these keywords.

    JEL classification:

    • A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • D04 - Microeconomics - - General - - - Microeconomic Policy: Formulation; Implementation; Evaluation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:56:y:2022:i:5:d:10.1007_s11135-021-01267-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.