IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v12y2020i11p4398-d363753.html
   My bibliography  Save this article

Building a Composite Indicator to Measure Environmental Sustainability Using Alternative Weighting Methods

Author

Listed:
  • José A. Gómez-Limón

    (WEARE: Water, Environmental and Agricultural Resources Economics Research Group, Faculty of Law and Business Sciences, University of Córdoba, 14071 Córdoba, Spain)

  • Manuel Arriaza

    (Department of Agricultural Economics, Institute of Agricultural Research and Training (IFAPA), 14080 Córdoba, Spain)

  • M. Dolores Guerrero-Baena

    (WEARE: Water, Environmental and Agricultural Resources Economics Research Group, Faculty of Law and Business Sciences, University of Córdoba, 14071 Córdoba, Spain)

Abstract

Environmental sustainability in agriculture can be measured through the construction of composite indicators. However, this is a challenging task because these indexes are heavily dependent on how the individual base indicators are weighted. The main aim of this paper is to contribute to the existing literature regarding the robustness of subjective (based on experts’ opinions) weighting methods when constructing a composite indicator for measuring environmental sustainability at the farm level. In particular, the study analyzes two multi-criteria techniques, the analytic hierarchy process and the recently developed best-worst method, as well as the more straightforward point allocation method. These alternative methods have been implemented to empirically assess the environmental performance of irrigated olive farms in Spain. Data for this case study were collected from a panel of 22 experts and a survey of 99 farms. The results obtained suggest that there are no statistically significant differences in the weights of the individual base indicators derived from the three weighting methods considered. Moreover, the ranking of the sampled farms, in terms of their level of environmental sustainability measured through the composite indicators proposed, is not dependent on the use of the different weighting methods. Thus, the results support the robustness of the three weighting methods considered.

Suggested Citation

  • José A. Gómez-Limón & Manuel Arriaza & M. Dolores Guerrero-Baena, 2020. "Building a Composite Indicator to Measure Environmental Sustainability Using Alternative Weighting Methods," Sustainability, MDPI, vol. 12(11), pages 1-17, May.
  • Handle: RePEc:gam:jsusta:v:12:y:2020:i:11:p:4398-:d:363753
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/12/11/4398/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/12/11/4398/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bohringer, Christoph & Jochem, Patrick E.P., 2007. "Measuring the immeasurable -- A survey of sustainability indices," Ecological Economics, Elsevier, vol. 63(1), pages 1-8, June.
    2. van Calker, K.J. & Berentsen, P.B.M. & Romero, C. & Giesen, G.W.J. & Huirne, R.B.M., 2006. "Development and application of a multi-attribute sustainability function for Dutch dairy farming systems," Ecological Economics, Elsevier, vol. 57(4), pages 640-658, June.
    3. Claudia Seidel & Thomas Heckelei & Sebastian Lakner, 2019. "Conventionalization of Organic Farms in Germany: An Empirical Investigation Based on a Composite Indicator Approach," Sustainability, MDPI, vol. 11(10), pages 1-16, May.
    4. Ness, Barry & Urbel-Piirsalu, Evelin & Anderberg, Stefan & Olsson, Lennart, 2007. "Categorising tools for sustainability assessment," Ecological Economics, Elsevier, vol. 60(3), pages 498-508, January.
    5. Hansen, J. W., 1996. "Is agricultural sustainability a useful concept?," Agricultural Systems, Elsevier, vol. 50(2), pages 117-143.
    6. O. Flores Baquero & J. Gallego-Ayala & R. Giné-Garriga & A. Jiménez-Fernández. Palencia & A. Pérez-Foguet, 2017. "The Influence of the Human Rights to Water and Sanitation Normative Content in Measuring the Level of Service," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 133(2), pages 763-786, September.
    7. Júlia Teles, 2012. "Concordance coefficients to measure the agreement among several sets of ranks," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(8), pages 1749-1764, March.
    8. Gomez-Limon, Jose Antonio & Riesgo, Laura, 2010. "Sustainability assessment of olive grove in Andalusia: A methodological proposal," 120th Seminar, September 2-4, 2010, Chania, Crete 109323, European Association of Agricultural Economists.
    9. Krajnc, Damjan & Glavic, Peter, 2005. "How to compare companies on relevant dimensions of sustainability," Ecological Economics, Elsevier, vol. 55(4), pages 551-563, December.
    10. Gomez-Limon, Jose Antonio & Riesgo, Laura, 2008. "Alternative Approaches On Constructing A Composite Indicator To Measure Agricultural Sustainability," 107th Seminar, January 30-February 1, 2008, Sevilla, Spain 6489, European Association of Agricultural Economists.
    11. Saaty, Thomas L., 2003. "Decision-making with the AHP: Why is the principal eigenvector necessary," European Journal of Operational Research, Elsevier, vol. 145(1), pages 85-91, February.
    12. Pollesch, N.L. & Dale, V.H., 2016. "Normalization in sustainability assessment: Methods and implications," Ecological Economics, Elsevier, vol. 130(C), pages 195-208.
    13. Forman, Ernest & Peniwati, Kirti, 1998. "Aggregating individual judgments and priorities with the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 108(1), pages 165-169, July.
    14. Pannell, David J. & Glenn, Nicole A., 2000. "A framework for the economic evaluation and selection of sustainability indicators in agriculture," Ecological Economics, Elsevier, vol. 33(1), pages 135-149, April.
    15. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    16. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    17. Alfonso Expósito & Julio Berbel, 2019. "Drivers of Irrigation Water Productivity and Basin Closure Process: Analysis of the Guadalquivir River Basin (Spain)," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(4), pages 1439-1450, March.
    18. Gómez-Limón, José A. & Sanchez-Fernandez, Gabriela, 2010. "Empirical evaluation of agricultural sustainability using composite indicators," Ecological Economics, Elsevier, vol. 69(5), pages 1062-1075, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ranjan Roy & Ngai Weng Chan, 2012. "An assessment of agricultural sustainability indicators in Bangladesh: review and synthesis," Environment Systems and Decisions, Springer, vol. 32(1), pages 99-110, March.
    2. Shamsheer Haq & Ismet Boz, 2020. "Measuring environmental, economic, and social sustainability index of tea farms in Rize Province, Turkey," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 22(3), pages 2545-2567, March.
    3. Dillon, Emma J. & Hennessy, Thia C. & Hynes, Stephen, 2009. "Towards Measurement of Farm Sustainability - an Irish case study," 2009 Conference, August 16-22, 2009, Beijing, China 51786, International Association of Agricultural Economists.
    4. Emma J. Dillon & Thia Hennessy & Stephen Hynes & Verena Commins, 2008. "Assessing the Sustainability of Irish Agriculture," Working Papers 0809, Rural Economy and Development Programme,Teagasc.
    5. Paolo Cupo & Rinalda Alberta Di Cerbo, 2016. "The determinants of ranking in sustainable efficiency of Italian farms," RIVISTA DI STUDI SULLA SOSTENIBILITA', FrancoAngeli Editore, vol. 2016(2), pages 141-159.
    6. Carrillo, Marianela & Jorge, Jesús M., 2017. "Multidimensional Analysis of Regional Tourism Sustainability in Spain," Ecological Economics, Elsevier, vol. 140(C), pages 89-98.
    7. Gomez-Limon, Jose Antonio & Riesgo, Laura, 2010. "Sustainability assessment of olive grove in Andalusia: A methodological proposal," 120th Seminar, September 2-4, 2010, Chania, Crete 109323, European Association of Agricultural Economists.
    8. Gómez-Limón, José A. & Sanchez-Fernandez, Gabriela, 2010. "Empirical evaluation of agricultural sustainability using composite indicators," Ecological Economics, Elsevier, vol. 69(5), pages 1062-1075, March.
    9. Anna Gaviglio & Mattia Bertocchi & Maria Elena Marescotti & Eugenio Demartini & Alberto Pirani, 2016. "The social pillar of sustainability: a quantitative approach at the farm level," Agricultural and Food Economics, Springer;Italian Society of Agricultural Economics (SIDEA), vol. 4(1), pages 1-19, December.
    10. Norman Siebrecht, 2020. "Sustainable Agriculture and Its Implementation Gap—Overcoming Obstacles to Implementation," Sustainability, MDPI, vol. 12(9), pages 1-27, May.
    11. Paula Trivino-Tarradas & Manuel R. Gomez-Ariza & Gottlieb Basch & Emilio J. Gonzalez-Sanchez, 2019. "Sustainability Assessment of Annual and Permanent Crops: The Inspia Model," Sustainability, MDPI, vol. 11(3), pages 1-21, January.
    12. Van den Bossche, Filip & Rogge, Nicky & Devooght, Kurt & Van Puyenbroeck , Tom, 2009. "Robust CSR Investment Screening," Working Papers 2009/05, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    13. Koenigsmarck, Markus & Geissdoerfer, Martin, 2023. "Shifting the Focus to Measurement: A Review of Socially Responsible Investing and Sustainability Indicators," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 136617, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    14. Samir Mili & Javier Martínez-Vega, 2019. "Accounting for Regional Heterogeneity of Agricultural Sustainability in Spain," Sustainability, MDPI, vol. 11(2), pages 1-20, January.
    15. Luong Van Pham & Carl Smith, 2014. "Drivers of agricultural sustainability in developing countries: a review," Environment Systems and Decisions, Springer, vol. 34(2), pages 326-341, June.
    16. Van den Bossche, Filip & Rogge, Nicky & Devooght, Kurt & Van Puyenbroeck, Tom, 2010. "Robust Corporate Social Responsibility investment screening," Ecological Economics, Elsevier, vol. 69(5), pages 1159-1169, March.
    17. Sartori, Simone & Witjes, Sjors & Campos, Lucila M.S., 2017. "Sustainability performance for Brazilian electricity power industry: An assessment integrating social, economic and environmental issues," Energy Policy, Elsevier, vol. 111(C), pages 41-51.
    18. Gomez-Limon, Jose Antonio & Riesgo, Laura, 2008. "Alternative Approaches On Constructing A Composite Indicator To Measure Agricultural Sustainability," 107th Seminar, January 30-February 1, 2008, Sevilla, Spain 6489, European Association of Agricultural Economists.
    19. Vecchione, Gaetano, 2010. "EU rural policy: proposal and application of an agricultural sustainability index," MPRA Paper 27032, University Library of Munich, Germany.
    20. Markus Koenigsmarck & Martin Geissdoerfer, 2023. "Shifting the Focus to Measurement: A Review of Socially Responsible Investing and Sustainability Indicators," Sustainability, MDPI, vol. 15(2), pages 1-24, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:12:y:2020:i:11:p:4398-:d:363753. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.