A computational approach for characterizing social and ecological values in public comments

1. Addressing social and ecological values is a central aim of democratic environmental management and policymaking, especially during deliberative and participatory processes. Agencies responsible for managing public lands would benefit from a deepened understanding of how various publics’ value those lands. 2. Federal land management agencies receive millions of written comments from the public on proposed management actions annually, providing a unique source of insights into how the public assigns value to public lands. To date, little attention has been directed towards methods for analyzing the public’s comments to understand their expressed values, in part because the volume of comments often makes manual analysis unworkable. 3. This study introduces and applies a novel computational approach to inferring values in written text by using natural language processing and a method that combines a lexicon with semantic embedding models. We developed embedding models for four types of values that are expressed in public comments. We then fit models to 409,241 public comments on actions proposed by the United States Forest Service from 2011 to 2020 and regulated by the Natural Environmental Policy Act. 4. The embedding model generally outperformed the lexicon word-count, particularly for value types with shorter lexicons, and, like human evaluators, the embedding models performed better for more evident values and were less reliable for more abstract or latent values. 5. By applying the resulting model, we furthered our understanding of how the public values National Forest lands in the United States. We observed that aesthetic and moral values were expressed more often in comments for projects that received more public interest, as gauged by the number of comments a project received and in comments for projects addressing recreational management.