IDEAS home Printed from https://ideas.repec.org/a/zbw/espost/341674.html

Responsive to What? Explaining the Information Quality of Public Comments on Bureaucratic Policymaking Using a Text‐as‐Data Approach

Author

Listed:
  • Bunea, Adriana
  • Lipcean, Sergiu
  • Rauh, Christian

Abstract

What drives the quality of information that public comments on bureaucratic policymaking provide? We address this question along a text‐as‐data approach, develop and validate four measures capturing the multidimensional concept of information quality, and apply it to an original dataset covering more than 20,000 public comments across 1036 policy acts issued by the European Commission between 2016 and 2021. We argue that the interplay of information demand and supply and institutional factors matter in particular for varying information quality of public comments. Our results show only mixed evidence regarding the claim that high‐quality comments are more likely during the policy formulation stage. Counterintuitively, we find that more informationally dense and syntactically complex EC policy documents generate public comments of higher quality. Regarding policy areas, information quality is unrelated to the age of European policy while more technical fields receive public comments of lower quality on average. Based on developing and validating an innovative empirical strategy, we thus provide novel insights into how the design of public commenting procedures and crafting of policy acts shape the information quality provided through public consultations.

Suggested Citation

  • Bunea, Adriana & Lipcean, Sergiu & Rauh, Christian, 2026. "Responsive to What? Explaining the Information Quality of Public Comments on Bureaucratic Policymaking Using a Text‐as‐Data Approach," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 39(2), pages 1-18.
  • Handle: RePEc:zbw:espost:341674
    DOI: 10.1111/gove.70122
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/341674/1/Full-text-article-Bunea-et-al-Responsibible-to-what.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.1111/gove.70122?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Coglianese, Cary, 2006. "Citizen Participation in Rulemaking: Past, Present, and Future," Working Paper Series rwp06-027, Harvard University, John F. Kennedy School of Government.
    2. de Vries, Erik & Schoonvelde, Martijn & Schumacher, Gijs, 2018. "No Longer Lost in Translation: Evidence that Google Translate Works for Comparative Bag-of-Words Text Applications," Political Analysis, Cambridge University Press, vol. 26(4), pages 417-430, October.
    3. Maiken Røed & Vibeke Wøien Hansen, 2018. "Explaining Participation Bias in the European Commission's Online Consultations: The Struggle for Policy Gain without too Much Pain," Journal of Common Market Studies, Wiley Blackwell, vol. 56(6), pages 1446-1461, September.
    4. Kenneth Benoit & Kevin Munger & Arthur Spirling, 2019. "Measuring and Explaining Political Sophistication through Textual Complexity," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 491-508, April.
    5. Rauh, Christian, 2022. "Clear messages to the European public? The language of European Commission press releases 1985–2020," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, issue Latest Ar, pages 1-19.
    6. Steffen Hurka & Maximilian Haag, 2020. "Policy complexity and legislative duration in the European Union," European Union Politics, , vol. 21(1), pages 87-108, March.
    7. Iskander De Bruycker, 2016. "Pressure and Expertise: Explaining the Information Supply of Interest Groups in EU Legislative Lobbying," Journal of Common Market Studies, Wiley Blackwell, vol. 54(3), pages 599-616, May.
    8. Steven J. Balla & Alexander R. Beck & Elizabeth Meehan & Aryamala Prasad, 2022. "Lost in the flood?: Agency responsiveness to mass comment campaigns in administrative rulemaking," Regulation & Governance, John Wiley & Sons, vol. 16(1), pages 293-308, January.
    9. Balla, Steven J., 1998. "Administrative Procedures and Political Control of the Bureaucracy," American Political Science Review, Cambridge University Press, vol. 92(3), pages 663-673, September.
    10. Ban, Pamela & Park, Ju Yeon & You, Hye Young, 2023. "How Are Politicians Informed? Witnesses and Information Provision in Congress," American Political Science Review, Cambridge University Press, vol. 117(1), pages 122-139, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Idunn Nørbech, 2024. "Does policy context matter for citizen engagement in policymaking? Evidence from the European Commission's public consultation regime," European Union Politics, , vol. 25(1), pages 130-150, March.
    2. Adriana Bunea & Sergiu Lipcean, 2024. "Understanding patterns of stakeholder participation in public commenting on bureaucratic policymaking: Evidence from the European Union," Regulation & Governance, John Wiley & Sons, vol. 18(3), pages 874-895, July.
    3. Roberta Rocca & Katharina Lawall & Manos Tsakiris & Laura Cram, 2024. "Communicating Europe: a computational analysis of the evolution of the European Commission’s communication on Twitter," Journal of Computational Social Science, Springer, vol. 7(2), pages 1223-1274, October.
    4. Peter Bils & Robert J. Carroll & Lawrence S. Rothenberg, 2024. "Strategic avoidance and rulemaking procedures," Journal of Theoretical Politics, , vol. 36(2), pages 156-185, April.
    5. Fraccaroli, Nicolò & Giovannini, Alessandro & Jamet, Jean-François & Persson, Eric, 2022. "Ideology and monetary policy. The role of political parties’ stances in the European Central Bank’s parliamentary hearings," European Journal of Political Economy, Elsevier, vol. 74(C).
    6. Francisco Jiménez Alcarria & Jorge Tuñón Navarro, 2024. "Stakeholders and impact (engagement) in EU digital communication strategies during the COVID-19 vaccination campaign," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-11, December.
    7. Xiaohong Yu & Zhaoyang Sun, 2022. "The company they keep: When and why Chinese judges engage in collegiality," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 19(4), pages 936-1002, December.
    8. Konstantinos G. Papaspyropoulos & Harikleia Liakou & Panayotis Dimopoulos, 2023. "Climate Change in the Biodiversity and Forest Strategies in Greece Using Discourse Analysis and Text Mining: Is an Integration into a Cost-Efficient Natural Resources Policy Feasible?," Sustainability, MDPI, vol. 15(7), pages 1-12, April.
    9. Frederik Stevens & Iskander De Bruycker, 2020. "Influence, affluence and media salience: Economic resources and lobbying influence in the European Union," European Union Politics, , vol. 21(4), pages 728-750, December.
    10. Eugenio Salvati, 2024. "Debating Legitimacy and Solidarity in the European Parliament: Patterns of Opposition and Conflict During the Pandemic," Journal of Common Market Studies, Wiley Blackwell, vol. 62(6), pages 1692-1711, November.
    11. Özdemir, Sina & Rauh, Christian, 2022. "A Bird’s Eye View: Supranational EU Actors on Twitter," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 10(1), pages 133-145.
    12. Sina Özdemir & Christian Rauh, 2022. "A Bird’s Eye View: Supranational EU Actors on Twitter," Politics and Governance, Cogitatio Press, vol. 10(1), pages 133-145.
    13. Yuxuan Lei, 2025. "The Role of Political Actors’ Preference Variation in the Decision-Making Process of the European Union," Social Sciences, MDPI, vol. 14(4), pages 1-31, March.
    14. Pavlos Sermpezis & Stelios Karamanidis & Eva Paraschou & Ilias Dimitriadis & Sofia Yfantidou & Filitsa-Ioanna Kouskouveli & Thanasis Troboukis & Kelly Kiki & Antonis Galanopoulos & Athena Vakali, 2026. "Agoraspeech: a multi-annotated comprehensive dataset of political discourse through the lens of humans and AI," Journal of Computational Social Science, Springer, vol. 9(2), pages 1-28, May.
    15. Bugarin, M. B., 2007. "Benefit Sharing: An Incentive Mechanism for Social Control of Government Expenditure," Insper Working Papers wpe_77, Insper Working Paper, Insper Instituto de Ensino e Pesquisa.
    16. André Corrêa d’Almeida & Donald Klingner, 2008. "FEMA and the Witt Revolution: Testing the Hypothesis of “Bureaucratic Autonomy”," Public Organization Review, Springer, vol. 8(4), pages 291-305, December.
    17. Pablo Castillo‐Ortiz, 2023. "Right‐Wing Eurosceptic Parties and the Strategic Use of Law," Journal of Common Market Studies, Wiley Blackwell, vol. 61(5), pages 1125-1142, September.
    18. Rauh, Christian, 2022. "Clear messages to the European public? The language of European Commission press releases 1985–2020," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, issue Latest Ar, pages 1-19.
    19. Steven J. Balla & Benjamin M. Daniels, 2007. "Information technology and public commenting on agency regulations," Regulation & Governance, John Wiley & Sons, vol. 1(1), pages 46-67, March.
    20. Ferrara, Federico M. & Masciandaro, Donato & Moschella, Manuela & Romelli, Davide, 2022. "Political voice on monetary policy: Evidence from the parliamentary hearings of the European Central Bank," European Journal of Political Economy, Elsevier, vol. 74(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:espost:341674. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.