IDEAS home Printed from https://ideas.repec.org/a/pal/palcom/v12y2025i1d10.1057_s41599-025-04941-6.html
   My bibliography  Save this article

Future cities imagined by ChatGPT-4o: human evaluation using importance-performance analysis

Author

Listed:
  • Zihao Cao

    (Universiti Sains Malaysia)

  • Yongchun Mao

    (Qilu University of Technology (Shandong Academy of Sciences))

  • Muhizam Mustafa

    (Universiti Sains Malaysia)

  • Mohd Hafizal Mohd Isa

    (Universiti Sains Malaysia)

Abstract

Despite the growing integration of artificial intelligence (AI) into human society, a significant gap remains in understanding how AI can use its database-driven imagination to enhance urban planning and aesthetics effectively. This study explores ChatGPT-4o’s potential in generating future urban designs by incorporating human evaluations. Using a mixed-methods design, the study identified key indicators for evaluating AI-generated urban design images and then applied Importance-Performance Analysis (IPA) to measure participants’ evaluations of these indicators. Results showed that creativity was the most critical indicator needing improvement, while technological sense received high performance. Surprisingly, indicators like traffic rationality, environmental greening, public space utilization and cultural representation were deemed less important. These findings suggest that participants prefer AI to focus more on bold, imaginative aspects. This study constructs a framework for evaluating AI-generated urban design images and offers valuable insights for improving AI applications in urban planning and image generation.

Suggested Citation

  • Zihao Cao & Yongchun Mao & Muhizam Mustafa & Mohd Hafizal Mohd Isa, 2025. "Future cities imagined by ChatGPT-4o: human evaluation using importance-performance analysis," Palgrave Communications, Palgrave Macmillan, vol. 12(1), pages 1-12, December.
    • Handle: RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-04941-6
    DOI: 10.1057/s41599-025-04941-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41599-025-04941-6
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/s41599-025-04941-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Xinyu Fu & Ruoniu Wang & Chaosu Li, 2024. "Can ChatGPT Evaluate Plans?," Journal of the American Planning Association, Taylor & Francis Journals, vol. 90(3), pages 525-536, July.
    2. Abalo, Javier & Varela, Jesus & Manzano, Vicente, 2007. "Importance values for Importance-Performance Analysis: A formula for spreading out values derived from preference rankings," Journal of Business Research, Elsevier, vol. 60(2), pages 115-121, February.
    3. Shuhui Yu & Ya Yang & Jiamin Li & Keyu Guo & Zeyu Wang & Yuwei Liu, 2024. "Exploring low-carbon and sustainable urban transformation design using ChatGPT and artificial bee colony algorithm," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-14, December.
    4. Thomas J. Aicher & Bob Heere & Michael A. Odio & Jeffery M. Ferguson, 2023. "Looking beyond performance: understanding service quality through the importance-performance analysis," Sport Management Review, Taylor & Francis Journals, vol. 26(3), pages 448-470, May.
    5. Jinyang Deng & Chad D. Pierskalla, 2018. "Linking Importance–Performance Analysis, Satisfaction, and Loyalty: A Study of Savannah, GA," Sustainability, MDPI, vol. 10(3), pages 1-17, March.
    6. Byung Cheol Lee & Jaeyeon (Jae) Chung, 2024. "An empirical investigation of the impact of ChatGPT on creativity," Nature Human Behaviour, Nature, vol. 8(10), pages 1906-1914, October.
    7. Mengying Feng & John Mangan & Chee Wong & Maozeng Xu & Chandra Lalwani, 2014. "Investigating the different approaches to importance-performance analysis," The Service Industries Journal, Taylor & Francis Journals, vol. 34(12), pages 1021-1041, August.
    8. Phadermrod, Boonyarat & Crowder, Richard M. & Wills, Gary B., 2019. "Importance-Performance Analysis based SWOT analysis," International Journal of Information Management, Elsevier, vol. 44(C), pages 194-203.
    9. Sever, Ivan, 2015. "Importance-performance analysis: A valid management tool?," Tourism Management, Elsevier, vol. 48(C), pages 43-53.
    10. Ida Rašovská & Marketa Kubickova & Kateřina Ryglová, 2021. "Importance–performance analysis approach to destination management," Tourism Economics, , vol. 27(4), pages 777-794, June.
    11. Olivia Psara & Fernando Fonseca & Olympia Nisiforou & Rui Ramos, 2023. "Evaluation of Urban Sustainability Based on Transportation and Green Spaces: The Case of Limassol, Cyprus," Sustainability, MDPI, vol. 15(13), pages 1-18, July.
    12. Boley, B. Bynum & McGehee, Nancy Gard & Tom Hammett, A.L., 2017. "Importance-performance analysis (IPA) of sustainable tourism initiatives: The resident perspective," Tourism Management, Elsevier, vol. 58(C), pages 66-77.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Esmailpour, Javad & Aghabayk, Kayvan & Abrari Vajari, Mohammad & De Gruyter, Chris, 2020. "Importance – Performance Analysis (IPA) of bus service attributes: A case study in a developing country," Transportation Research Part A: Policy and Practice, Elsevier, vol. 142(C), pages 129-150.
    2. Jih-Kuang Chen, 2021. "A New Approach for Diagonal Line Model of Importance-Performance Analysis: A Case Study of Tourist Satisfaction in China," SAGE Open, , vol. 11(1), pages 21582440219, January.
    3. Sung-Shun Weng & Yang Liu & Yen-Ching Chuang, 2019. "Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model," Sustainability, MDPI, vol. 11(19), pages 1-23, October.
    4. Michele Preziosi & Alessia Acampora & Maria Claudia Lucchetti & Roberto Merli, 2022. "Delighting Hotel Guests with Sustainability: Revamping Importance-Performance Analysis in the Light of the Three-Factor Theory of Customer Satisfaction," Sustainability, MDPI, vol. 14(6), pages 1-20, March.
    5. Cai, Gangwei & Xu, Binyan & Lu, Feidong & Lu, Ye, 2023. "The promotion strategies and dynamic evaluation model of exhibition-driven sustainable tourism based on previous/prospective tourist satisfaction after COVID-19," Evaluation and Program Planning, Elsevier, vol. 101(C).
    6. Sogbe, Eugene & Susilawati, Susilawati & Currie, Graham & Tan, Chee Pin, 2025. "Exploring factors influencing first-mile and last-mile connections to public transport from car users' perspective: Evidence from Greater Accra, Ghana," Journal of Transport Geography, Elsevier, vol. 126(C).
    7. Carlos Manzanares-Cañizares & Alberto Sánchez-Lite & Víctor F. Rosales-Prieto & José Luis Fuentes-Bargues & Cristina González-Gaya, 2022. "A 5S Lean Strategy for a Sustainable Welding Process," Sustainability, MDPI, vol. 14(11), pages 1-17, May.
    8. Chengcai Tang & Qianqian Zheng & Pin Ng, 2019. "A Study on the Coordinative Green Development of Tourist Experience and Commercialization of Tourism at Cultural Heritage Sites," Sustainability, MDPI, vol. 11(17), pages 1-19, August.
    9. Say-Wah Lee & Chuen-Wah Seow & Ke Xue, 2021. "Residents’ Sustainable City Evaluation, Satisfaction and Loyalty: Integrating Importance-Performance Analysis and Structural Equation Modelling," Sustainability, MDPI, vol. 13(12), pages 1-14, June.
    10. Cristina López & Rocío Ruíz-Benítez & Carmen Vargas-Machuca, 2019. "On the Environmental and Social Sustainability of Technological Innovations in Urban Bus Transport: The EU Case," Sustainability, MDPI, vol. 11(5), pages 1-22, March.
    11. Liang-Ching Chen, 2023. "An Improved Corpus-Based NLP Method for Facilitating Keyword Extraction: An Example of the COVID-19 Vaccine Hesitancy Corpus," Sustainability, MDPI, vol. 15(4), pages 1-19, February.
    12. Yu-Hung Chien & Fang-Yu Chang, 2023. "An importance-performance analysis of teachers’ perception of STEM engineering design education," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-11, December.
    13. Jeong-Sil Choi & Se-Young Ju, 2022. "A Study of Food Safety Knowledge for Sustainable Foodservice Management of Childcare Centers in South Korea Using Importance–Performance Analysis," IJERPH, MDPI, vol. 19(15), pages 1-14, August.
    14. Maciej Kozlowski & Jerzy Korzeniewski & Agnieszka Piotrowska-Piatek, 2025. "Importance-Performance Analysis Based on Text Mining," European Research Studies Journal, European Research Studies Journal, vol. 0(3), pages 450-470.
    15. Ida Rašovská & Marketa Kubickova & Kateřina Ryglová, 2021. "Importance–performance analysis approach to destination management," Tourism Economics, , vol. 27(4), pages 777-794, June.
    16. Yanchun Jin & Yoonseo Park, 2019. "An Integrated Approach to Determining Rural Tourist Satisfaction Factors Using the IPA and Conjoint Analysis," IJERPH, MDPI, vol. 16(20), pages 1-16, October.
    17. Lorena Bašan & Jelena Kapeš & Ana Kamenečki, 2021. "Tourist Satisfaction as a Driver of Destination Marketing Improvements: The Case of the Opatija Riviera," Tržište/Market, Faculty of Economics and Business, University of Zagreb, vol. 33(1), pages 93-112.
    18. Yan Hu & Feng Lin & Qizhen Dong & Young-joo Ahn, 2024. "Exploring Cultural and Heritage Attributes at Mount Yunqiu, China, Using Importance–Performance Analysis," Sustainability, MDPI, vol. 16(13), pages 1-20, June.
    19. Gangwei Cai & Yan Hong & Lei Xu & Weijun Gao & Ka Wang & Xiaoting Chi, 2020. "An Evaluation of Green Ryokans through a Tourism Accommodation Survey and Customer-Satisfaction-Related CASBEE–IPA after COVID-19 Pandemic," Sustainability, MDPI, vol. 13(1), pages 1-24, December.
    20. Guizzardi, Andrea & Stacchini, Annalisa, 2017. "Destinations strategic groups via Multivariate Competition-based IPA," Tourism Management, Elsevier, vol. 58(C), pages 40-50.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-04941-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: https://www.nature.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.