IDEAS home Printed from https://ideas.repec.org/a/pal/palcom/v12y2025i1d10.1057_s41599-025-04941-6.html
   My bibliography  Save this article

Future cities imagined by ChatGPT-4o: human evaluation using importance-performance analysis

Author

Listed:
  • Zihao Cao

    (Universiti Sains Malaysia)

  • Yongchun Mao

    (Qilu University of Technology (Shandong Academy of Sciences))

  • Muhizam Mustafa

    (Universiti Sains Malaysia)

  • Mohd Hafizal Mohd Isa

    (Universiti Sains Malaysia)

Abstract

Despite the growing integration of artificial intelligence (AI) into human society, a significant gap remains in understanding how AI can use its database-driven imagination to enhance urban planning and aesthetics effectively. This study explores ChatGPT-4o’s potential in generating future urban designs by incorporating human evaluations. Using a mixed-methods design, the study identified key indicators for evaluating AI-generated urban design images and then applied Importance-Performance Analysis (IPA) to measure participants’ evaluations of these indicators. Results showed that creativity was the most critical indicator needing improvement, while technological sense received high performance. Surprisingly, indicators like traffic rationality, environmental greening, public space utilization and cultural representation were deemed less important. These findings suggest that participants prefer AI to focus more on bold, imaginative aspects. This study constructs a framework for evaluating AI-generated urban design images and offers valuable insights for improving AI applications in urban planning and image generation.

Suggested Citation

  • Zihao Cao & Yongchun Mao & Muhizam Mustafa & Mohd Hafizal Mohd Isa, 2025. "Future cities imagined by ChatGPT-4o: human evaluation using importance-performance analysis," Palgrave Communications, Palgrave Macmillan, vol. 12(1), pages 1-12, December.
    • Handle: RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-04941-6
    DOI: 10.1057/s41599-025-04941-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41599-025-04941-6
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/s41599-025-04941-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Thomas J. Aicher & Bob Heere & Michael A. Odio & Jeffery M. Ferguson, 2023. "Looking beyond performance: understanding service quality through the importance-performance analysis," Sport Management Review, Taylor & Francis Journals, vol. 26(3), pages 448-470, May.
    2. Ida Rašovská & Marketa Kubickova & Kateřina Ryglová, 2021. "Importance–performance analysis approach to destination management," Tourism Economics, , vol. 27(4), pages 777-794, June.
    3. Shuhui Yu & Ya Yang & Jiamin Li & Keyu Guo & Zeyu Wang & Yuwei Liu, 2024. "Exploring low-carbon and sustainable urban transformation design using ChatGPT and artificial bee colony algorithm," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-14, December.
    4. Abalo, Javier & Varela, Jesus & Manzano, Vicente, 2007. "Importance values for Importance-Performance Analysis: A formula for spreading out values derived from preference rankings," Journal of Business Research, Elsevier, vol. 60(2), pages 115-121, February.
    5. Jinyang Deng & Chad D. Pierskalla, 2018. "Linking Importance–Performance Analysis, Satisfaction, and Loyalty: A Study of Savannah, GA," Sustainability, MDPI, vol. 10(3), pages 1-17, March.
    6. Phadermrod, Boonyarat & Crowder, Richard M. & Wills, Gary B., 2019. "Importance-Performance Analysis based SWOT analysis," International Journal of Information Management, Elsevier, vol. 44(C), pages 194-203.
    7. Olivia Psara & Fernando Fonseca & Olympia Nisiforou & Rui Ramos, 2023. "Evaluation of Urban Sustainability Based on Transportation and Green Spaces: The Case of Limassol, Cyprus," Sustainability, MDPI, vol. 15(13), pages 1-18, July.
    8. Mengying Feng & John Mangan & Chee Wong & Maozeng Xu & Chandra Lalwani, 2014. "Investigating the different approaches to importance-performance analysis," The Service Industries Journal, Taylor & Francis Journals, vol. 34(12), pages 1021-1041, August.
    9. Xinyu Fu & Ruoniu Wang & Chaosu Li, 2024. "Can ChatGPT Evaluate Plans?," Journal of the American Planning Association, Taylor & Francis Journals, vol. 90(3), pages 525-536, July.
    10. Byung Cheol Lee & Jaeyeon (Jae) Chung, 2024. "An empirical investigation of the impact of ChatGPT on creativity," Nature Human Behaviour, Nature, vol. 8(10), pages 1906-1914, October.
    11. Boley, B. Bynum & McGehee, Nancy Gard & Tom Hammett, A.L., 2017. "Importance-performance analysis (IPA) of sustainable tourism initiatives: The resident perspective," Tourism Management, Elsevier, vol. 58(C), pages 66-77.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michele Preziosi & Alessia Acampora & Maria Claudia Lucchetti & Roberto Merli, 2022. "Delighting Hotel Guests with Sustainability: Revamping Importance-Performance Analysis in the Light of the Three-Factor Theory of Customer Satisfaction," Sustainability, MDPI, vol. 14(6), pages 1-20, March.
    2. Esmailpour, Javad & Aghabayk, Kayvan & Abrari Vajari, Mohammad & De Gruyter, Chris, 2020. "Importance – Performance Analysis (IPA) of bus service attributes: A case study in a developing country," Transportation Research Part A: Policy and Practice, Elsevier, vol. 142(C), pages 129-150.
    3. Jih-Kuang Chen, 2021. "A New Approach for Diagonal Line Model of Importance-Performance Analysis: A Case Study of Tourist Satisfaction in China," SAGE Open, , vol. 11(1), pages 21582440219, January.
    4. Cristina López & Rocío Ruíz-Benítez & Carmen Vargas-Machuca, 2019. "On the Environmental and Social Sustainability of Technological Innovations in Urban Bus Transport: The EU Case," Sustainability, MDPI, vol. 11(5), pages 1-22, March.
    5. Liang-Ching Chen, 2023. "An Improved Corpus-Based NLP Method for Facilitating Keyword Extraction: An Example of the COVID-19 Vaccine Hesitancy Corpus," Sustainability, MDPI, vol. 15(4), pages 1-19, February.
    6. Lorena Bašan & Jelena Kapeš & Ana Kamenečki, 2021. "Tourist Satisfaction as a Driver of Destination Marketing Improvements: The Case of the Opatija Riviera," Tržište/Market, Faculty of Economics and Business, University of Zagreb, vol. 33(1), pages 93-112.
    7. Chengcai Tang & Qianqian Zheng & Pin Ng, 2019. "A Study on the Coordinative Green Development of Tourist Experience and Commercialization of Tourism at Cultural Heritage Sites," Sustainability, MDPI, vol. 11(17), pages 1-19, August.
    8. Zhong-Lei Wang & Hou-Cai Shen & Jian Zuo, 2019. "Risks in Prefabricated Buildings in China: Importance-Performance Analysis Approach," Sustainability, MDPI, vol. 11(12), pages 1-13, June.
    9. Sung-Shun Weng & Yang Liu & Yen-Ching Chuang, 2019. "Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model," Sustainability, MDPI, vol. 11(19), pages 1-23, October.
    10. Say-Wah Lee & Chuen-Wah Seow & Ke Xue, 2021. "Residents’ Sustainable City Evaluation, Satisfaction and Loyalty: Integrating Importance-Performance Analysis and Structural Equation Modelling," Sustainability, MDPI, vol. 13(12), pages 1-14, June.
    11. Ida Rašovská & Marketa Kubickova & Kateřina Ryglová, 2021. "Importance–performance analysis approach to destination management," Tourism Economics, , vol. 27(4), pages 777-794, June.
    12. Cai, Gangwei & Xu, Binyan & Lu, Feidong & Lu, Ye, 2023. "The promotion strategies and dynamic evaluation model of exhibition-driven sustainable tourism based on previous/prospective tourist satisfaction after COVID-19," Evaluation and Program Planning, Elsevier, vol. 101(C).
    13. Carlos Manzanares-Cañizares & Alberto Sánchez-Lite & Víctor F. Rosales-Prieto & José Luis Fuentes-Bargues & Cristina González-Gaya, 2022. "A 5S Lean Strategy for a Sustainable Welding Process," Sustainability, MDPI, vol. 14(11), pages 1-17, May.
    14. Kyung-Ja Kim & Kanghwa Choi, 2019. "Bridging the Perception Gap between Management and Customers on DINESERV Attributes: The Korean All-You-Can-Eat Buffet," Sustainability, MDPI, vol. 11(19), pages 1-21, September.
    15. Xingli Wu & Huchang Liao & Chonghui Zhang, 2024. "Importance-performance analysis to develop product/service improvement strategies through online reviews with reliability," Annals of Operations Research, Springer, vol. 342(3), pages 1905-1924, November.
    16. Agung Dwi Sutrisno & Yun-Ju Chen & I Wayan Koko Suryawan & Chun-Hung Lee, 2023. "Building a Community’s Adaptive Capacity for Post-Mining Plans Based on Important Performance Analysis: Case Study from Indonesia," Land, MDPI, vol. 12(7), pages 1-21, June.
    17. Luis Camilo Ortigueira-Sánchez, 2017. "Influencing factors on citizen safety perception: systems and broken windows theories," International Review on Public and Nonprofit Marketing, Springer;International Association of Public and Non-Profit Marketing, vol. 14(1), pages 95-111, March.
    18. Shahrbanoo Gholitabar & Habib Alipour & Carlos Manuel Martins da Costa, 2018. "An Empirical Investigation of Architectural Heritage Management Implications for Tourism: The Case of Portugal," Sustainability, MDPI, vol. 10(1), pages 1-32, January.
    19. Yu-Hung Chien & Fang-Yu Chang, 2023. "An importance-performance analysis of teachers’ perception of STEM engineering design education," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-11, December.
    20. Lai, Ivan Ka Wai & Hitchcock, Michael, 2015. "Importance–performance analysis in tourism: A framework for researchers," Tourism Management, Elsevier, vol. 48(C), pages 242-267.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-04941-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: https://www.nature.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.