IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.21772.html

A Unified Metric Architecture for AI Infrastructure: A Cross-Layer Taxonomy Integrating Performance, Efficiency, and Cost

Author

Listed:
  • Qi He

Abstract

The growth of large-scale AI systems is increasingly constrained by infrastructure limits: power availability, thermal and water constraints, interconnect scaling, memory pressure, data-pipeline throughput, and rapidly escalating lifecycle cost. Across hyperscale clusters, these constraints interact, yet the main metrics remain fragmented. Existing metrics, ranging from facility measures (PUE) and rack power density to network metrics (all-reduce latency), data-pipeline measures, and financial metrics (TCO series), each capture only their own domain and provide no integrated view of how physical, computational, and economic constraints interact. This fragmentation obscures the structural relationships among energy, computation, and cost, preventing a coherent optimization across sector and how bottlenecks emerge, propagate, and jointly determine the efficiency frontier of AI infrastructure. This paper develops an integrated framework that unifies these disparate metrics through a three-domain semantic classification and a six-layer architectural decomposition, producing a 6x3 taxonomy that maps how various sectors propagate across the AI infrastructure stack. The taxonomy is grounded in a systematic review and meta-analysis of all metrics with economic and financial relevance, identifying the most widely used measures, their research intensity, and their cross-domain interdependencies. Building on this evidence base, the Metric Propagation Graph (MPG) formalizes cross-layer dependencies, enabling systemwide interpretation, composite-metric construction, and multi-objective optimization of energy, carbon, and cost. The framework offers a coherent foundation for benchmarking, cluster design, capacity planning, and lifecycle economic analysis by linking physical operations, computational efficiency, and cost outcomes within a unified analytic structure.

Suggested Citation

  • Qi He, 2025. "A Unified Metric Architecture for AI Infrastructure: A Cross-Layer Taxonomy Integrating Performance, Efficiency, and Cost," Papers 2511.21772, arXiv.org, revised Jan 2026.
  • Handle: RePEc:arx:papers:2511.21772
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.21772
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Eliseo Curcio, 2025. "Introducing LCOAI: A Standardized Economic Metric for Evaluating AI Deployment Costs," Papers 2509.02596, arXiv.org.
    2. Li, Jian & Jurasz, Jakub & Li, Hailong & Tao, Wen-Quan & Duan, Yuanyuan & Yan, Jinyue, 2020. "A new indicator for a fair comparison on the energy performance of data centers," Applied Energy, Elsevier, vol. 276(C).
    3. Qi He, 2025. "Location-Robust Cost-Preserving Blended Pricing for Multi-Campus AI Data Centers," Papers 2512.14197, arXiv.org, revised Jan 2026.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han, Yibo & Han, Kai & Wang, Yongzhen & Lin, Jiayu & Han, Juntao & Song, Kuo & Tang, Hao & Han, Te, 2025. "Bi-level optimization and sustainability assessment of data center integrated energy system based on emergy theory," Energy, Elsevier, vol. 334(C).
    2. Lin, Xueru & Li, Jing & Zhong, Wei & Lin, Xiaojie & Zhang, Hong & Wei, Wei, 2025. "Cross-scale coordinated optimization method for electricity-thermal-hydrogen systems in chemical industrial parks based on long-term and short-term flexibility margin evaluation," Energy, Elsevier, vol. 340(C).
    3. Ye, Guisen & Gao, Feng & Fang, Jingyang, 2022. "A mission-driven two-step virtual machine commitment for energy saving of modern data centers through UPS and server coordinated optimizations," Applied Energy, Elsevier, vol. 322(C).
    4. Li, Nan & Li, Haowei & Duan, Kaiwen & Tao, Wen-Quan, 2025. "Evaluation of the cooling effectiveness of air-cooled data centers by energy diagram," Applied Energy, Elsevier, vol. 382(C).
    5. Li, Weiwei & Qian, Tong & Zhang, Yin & Shen, Yueqing & Wu, Chenghu & Tang, Wenhu, 2023. "Distributionally robust chance-constrained planning for regional integrated electricity–heat systems with data centers considering wind power uncertainty," Applied Energy, Elsevier, vol. 336(C).
    6. Ji, Haoran & Chen, Sirui & Yu, Hao & Li, Peng & Yan, Jinyue & Song, Jieying & Wang, Chengshan, 2022. "Robust operation for minimizing power consumption of data centers with flexible substation integration," Energy, Elsevier, vol. 248(C).
    7. Fan, Chengliang & Hinkelman, Kathryn & Fu, Yangyang & Zuo, Wangda & Huang, Sen & Shi, Chengnan & Mamaghani, Nasim & Faulkner, Cary & Zhou, Xiaoqing, 2021. "Open-source Modelica models for the control performance simulation of chiller plants with water-side economizer," Applied Energy, Elsevier, vol. 299(C).
    8. Chen, Sirui & Li, Peng & Ji, Haoran & Yu, Hao & Yan, Jinyue & Wu, Jianzhong & Wang, Chengshan, 2021. "Operational flexibility of active distribution networks with the potential from data centers," Applied Energy, Elsevier, vol. 293(C).
    9. Qiankun Chang & Yuanfeng Huang & Kaiyan Liu & Xin Xu & Yaohua Zhao & Song Pan, 2024. "Optimization Control Strategies and Evaluation Metrics of Cooling Systems in Data Centers: A Review," Sustainability, MDPI, vol. 16(16), pages 1-41, August.
    10. Han, Ouzhu & Ding, Tao & Mu, Chenggang & Jia, Wenhao & Ma, Zhoujun, 2023. "Waste heat reutilization and integrated demand response for decentralized optimization of data centers," Energy, Elsevier, vol. 264(C).
    11. Lin, Xiaojie & Lin, Xueru & Zhong, Wei & Zhou, Yi, 2024. "Multi-time scale dynamic operation optimization method for industrial park electricity-heat-gas integrated energy system considering demand elasticity," Energy, Elsevier, vol. 293(C).
    12. Khaled Iyad Alsharif & Aspen Glaspell & Kyosung Choo, 2021. "Energy Conservation Measures for a Research Data Center in an Academic Campus," Energies, MDPI, vol. 14(10), pages 1-12, May.
    13. Wu, Si & Zheng, Wanfu & Wang, Zhe & Chen, Guanghao & Yang, Pu & Yue, Shang & Li, Dingqian & Wu, Yue, 2025. "AlphaDataCenterCooling: A virtual testbed for evaluating operational strategies in data center cooling plants," Applied Energy, Elsevier, vol. 380(C).
    14. Mateusz Borkowski & Adam Krzysztof Piłat, 2022. "Energy Efficiency Increase Achieved by Dedicated Rule-Based Control of Chillers Operating in the Data Center," Energies, MDPI, vol. 15(7), pages 1-25, March.
    15. Qi He & Chunyu Qu, 2025. "Modular Landfill Remediation for AI Grid Resilience," Papers 2512.19202, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.21772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.