IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v153y2021ip1s0960077921007992.html
   My bibliography  Save this article

Based on the multi-assessment model: Towards a new context of combining the artificial neural network and structural equation modelling: A review

Author

Listed:
  • Albahri, A.S.
  • Alnoor, Alhamzah
  • Zaidan, A.A.
  • Albahri, O.S.
  • Hameed, Hamsa
  • Zaidan, B.B.
  • Peh, S.S.
  • Zain, A.B.
  • Siraj, S.B.
  • Alamoodi, A.H.
  • Yass, A.A.

Abstract

Theoretical models have become increasingly complex, but the dual-phase structural equation modelling (SEM) and artificial neural network analysis can be used by scholars to unveil the causal interactions and nonlinear relationships between variables. However, not only a single open issue and challenge—but several of them—are encountered in the use of different multi-assessment types of measurement model to achieve the reliability and validity whilst implementing SEM, but the gaps have not been fully determined at present. The issues significantly impact the effectiveness process of selecting the most suitable method to assess the measurement model of SEM. Once the best sequence quality improvement is met, it then needs to present a recommendable solution. To this end, this study completes the literature by presenting a systematic review of all main advanced aspects of the SEM reliability and validity approaches. Firstly, the databases of ScienceDirect, IEEE Xplore, Web of Science and Scopus were checked for the retrospective studies. A total of 239 papers were gathered for the period covering 2016 to June 2021. Then, the obtained articles were filtered according to the predefined inclusion criteria. Sixty articles were ultimately selected and divided into three categories (single, hybrid and other types) to enable a new representation of the crossover taxonomy amongst ‘SEM reliability and validity’ and ‘multi-assessment methods for structural model’ for the first time. The three categories had been matched with the SEM processes, and each of the detailed models were defined to determine the sets of principal criteria of the entire selected SEM approaches. Consequently, this multi-field interdisciplinary review was used to expose the state-of-the-art challenges and open issues (i.e. multiple-evaluation criteria, importance criteria and data variation) related to the sets of SEM criteria necessitating a selection process for deriving the best SEM method. Each issue entailed a ‘wherefore’, and multi-criteria decision making was adopted to handle the complexity problems in the different cases. Thus, a new three-phase decision-making methodology was constructed. In the first phase, a decision matrix (DM) was identified for the SEM approach; the composition of the decision alternatives and identified criteria were derived from the academic literature. In the second phase, the development methodology was achieved on the basis of the integrated multi-criteria DM techniques. The analytic hierarchy process was used for the subjective weighting of the criteria within the constructed DM, whereas the vlsekriterijumska optimizcija i kaompromisno resenje technique was used for ranking and selecting the best SEM methods. In the third phase, an objective validation approach was adopted to validate the proposed methodology. The outcome of this novel approach is intended to guide decision makers and policymakers on the easy evaluation of their goals of selecting the most suitable computing methods and the improvement of the reliability and validity of SEM.

Suggested Citation

  • Albahri, A.S. & Alnoor, Alhamzah & Zaidan, A.A. & Albahri, O.S. & Hameed, Hamsa & Zaidan, B.B. & Peh, S.S. & Zain, A.B. & Siraj, S.B. & Alamoodi, A.H. & Yass, A.A., 2021. "Based on the multi-assessment model: Towards a new context of combining the artificial neural network and structural equation modelling: A review," Chaos, Solitons & Fractals, Elsevier, vol. 153(P1).
  • Handle: RePEc:eee:chsofr:v:153:y:2021:i:p1:s0960077921007992
    DOI: 10.1016/j.chaos.2021.111445
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077921007992
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2021.111445?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Aria, Massimo & Cuccurullo, Corrado, 2017. "bibliometrix: An R-tool for comprehensive science mapping analysis," Journal of Informetrics, Elsevier, vol. 11(4), pages 959-975.
    2. O. H. Salman & A. A. Zaidan & B. B. Zaidan & Naserkalid & M. Hashim, 2017. "Novel Methodology for Triage and Prioritizing Using “Big Data” Patients with Chronic Heart Diseases Through Telemedicine Environmental," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(05), pages 1211-1245, September.
    3. Alhamzah Alnoor, 2020. "Human capital dimensions and firm performance, mediating role of knowledge management," International Journal of Business Excellence, Inderscience Enterprises Ltd, vol. 20(2), pages 149-168.
    4. Hair, Joe F. & Howard, Matt C. & Nitzl, Christian, 2020. "Assessing measurement model quality in PLS-SEM using confirmatory composite analysis," Journal of Business Research, Elsevier, vol. 109(C), pages 101-110.
    5. Raut, Rakesh D. & Priyadarshinee, Pragati & Gardas, Bhaskar B. & Jha, Manoj Kumar, 2018. "Analyzing the factors influencing cloud computing adoption using three stage hybrid SEM-ANN-ISM (SEANIS) approach," Technological Forecasting and Social Change, Elsevier, vol. 134(C), pages 98-123.
    6. Naeem Hayat & Abdullah Al Mamun & Noorul Azwin Md Nasir & Ganeshsree Selvachandran & Noorshella Binti Che Nawi & Quek Shio Gai, 2020. "Predicting Sustainable Farm Performance—Using Hybrid Structural Equation Modelling with an Artificial Neural Network Approach," Land, MDPI, vol. 9(9), pages 1-37, August.
    7. Simona Sternad Zabukovšek & Zoran Kalinic & Samo Bobek & Polona Tominc, 2019. "SEM–ANN based research of factors’ impact on extended use of ERP systems," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 27(3), pages 703-735, September.
    8. Siwaporn Kunnapapdeelert & Krittipat Pitchayadejanant, 2020. "Hybrid SEM-neural networks for predicting electronics logistics information system adoption in Thailand healthcare supply chain," International Journal of Business Performance and Supply Chain Modelling, Inderscience Enterprises Ltd, vol. 11(1), pages 54-68.
    9. Opricovic, Serafim & Tzeng, Gwo-Hshiung, 2007. "Extended VIKOR method in comparison with outranking methods," European Journal of Operational Research, Elsevier, vol. 178(2), pages 514-529, April.
    10. R. T. Mohammed & R. Yaakob & A. A. Zaidan & N. M. Sharef & R. H. Abdullah & B. B. Zaidan & K. A. Dawood, 2020. "Review of the Research Landscape of Multi-Criteria Evaluation and Benchmarking Processes for Many-Objective Optimization Methods: Coherent Taxonomy, Challenges and Recommended Solution," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 19(06), pages 1619-1693, November.
    11. A. S. Albahri & Jameel R. Al-Obaidi & A. A. Zaidan & O. S. Albahri & Rula A. Hamid & B. B. Zaidan & A. H. Alamoodi & M. Hashim, 2020. "Multi-Biological Laboratory Examination Framework for the Prioritization of Patients with COVID-19 Based on Integrated AHP and Group VIKOR Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 19(05), pages 1247-1269, August.
    12. F. M. Jumaah & A. A. Zaidan & B. B. Zaidan & R. Bahbibi & M. Y. Qahtan & A. Sali, 2018. "Technique for order performance by similarity to ideal solution for solving complex situations in multi-criteria optimization of the tracking channels of GPS baseband telecommunication receivers," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 68(3), pages 425-443, July.
    13. Arsalan Najmi & Kanagi Kanapathy & Azmin A. Aziz, 2021. "Exploring consumer participation in environment management: Findings from two‐staged structural equation modelling‐artificial neural network approach," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 28(1), pages 184-195, January.
    14. Sarstedt, Marko & Ringle, Christian M. & Smith, Donna & Reams, Russell & Hair, Joseph F., 2014. "Partial least squares structural equation modeling (PLS-SEM): A useful tool for family business researchers," Journal of Family Business Strategy, Elsevier, vol. 5(1), pages 105-115.
    15. Nair, Divya J. & Rashidi, Taha Hossein & Dixit, Vinayak V., 2017. "Estimating surplus food supply for food rescue and delivery operations," Socio-Economic Planning Sciences, Elsevier, vol. 57(C), pages 73-83.
    16. A. A. Zaidan & B. B. Zaidan & M. Y. Qahtan & O. S. Albahri & A. S. Albahri & Mussab Alaa & F. M. Jumaah & Mohammed Talal & K. L. Tan & W. L. Shir & C. K. Lim, 2018. "A survey on communication components for IoT-based technologies in smart homes," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 69(1), pages 1-25, September.
    17. Ghazanfar Ali Abbasi & Lee Yin Tiew & Jinquan Tang & Yen-Nee Goh & Ramayah Thurasamy, 2021. "The adoption of cryptocurrency as a disruptive force: Deep learning-based dual stage structural equation modelling and artificial neural network analysis," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-26, March.
    18. Ray, Arghya & Bala, Pradip Kumar & Rana, Nripendra P., 2021. "Exploring the drivers of customers’ brand attitudes of online travel agency services: A text-mining based approach," Journal of Business Research, Elsevier, vol. 128(C), pages 391-404.
    19. Wenshuai Wu & Zeshui Xu, 2020. "Hybrid TODIM Method with Crisp Number and Probability Linguistic Term Set for Urban Epidemic Situation Evaluation," Complexity, Hindawi, vol. 2020, pages 1-11, August.
    20. Kalinic, Zoran & Marinkovic, Veljko & Molinillo, Sebastián & Liébana-Cabanillas, Francisco, 2019. "A multi-analytical approach to peer-to-peer mobile payment acceptance prediction," Journal of Retailing and Consumer Services, Elsevier, vol. 49(C), pages 143-153.
    21. Higueras-Castillo, Elena & Kalinic, Zoran & Marinkovic, Veljko & Liébana-Cabanillas, Francisco J., 2020. "A mixed analysis of perceptions of electric and hybrid vehicles," Energy Policy, Elsevier, vol. 136(C).
    22. Leong, Lai-Ying & Hew, Teck-Soon & Ooi, Keng-Boon & Chong, Alain Yee-Loong, 2020. "Predicting the antecedents of trust in social commerce – A hybrid structural equation modeling with neural network approach," Journal of Business Research, Elsevier, vol. 110(C), pages 24-40.
    23. Mahmood M. Salih & O. S. Albahri & A. A. Zaidan & B. B. Zaidan & F. M. Jumaah & A. S. Albahri, 2021. "Benchmarking of AQM methods of network congestion control based on extension of interval type-2 trapezoidal fuzzy decision by opinion score method," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 77(3), pages 493-522, July.
    24. Liébana-Cabanillas, Francisco & Marinkovic, Veljko & Ramos de Luna, Iviane & Kalinic, Zoran, 2018. "Predicting the determinants of mobile payment acceptance: A hybrid SEM-neural network approach," Technological Forecasting and Social Change, Elsevier, vol. 129(C), pages 117-130.
    25. Alam, Mohammad Zahedul & Hu, Wang & Kaium, Md Abdul & Hoque, Md Rakibul & Alam, Mirza Mohammad Didarul, 2020. "Understanding the determinants of mHealth apps adoption in Bangladesh: A SEM-Neural network approach," Technology in Society, Elsevier, vol. 61(C).
    26. Shahzad, Fakhar & Xiu, Guoyi & Shafique Khan, Muhammad Aamir & Shahbaz, Muhammad, 2020. "Predicting the adoption of a mobile government security response system from the user's perspective: An application of the artificial neural network approach," Technology in Society, Elsevier, vol. 62(C).
    27. Chandan Parsad & Shashank Mittal & Raveesh Krishnankutty, 2020. "A study on the factors affecting household solar adoption in Kerala, India," International Journal of Productivity and Performance Management, Emerald Group Publishing Limited, vol. 69(8), pages 1695-1720, July.
    28. Baffoe, Gideon, 2019. "Exploring the utility of Analytic Hierarchy Process (AHP) in ranking livelihood activities for effective and sustainable rural development interventions in developing countries," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 197-204.
    29. Islam, A.K.M. Najmul & Laato, Samuli & Talukder, Shamim & Sutinen, Erkki, 2020. "Misinformation sharing and social media fatigue during COVID-19: An affordance and cognitive load perspective," Technological Forecasting and Social Change, Elsevier, vol. 159(C).
    30. Maimuna Khatari & A. A. Zaidan & B. B. Zaidan & O. S. Albahri & M. A. Alsalem, 2019. "Multi-Criteria Evaluation and Benchmarking for Active Queue Management Methods: Open Issues, Challenges and Recommended Pathway Solutions," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(04), pages 1187-1242, July.
    31. Talwar, Manish & Talwar, Shalini & Kaur, Puneet & Tripathy, Naliniprava & Dhir, Amandeep, 2021. "Has financial attitude impacted the trading activity of retail investors during the COVID-19 pandemic?," Journal of Retailing and Consumer Services, Elsevier, vol. 58(C).
    32. Mohammed Talal & A. A. Zaidan & B. B. Zaidan & O. S. Albahri & M. A. Alsalem & A. S. Albahri & A. H. Alamoodi & M. L. M. Kiah & F. M. Jumaah & Mussab Alaa, 2019. "Comprehensive review and analysis of anti-malware apps for smartphones," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 72(2), pages 285-337, October.
    33. Karrar Hameed Abdulkareem & Nureize Arbaiy & A. A. Zaidan & B. B. Zaidan & O. S. Albahri & M. A. Alsalem & Mahmood M. Salih, 2020. "A Novel Multi-Perspective Benchmarking Framework for Selecting Image Dehazing Intelligent Algorithms Based on BWM and Group VIKOR Techniques," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 19(03), pages 909-957, May.
    34. Maimuna Khatari & A. A. Zaidan & B. B. Zaidan & O. S. Albahri & M. A. Alsalem & A. S. Albahri, 2021. "Multidimensional Benchmarking Framework for AQMs of Network Congestion Control Based on AHP and Group-TOPSIS," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 20(05), pages 1409-1446, September.
    35. A. A. Zaidan & B. B. Zaidan & M. A. Alsalem & Fayiz Momani & Omar Zughoul, 2020. "Novel Multiperspective Hiring Framework for the Selection of Software Programmer Applicants Based on AHP and Group TOPSIS Techniques," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 19(03), pages 775-847, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alhamzah Alnoor & Khai Wah Khaw & XinYing Chew & Sammar Abbas & Zeeshan Zaib Khattak, 2023. "The Influence of the Barriers of Hybrid Strategy on Strategic Competitive Priorities: Evidence from Oil Companies," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 24(2), pages 179-198, June.
    2. Paweł Ziemba & Mateusz Piwowarski & Kesra Nermend, 2023. "Remote Work in Post-Pandemic Reality—Multi-Criteria Evaluation of Teleconferencing Software," Sustainability, MDPI, vol. 15(13), pages 1-20, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mahmood M. Salih & O. S. Albahri & A. A. Zaidan & B. B. Zaidan & F. M. Jumaah & A. S. Albahri, 2021. "Benchmarking of AQM methods of network congestion control based on extension of interval type-2 trapezoidal fuzzy decision by opinion score method," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 77(3), pages 493-522, July.
    2. Noor S. Baqer & A. S. Albahri & Hussein A. Mohammed & A. A. Zaidan & Rula A. Amjed & Abbas M. Al-Bakry & O. S. Albahri & H. A. Alsattar & Alhamzah Alnoor & A. H. Alamoodi & B. B. Zaidan & R. Q. Malik , 2022. "Indoor air quality pollutants predicting approach using unified labelling process-based multi-criteria decision making and machine learning techniques," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 81(4), pages 591-613, December.
    3. Francisco Liébana-Cabanillas & Nidhi Singh & Zoran Kalinic & Elena Carvajal-Trujillo, 2021. "Examining the determinants of continuance intention to use and the moderating effect of the gender and age of users of NFC mobile payments: a multi-analytical approach," Information Technology and Management, Springer, vol. 22(2), pages 133-161, June.
    4. Simona Sternad Zabukovšek & Samo Bobek & Uroš Zabukovšek & Zoran Kalinić & Polona Tominc, 2022. "Enhancing PLS-SEM-Enabled Research with ANN and IPMA: Research Study of Enterprise Resource Planning (ERP) Systems’ Acceptance Based on the Technology Acceptance Model (TAM)," Mathematics, MDPI, vol. 10(9), pages 1-28, April.
    5. Larbi-Siaw, Otu & Xuhua, Hu & Owusu, Ebenezer & Owusu-Agyeman, Abigail & Fulgence, Brou Ettien & Frimpong, Samuel Akwasi, 2022. "Eco-innovation, sustainable business performance and market turbulence moderation in emerging economies," Technology in Society, Elsevier, vol. 68(C).
    6. Ashaari, Mohamed Azlan & Singh, Karpal Singh Dara & Abbasi, Ghazanfar Ali & Amran, Azlan & Liebana-Cabanillas, Francisco J., 2021. "Big data analytics capability for improved performance of higher education institutions in the Era of IR 4.0: A multi-analytical SEM & ANN perspective," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    7. Basco, Rodrigo & Hair, Joseph F. & Ringle, Christian M. & Sarstedt, Marko, 2022. "Advancing family business research through modeling nonlinear relationships: Comparing PLS-SEM and multiple regression," Journal of Family Business Strategy, Elsevier, vol. 13(3).
    8. Tewari, Alok & Mathur, Smriti & Srivastava, Smriti & Gangwar, Divya, 2022. "Examining the role of receptivity to green communication, altruism and openness to change on young consumers’ intention to purchase green apparel: A multi-analytical approach," Journal of Retailing and Consumer Services, Elsevier, vol. 66(C).
    9. Enrico Ciavolino & Massimo Aria & Jun-Hwa Cheah & José Luis Roldán, 2022. "A tale of PLS Structural Equation Modelling: Episode I— A Bibliometrix Citation Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 164(3), pages 1323-1348, December.
    10. Komlan Gbongli & Yongan Xu & Komi Mawugbe Amedjonekou, 2019. "Extended Technology Acceptance Model to Predict Mobile-Based Money Acceptance and Sustainability: A Multi-Analytical Structural Equation Modeling and Neural Network Approach," Sustainability, MDPI, vol. 11(13), pages 1-33, July.
    11. Andrej Kastrin & Janez Povh & Lidija Zadnik Stirn & Janez Žerovnik, 2021. "Methodologies and applications for resilient global development from the aspect of SDI-SOR special issues of CJOR," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 29(3), pages 773-790, September.
    12. Liu, Hongfei & Liu, Wentong & Yoganathan, Vignesh & Osburg, Victoria-Sophie, 2021. "COVID-19 information overload and generation Z's social media discontinuance intention during the pandemic lockdown," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    13. Thitinan Pholsook & Warit Wipulanusat & Poomporn Thamsatitdej & Sarawut Ramjan & Jirapon Sunkpho & Vatanavongs Ratanavaraha, 2023. "A Three-Stage Hybrid SEM-BN-ANN Approach for Analyzing Airport Service Quality," Sustainability, MDPI, vol. 15(11), pages 1-20, May.
    14. Shahbaz, Muhammad & Gao, Changyuan & Zhai, LiLi & Shahzad, Fakhar & Khan, Imran, 2021. "Environmental air pollution management system: Predicting user adoption behavior of big data analytics," Technology in Society, Elsevier, vol. 64(C).
    15. Nebiyu Kedir & Phuong H. D. Nguyen & Citlaly Pérez & Pedro Ponce & Aminah Robinson Fayek, 2023. "Systematic Literature Review on Fuzzy Hybrid Methods in Photovoltaic Solar Energy: Opportunities, Challenges, and Guidance for Implementation," Energies, MDPI, vol. 16(9), pages 1-38, April.
    16. Yapanto, Lis M, 2021. "Supply chain management and logistic presentation: Mediation effect of competitive advantage," OSF Preprints ze96v, Center for Open Science.
    17. Naeem, Muhammad & Ozuem, Wilson, 2021. "The role of social media in internet banking transition during COVID-19 pandemic: Using multiple methods and sources in qualitative research," Journal of Retailing and Consumer Services, Elsevier, vol. 60(C).
    18. Sharma, Manu & Kaushal, Deepak & Joshi, Sudhanshu, 2023. "Adverse effect of social media on generation Z user's behavior: Government information support as a moderating variable," Journal of Retailing and Consumer Services, Elsevier, vol. 72(C).
    19. Oussama Tounekti & Antonio Ruiz-Martínez & Antonio F. Skarmeta Gomez, 2022. "Research in Electronic and Mobile Payment Systems: A Bibliometric Analysis," Sustainability, MDPI, vol. 14(13), pages 1-24, June.
    20. Scott C. Manley & Joseph F. Hair & Ralph I. Williams & William C. McDowell, 2021. "Essential new PLS-SEM analysis methods for your entrepreneurship analytical toolbox," International Entrepreneurship and Management Journal, Springer, vol. 17(4), pages 1805-1825, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:153:y:2021:i:p1:s0960077921007992. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.