IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0241480.html
   My bibliography  Save this article

Validation of the Mobile Application Rating Scale (MARS)

Author

Listed:
  • Yannik Terhorst
  • Paula Philippi
  • Lasse B Sander
  • Dana Schultchen
  • Sarah Paganini
  • Marco Bardus
  • Karla Santo
  • Johannes Knitza
  • Gustavo C Machado
  • Stephanie Schoeppe
  • Natalie Bauereiß
  • Alexandra Portenhauser
  • Matthias Domhardt
  • Benjamin Walter
  • Martin Krusche
  • Harald Baumeister
  • Eva-Maria Messner

Abstract

Background: Mobile health apps (MHA) have the potential to improve health care. The commercial MHA market is rapidly growing, but the content and quality of available MHA are unknown. Instruments for the assessment of the quality and content of MHA are highly needed. The Mobile Application Rating Scale (MARS) is one of the most widely used tools to evaluate the quality of MHA. Only few validation studies investigated its metric quality. No study has evaluated the construct validity and concurrent validity. Objective: This study evaluates the construct validity, concurrent validity, reliability, and objectivity, of the MARS. Methods: Data was pooled from 15 international app quality reviews to evaluate the metric properties of the MARS. The MARS measures app quality across four dimensions: engagement, functionality, aesthetics and information quality. Construct validity was evaluated by assessing related competing confirmatory models by confirmatory factor analysis (CFA). Non-centrality (RMSEA), incremental (CFI, TLI) and residual (SRMR) fit indices were used to evaluate the goodness of fit. As a measure of concurrent validity, the correlations to another quality assessment tool (ENLIGHT) were investigated. Reliability was determined using Omega. Objectivity was assessed by intra-class correlation. Results: In total, MARS ratings from 1,299 MHA covering 15 different health domains were included. Confirmatory factor analysis confirmed a bifactor model with a general factor and a factor for each dimension (RMSEA = 0.074, TLI = 0.922, CFI = 0.940, SRMR = 0.059). Reliability was good to excellent (Omega 0.79 to 0.93). Objectivity was high (ICC = 0.82). MARS correlated with ENLIGHT (ps

Suggested Citation

  • Yannik Terhorst & Paula Philippi & Lasse B Sander & Dana Schultchen & Sarah Paganini & Marco Bardus & Karla Santo & Johannes Knitza & Gustavo C Machado & Stephanie Schoeppe & Natalie Bauereiß & Alexan, 2020. "Validation of the Mobile Application Rating Scale (MARS)," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-14, November.
    • Handle: RePEc:plo:pone00:0241480
    DOI: 10.1371/journal.pone.0241480
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0241480
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0241480&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0241480?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Paul T E Cusack, 2020. "On Pain," Biomedical Journal of Scientific & Technical Research, Biomedical Research Network+, LLC, vol. 31(3), pages 24253-24254, October.
    2. William Revelle & Richard Zinbarg, 2009. "Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 145-154, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Felix Holl & Jennifer Kircher & Walter J. Swoboda & Johannes Schobel, 2021. "Methods Used to Evaluate mHealth Applications for Cardiovascular Disease: A Quasi-Systematic Scoping Review," IJERPH, MDPI, vol. 18(23), pages 1-16, November.
    2. Chiara Mack & Yannik Terhorst & Mirjam Stephan & Harald Baumeister & Michael Stach & Eva-Maria Messner & Jürgen Bengel & Lasse B. Sander, 2021. "“Help in a Heartbeat?”: A Systematic Evaluation of Mobile Health Applications (Apps) for Coronary Heart Disease," IJERPH, MDPI, vol. 18(19), pages 1-15, September.
    3. Jihye Choi & Chongwook Chung & Hyekyung Woo, 2021. "Diet-Related Mobile Apps to Promote Healthy Eating and Proper Nutrition: A Content Analysis and Quality Assessment," IJERPH, MDPI, vol. 18(7), pages 1-10, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Niederer & Juliane Mueller, 2020. "Sustainability effects of motor control stabilisation exercises on pain and function in chronic nonspecific low back pain patients: A systematic review with meta-analysis and meta-regression," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-21, January.
    2. Anne-Catherine Guio & David Gordon & Eric Marlier & Hector Najera & Marco Pomati, 2018. "Towards an EU measure of child deprivation," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 11(3), pages 835-860, June.
    3. Sana Sadiq & Khadija Anasse & Najib Slimani, 2022. "The impact of mobile phones on high school students: connecting the research dots," Technium Social Sciences Journal, Technium Science, vol. 30(1), pages 252-270, April.
    4. Jitka Vseteckova, 2020. "Psychological Therapy for ICT Literate Older Adults in the Time of COVID-19 - Perceptions on the Acceptability of Online Versus Face to Face Versions of a Mindfulness for Later Life Group," Biomedical Journal of Scientific & Technical Research, Biomedical Research Network+, LLC, vol. 31(1), pages 23912-23916, October.
    5. Khalid Ahmed Al-Ansari & Ahmet Faruk Aysan, 2021. "More than ten years of Blockchain creation: How did we use the technology and which direction is the research heading? [Plus de dix ans de création Blockchain : Comment avons-nous utilisé la techno," Working Papers hal-03343048, HAL.
    6. Ling, Gabriel Hoh Teck & Suhud, Nur Amiera binti Md & Leng, Pau Chung & Yeo, Lee Bak & Cheng, Chin Tiong & Ahmad, Mohd Hamdan Haji & Matusin, AK Mohd Rafiq AK, 2021. "Factors Influencing Asia-Pacific Countries’ Success Level in Curbing COVID-19: A Review Using a Social–Ecological System (SES) Framework," SocArXiv b9f2w, Center for Open Science.
    7. Benedict E. DeDominicis, 2021. "Multinational Enterprises And Economic Nationalism: A Strategic Analysis Of Culture," Global Journal of Business Research, The Institute for Business and Finance Research, vol. 15(1), pages 19-66.
    8. Robert J. R. Elliott & Ingmar Schumacher & Cees Withagen, 2020. "Suggestions for a Covid-19 Post-Pandemic Research Agenda in Environmental Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 76(4), pages 1187-1213, August.
    9. Rafał Krupiński, 2020. "Virtual Reality System and Scientific Visualisation for Smart Designing and Evaluating of Lighting," Energies, MDPI, vol. 13(20), pages 1-17, October.
    10. Gaetano Martino & Giulia Giacchè & Enrica Rossetti, 2016. "Organizing the Co-Production of Health and Environmental Values in Food Production: The Constitutional Processes in the Relationships between Italian Solidarity Purchasing Groups and Farmers," Sustainability, MDPI, vol. 8(4), pages 1-22, March.
    11. Samuel Mayanja & Joseph M. Ntayi & John C. Munene & Waswa Balunywa & James R. K. Kagaari, 2021. "Informational differences and entrepreneurial networking among small and medium enterprises in Uganda," Journal of Global Entrepreneurship Research, Springer;UNESCO Chair in Entrepreneurship, vol. 11(1), pages 563-577, December.
    12. Werner Hölzl & Michael Böheim & Klaus S. Friesenbichler & Agnes Kügler & Thomas Leoni, 2021. "Staatliche Hilfsmaßnahmen für Unternehmen in der COVID-19-Krise. Eine begleitende Analyse operativer Aspekte und Unternehmenseinschätzungen," WIFO Studies, WIFO, number 66624, February.
    13. Thorbecke, Willem & Chen, Chen & Salike, Nimesh, 2021. "China’s exports in a protectionist world," Journal of Asian Economics, Elsevier, vol. 77(C).
    14. Óscar Chiva-Bartoll & Honorato Morente-Oria & Francisco Tomás González-Fernández & Pedro Jesús Ruiz-Montero, 2020. "Anxiety and Bodily Pain in Older Women Participants in a Physical Education Program. A Multiple Moderated Mediation Analysis," Sustainability, MDPI, vol. 12(10), pages 1-12, May.
    15. Sai-fu Fung & Esther Oi-wah Chow & Chau-kiu Cheung, 2020. "Development and Evaluation of the Psychometric Properties of a Brief Wisdom Development Scale," IJERPH, MDPI, vol. 17(8), pages 1-14, April.
    16. Gigi Foster, 2020. "The behavioural economics of government responses to COVID-19," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 4(S3), pages 11-43, December.
    17. Reza Salajegheh & Edward C Nemergut & Terran M Rice & Roy Joseph & Siny Tsang & Bethany M Sarosiek & C Paige Muthusubramanian & Katelyn M Hipwell & Kate B Horton & Bhiken I Naik, 2020. "Impact of a perioperative oral opioid substitution protocol during the nationwide intravenous opioid shortage: A single center, interrupted time series with segmented regression analysis," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-13, June.
    18. Jaroslav Flegr & Radim Kuba & Robin Kopecký, 2020. "Rhesus-minus phenotype as a predictor of sexual desire and behavior, wellbeing, mental health, and fecundity," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-11, July.
    19. Tonata Dengeingei & Laura Uusiku & Olivia N Tuhadeleni & Alice Lifalaza, 2020. "Assessing Knowledge and Practice Regarding the Management of Dysmenorrhea Among Students at University of Namibia Rundu Campus," Global Journal of Health Science, Canadian Center of Science and Education, vol. 12(9), pages 105-105, August.
    20. Craig C Kage & Mohsen Akbari-Shandiz & Mary H Foltz & Rebekah L Lawrence & Taycia L Brandon & Nathaniel E Helwig & Arin M Ellingson, 2020. "Validation of an automated shape-matching algorithm for biplane radiographic spine osteokinematics and radiostereometric analysis error quantification," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-15, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0241480. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.