IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v10y2022i7p1025-d777517.html
   My bibliography  Save this article

Jointly Modeling Rating Responses and Times with Fuzzy Numbers: An Application to Psychometric Data

Author

Listed:
  • Niccolò Cao

    (DPSS, University of Padova, 35131 Padova, Italy)

  • Antonio Calcagnì

    (DPSS, University of Padova, 35131 Padova, Italy)

Abstract

In several research areas, ratings data and response times have been successfully used to unfold the stagewise process through which human raters provide their responses to questionnaires and social surveys. A limitation of the standard approach to analyze this type of data is that it requires the use of independent statistical models. Although this provides an effective way to simplify the data analysis, it could potentially involve difficulties with regard to statistical inference and interpretation. In this sense, a joint analysis could be more effective. In this research article, we describe a way to jointly analyze ratings and response times by means of fuzzy numbers. A probabilistic tree model framework has been adopted to fuzzify ratings data and four-parameters triangular fuzzy numbers have been used in order to integrate crisp responses and times. Finally, a real case study on psychometric data is discussed in order to illustrate the proposed methodology. Overall, we provide initial findings to the problem of using fuzzy numbers as abstract models for representing ratings data with additional information (i.e., response times). The results indicate that using fuzzy numbers leads to theoretically sound and more parsimonious data analysis methods, which limit some statistical issues that may occur with standard data analysis procedures.

Suggested Citation

  • Niccolò Cao & Antonio Calcagnì, 2022. "Jointly Modeling Rating Responses and Times with Fuzzy Numbers: An Application to Psychometric Data," Mathematics, MDPI, vol. 10(7), pages 1-11, March.
  • Handle: RePEc:gam:jmathe:v:10:y:2022:i:7:p:1025-:d:777517
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/10/7/1025/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/10/7/1025/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. De Boeck, Paul & Partchev, Ivailo, 2012. "IRTrees: Tree-Based Item Response Models of the GLMM Family," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(c01).
    2. De Boeck, Paul & Bakker, Marjan & Zwitser, Robert & Nivard, Michel & Hofman, Abe & Tuerlinckx, Francis & Partchev, Ivailo, 2011. "The Estimation of Item Response Models with the lmer Function from the lme4 Package in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 39(i12).
    3. Michael Veall & Klaus Zimmermann, 1994. "Evaluating Pseudo-R 2 's for binary probit models," Quality & Quantity: International Journal of Methodology, Springer, vol. 28(2), pages 151-164, May.
    4. Antonio Calcagnì & Luigi Lombardi, 2022. "Modeling random and non-random decision uncertainty in ratings data: a fuzzy beta model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(1), pages 145-173, March.
    5. Michelle Lalla & Gisella Facchinetti & Giovanni Mastroleo, 2005. "Ordinal scales and fuzzy set systems to measure agreement: An application to the evaluation of teaching activity," Quality & Quantity: International Journal of Methodology, Springer, vol. 38(5), pages 577-601, January.
    6. Concepción Costas & Pedro Marañon & Juan Cabrera, 1994. "Application of diffuse measurement to the evaluation of psychological structures," Quality & Quantity: International Journal of Methodology, Springer, vol. 28(3), pages 305-313, August.
    7. Bjelland, Ingvar & Krokstad, Steinar & Mykletun, Arnstein & Dahl, Alv A. & Tell, Grethe S. & Tambs, K., 2008. "Does a higher educational level protect against anxiety and depression? The HUNT study," Social Science & Medicine, Elsevier, vol. 66(6), pages 1334-1345, March.
    8. Qing Li, 2016. "Indirect membership function assignment based on ordinal regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(3), pages 441-460, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrés López-Sepulcre & Sebastiano De Bona & Janne K. Valkonen & Kate D.L. Umbers & Johanna Mappes, 2015. "Item Response Trees: a recommended method for analyzing categorical data in behavioral studies," Behavioral Ecology, International Society for Behavioral Ecology, vol. 26(5), pages 1268-1273.
    2. Nana Kim & Daniel M. Bolt & James Wollack, 2022. "Noncompensatory MIRT For Passage-Based Tests," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 992-1009, September.
    3. Ana M. Castaño & M. Asunción Lubiano & Antonio L. García-Izquierdo, 2020. "Gendered Beliefs in STEM Undergraduates: A Comparative Analysis of Fuzzy Rating versus Likert Scales," Sustainability, MDPI, vol. 12(15), pages 1-17, August.
    4. Antonio Caronni & Marina Ramella & Pietro Arcuri & Claudia Salatino & Lucia Pigini & Maurizio Saruggia & Chiara Folini & Stefano Scarano & Rosa Maria Converti, 2023. "The Rasch Analysis Shows Poor Construct Validity and Low Reliability of the Quebec User Evaluation of Satisfaction with Assistive Technology 2.0 (QUEST 2.0) Questionnaire," IJERPH, MDPI, vol. 20(2), pages 1-19, January.
    5. Ekhlas Al‐Gamal & Janelle Yorke, 2014. "Perceived breathlessness and psychological distress among patients with chronic obstructive pulmonary disease and their spouses," Nursing & Health Sciences, John Wiley & Sons, vol. 16(1), pages 103-111, March.
    6. Syed Latifi & Okan Bulut & Mark Gierl & Thomas Christie & Shehzad Jeeva, 2016. "Differential Performance on National Exams," SAGE Open, , vol. 6(2), pages 21582440166, June.
    7. Bonaccolto-Töpfer, Marina & Castagnetti, Carolina, 2021. "The COVID-19 pandemic: A threat to higher education?," Discussion Papers 117, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Labour and Regional Economics.
    8. Di Novi, Cinzia & Leporatti, Lucia & Montefiori, Marcello, 2021. "The role of education in psychological response to adverse health shocks," Health Policy, Elsevier, vol. 125(5), pages 643-650.
    9. Pavlova, Milena & Hendrix, Marijke & Nouwens, Elvira & Nijhuis, Jan & van Merode, Godefridus, 2009. "The choice of obstetric care by low-risk pregnant women in the Netherlands: Implications for policy and management," Health Policy, Elsevier, vol. 93(1), pages 27-34, November.
    10. Li, Kai & Chen, Pei-Ying & Yan, Erjia, 2019. "Challenges of measuring software impact through citations: An examination of the lme4 R package," Journal of Informetrics, Elsevier, vol. 13(1), pages 449-461.
    11. Joshua B. Gilbert & James S. Kim & Luke W. Miratrix, 2023. "Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 889-913, December.
    12. Sun-Joo Cho & Sarah Brown-Schmidt & Paul De Boeck & Jianhong Shen, 2020. "Modeling Intensive Polytomous Time-Series Eye-Tracking Data: A Dynamic Tree-Based Item Response Model," Psychometrika, Springer;The Psychometric Society, vol. 85(1), pages 154-184, March.
    13. Michele Lalla, 2017. "Fundamental characteristics and statistical analysis of ordinal variables: a review," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(1), pages 435-458, January.
    14. Pierpaolo D’Urso & Livia Giovanni & Marta Disegna & Riccardo Massari & Vincenzina Vitale, 2021. "A Tourist Segmentation Based on Motivation, Satisfaction and Prior Knowledge with a Socio-Economic Profiling: A Clustering Approach with Mixed Information," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 154(1), pages 335-360, February.
    15. Gerhard Tutz & Moritz Berger, 2016. "Response Styles in Rating Scales," Journal of Educational and Behavioral Statistics, , vol. 41(3), pages 239-268, June.
    16. Salaisook, Phastraporn & Faysse, Nicolas & Tsusaka, Takuji W., 2020. "Reasons for adoption of sustainable land management practices in a changing context: A mixed approach in Thailand," Land Use Policy, Elsevier, vol. 96(C).
    17. Kuan-Yu Jin & Yi-Jhen Wu & Hui-Fang Chen, 2022. "A New Multiprocess IRT Model With Ideal Points for Likert-Type Items," Journal of Educational and Behavioral Statistics, , vol. 47(3), pages 297-321, June.
    18. Minjeong Jeon & Sophia Rabe-Hesketh, 2012. "Profile-Likelihood Approach for Estimating Generalized Linear Mixed Models With Factor Structures," Journal of Educational and Behavioral Statistics, , vol. 37(4), pages 518-542, August.
    19. Ruiz-Palomino, Pablo & Yáñez-Araque, Benito & Jiménez-Estévez, Pedro & Gutiérrez-Broncano, Santiago, 2022. "Can servant leadership prevent hotel employee depression during the COVID-19 pandemic? A mediating and multigroup analysis," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    20. Brooke E. Magnus & David Thissen, 2017. "Item Response Modeling of Multivariate Count Data With Zero Inflation, Maximum Inflation, and Heaping," Journal of Educational and Behavioral Statistics, , vol. 42(5), pages 531-558, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:7:p:1025-:d:777517. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.