IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v33y2024i1d10.1007_s10260-023-00717-x.html
   My bibliography  Save this article

Hidden Markov models for longitudinal rating data with dynamic response styles

Author

Listed:
  • Roberto Colombi

    (University of Bergamo)

  • Sabrina Giordano

    (University of Calabria)

  • Maria Kateri

    (RWTH Aachen University)

Abstract

This work deals with the analysis of longitudinal ordinal responses. The novelty of the proposed approach is in modeling simultaneously the temporal dynamics of a latent trait of interest, measured via the observed ordinal responses, and the answering behaviors influenced by response styles, through hidden Markov models (HMMs) with two latent components. This approach enables the modeling of (i) the substantive latent trait, controlling for response styles; (ii) the change over time of latent trait and answering behavior, allowing also dependence on individual characteristics. For the proposed HMMs, estimation procedures, methods for standard errors calculation, measures of goodness of fit and classification, and full-conditional residuals are discussed. The proposed model is fitted to ordinal longitudinal data from the Survey on Household Income and Wealth (Bank of Italy) to give insights on the evolution of households financial capability.

Suggested Citation

  • Roberto Colombi & Sabrina Giordano & Maria Kateri, 2024. "Hidden Markov models for longitudinal rating data with dynamic response styles," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 33(1), pages 1-36, March.
    • Handle: RePEc:spr:stmapp:v:33:y:2024:i:1:d:10.1007_s10260-023-00717-x
    DOI: 10.1007/s10260-023-00717-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-023-00717-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10260-023-00717-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. D. Oakes, 1999. "Direct calculation of the information matrix via the EM," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 479-482, April.
    2. Guido Blasio & Maria Paola & Samuele Poy & Vincenzo Scoppa, 2021. "Massive earthquakes, risk aversion, and entrepreneurship," Small Business Economics, Springer, vol. 57(1), pages 295-322, June.
    3. Colombi, R. & Giordano, S., 2012. "Graphical models for multivariate Markov chains," Journal of Multivariate Analysis, Elsevier, vol. 107(C), pages 90-103.
    4. Muhammad Hanif & Faiza Sami & Mehvish Hyder & Muhammad Iqbal Ch, 2017. "Hidden Markov Model for Time Series Prediction," Journal of Asian Scientific Research, Asian Economic and Social Society, vol. 7(5), pages 196-205.
    5. Domenico Piccolo & Rosaria Simone & Maria Iannario, 2019. "Cumulative and CUB Models for Rating Data: A Comparative Analysis," International Statistical Review, International Statistical Institute, vol. 87(2), pages 207-236, August.
    6. Bettina Grün & Sara Dolnicar, 2016. "Response style corrected market segmentation for ordinal data," Marketing Letters, Springer, vol. 27(4), pages 729-741, December.
    7. Altman, Rachel MacKay, 2007. "Mixed Hidden Markov Models: An Extension of the Hidden Markov Model to the Longitudinal Data Setting," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 201-210, March.
    8. Francesco Bartolucci, 2006. "Likelihood inference for a class of latent Markov models under linear hypotheses on the transition probabilities," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(2), pages 155-178, April.
    9. Antonello Maruotti, 2011. "Mixed Hidden Markov Models for Longitudinal Data: An Overview," International Statistical Review, International Statistical Institute, vol. 79(3), pages 427-454, December.
    10. Roberto Colombi & Sabrina Giordano & Gerhard Tutz, 2021. "A Rating Scale Mixture Model to Account for the Tendency to Middle and Extreme Categories," Journal of Educational and Behavioral Statistics, , vol. 46(6), pages 682-716, December.
    11. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    12. Natalia Kieruj & Guy Moors, 2013. "Response style behavior: question format dependent or personal style?," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(1), pages 193-211, January.
    13. Roberto Colombi & Sabrina Giordano & Anna Gottard & Maria Iannario, 2019. "Hierarchical marginal models with latent uncertainty," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 46(2), pages 595-620, June.
    14. Gerhard Tutz, 2021. "Hierarchical Models for the Analysis of Likert Scales in Regression and Item Response Analysis," International Statistical Review, International Statistical Institute, vol. 89(1), pages 18-35, April.
    15. Colombi, R. & Giordano, S., 2015. "Multiple hidden Markov models for categorical time series," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 19-30.
    16. Muhammad Hanif & Faiza Sami & Mehvish Hyder & Muhammad Iqbal Ch, 2017. "Hidden Markov Model for Time Series Prediction," Journal of Asian Scientific Research, Asian Economic and Social Society, vol. 7(5), pages 196-205, May.
    17. Alessio Farcomeni, 2015. "Generalized Linear Mixed Models Based on Latent Markov Heterogeneity Structures," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 1127-1135, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roberto Colombi & Sabrina Giordano, 2025. "Markov switching stereotype logit models for longitudinal ordinal data affected by unobserved heterogeneity in responding behavior," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 109(1), pages 117-147, March.
    2. Gordon Anderson & Alessio Farcomeni & Maria Grazia Pittau & Roberto Zelli, 2019. "Rectangular latent Markov models for time‐specific clustering, with an analysis of the wellbeing of nations," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 68(3), pages 603-621, April.
    3. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 433-465, September.
    4. Gordon Anderson & Alessio Farcomeni & Grazia Pittau & Roberto Zelli, 2017. "Rectangular latent Markov models for time-specific clustering," Working Papers tecipa-589, University of Toronto, Department of Economics.
    5. Giorgio E. Montanari & Marco Doretti, 2019. "Ranking Nursing Homes’ Performances Through a Latent Markov Model with Fixed and Random Effects," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 146(1), pages 307-326, November.
    6. Catania, Leopoldo & Di Mari, Roberto, 2021. "Hierarchical Markov-switching models for multivariate integer-valued time-series," Journal of Econometrics, Elsevier, vol. 221(1), pages 118-137.
    7. Marino, Maria Francesca & Alfó, Marco, 2016. "Gaussian quadrature approximations in mixed hidden Markov models for longitudinal data: A simulation study," Computational Statistics & Data Analysis, Elsevier, vol. 94(C), pages 193-209.
    8. Luca Merlo & Lea Petrella & Nikos Tzavidis, 2022. "Quantile mixed hidden Markov models for multivariate longitudinal data: An application to children's Strengths and Difficulties Questionnaire scores," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(2), pages 417-448, March.
    9. Roland Langrock & Timo Adam & Vianey Leos‐Barajas & Sina Mews & David L. Miller & Yannis P. Papastamatiou, 2018. "Spline‐based nonparametric inference in general state‐switching models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 179-200, August.
    10. Francesco Lagona & Antonello Maruotti & Fabio Padovano, 2015. "Multilevel multivariate modelling of legislative count data, with a hidden Markov chain," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(3), pages 705-723, June.
    11. Maria Marino & Marco Alfó, 2015. "Latent drop-out based transitions in linear quantile hidden Markov models for longitudinal responses with attrition," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 9(4), pages 483-502, December.
    12. Francesco Bartolucci & Alessio Farcomeni, 2015. "A discrete time event-history approach to informative drop-out in mixed latent Markov models with covariates," Biometrics, The International Biometric Society, vol. 71(1), pages 80-89, March.
    13. Bartolucci, Francesco & Lupparelli, Monia, 2012. "Nested hidden Markov chains for modeling dynamic unobserved heterogeneity in multilevel longitudinal data," MPRA Paper 40588, University Library of Munich, Germany.
    14. Alessio Farcomeni, 2015. "Generalized Linear Mixed Models Based on Latent Markov Heterogeneity Structures," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 1127-1135, December.
    15. Rosaria Simone, 2021. "An accelerated EM algorithm for mixture models with uncertainty for rating data," Computational Statistics, Springer, vol. 36(1), pages 691-714, March.
    16. Antonello Maruotti & Jan Bulla & Tanya Mark, 2019. "Assessing the influence of marketing activities on customer behaviors: a dynamic clustering approach," METRON, Springer;Sapienza Università di Roma, vol. 77(1), pages 19-42, April.
    17. Giorgio Eduardo Montanari & Marco Doretti & Maria Francesca Marino, 2022. "Model-based two-way clustering of second-level units in ordinal multilevel latent Markov models," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(2), pages 457-485, June.
    18. Montanari, Giorgio E. & Doretti, Marco & Bartolucci, Francesco, 2017. "A multilevel latent Markov model for the evaluation of nursing homes' performance," MPRA Paper 80691, University Library of Munich, Germany.
    19. Jesse D. Raffa & Joel A. Dubin, 2015. "Multivariate longitudinal data analysis with mixed effects hidden Markov models," Biometrics, The International Biometric Society, vol. 71(3), pages 821-831, September.
    20. Mourad Mroua & Ahlem Lamine, 2023. "Financial time series prediction under Covid-19 pandemic crisis with Long Short-Term Memory (LSTM) network," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-15, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:33:y:2024:i:1:d:10.1007_s10260-023-00717-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.