IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v37y2022i5d10.1007_s00180-022-01210-x.html
   My bibliography  Save this article

Two sample tests for Semi-Markov processes with parametric sojourn time distributions: an application in sensory analysis

Author

Listed:
  • Cindy Frascolla

    (Institut de Mathématiques de Bourgogne, UMR CNRS 5584, Université de Bourgogne)

  • Guillaume Lecuelle

    (UMR AgroSup Dijon-CNRS-INRAE-Université de Bourgogne)

  • Pascal Schlich

    (UMR AgroSup Dijon-CNRS-INRAE-Université de Bourgogne)

  • Hervé Cardot

    (Institut de Mathématiques de Bourgogne, UMR CNRS 5584, Université de Bourgogne)

Abstract

Developing statistical approaches that are able to compare the probability law of qualitative trajectories can be of real interest in many fields of science such as economics and sociology, quality control or epidemiology. This work is motivated by an application in sensory analysis in which subjects indicate the succession of perceived sensations over time using a list of attributes. In Lecuelle (Food Qual Prefer 67:59–66, 2018), Semi-Markov Processes (SMPs) are introduced to model such data, allowing to take into account the dynamics via the transitions from one attribute to another as well as the duration law of each attribute. One of the major challenges of sensory analysis is to determine if two tasted products are perceived differently. For that purpose, the present paper introduces a statistical testing procedure based on the likelihood ratio between two semi-Markov processes, assuming a parametric form for the sojourn time distributions. Three approaches are evaluated to compute the p-value: a first one based on the asymptotic law of the likelihood ratio, a second one based on the parametric bootstrap and a third one based on permutations. These approaches are compared on Monte-Carlo simulated data both in terms of empirical levels under the null hypothesis and statistical powers under alternatives. We also develop partial tests to compare two processes on either their initial probabilities and transition matrices or their sojourn time distributions. Simulations show that permutation approaches perform better in nearly all situations and especially for small and moderate sample sizes. Finally, the proposed tests are illustrated on real datasets which consist in perceived sensations over time during the tasting of different chocolates and cheeses.

Suggested Citation

  • Cindy Frascolla & Guillaume Lecuelle & Pascal Schlich & Hervé Cardot, 2022. "Two sample tests for Semi-Markov processes with parametric sojourn time distributions: an application in sensory analysis," Computational Statistics, Springer, vol. 37(5), pages 2553-2580, November.
  • Handle: RePEc:spr:compst:v:37:y:2022:i:5:d:10.1007_s00180-022-01210-x
    DOI: 10.1007/s00180-022-01210-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-022-01210-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-022-01210-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hervé Cardot & Guillaume Lecuelle & Pascal Schlich & Michel Visalli, 2019. "Estimating finite mixtures of semi‐Markov chains: an application to the segmentation of temporal sensory data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 68(5), pages 1281-1303, November.
    2. Samis Trevezas & Nikolaos Limnios, 2011. "Exact MLE and asymptotic properties for nonparametric semi-Markov models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(3), pages 719-739.
    3. Vlad Stefan Barbu & Alex Karagrigoriou & Andreas Makrides, 2017. "Semi-Markov Modelling for Multi-State Systems," Methodology and Computing in Applied Probability, Springer, vol. 19(4), pages 1011-1028, December.
    4. Eddelbuettel, Dirk & Francois, Romain, 2011. "Rcpp: Seamless R and C++ Integration," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 40(i08).
    5. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daly, Michael & Delaney, Liam & Doyle, Orla & Fitzpatrick, Nick & O'Farrelly, Christine, 2014. "Can Early Intervention Policies Improve Well-being? Evidence from a randomized controlled trial," 2007 Annual Meeting, July 29-August 1, 2007, Portland, Oregon TN 2015-03, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    2. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Wilson J. Wright & Peter N. Neitlich & Alyssa E. Shiel & Mevin B. Hooten, 2022. "Mechanistic spatial models for heavy metal pollution," Environmetrics, John Wiley & Sons, Ltd., vol. 33(8), December.
    4. Sebastian Schneider & Matthias Sutter, 2020. "Higher Order Risk Preferences: New Experimental Measures, Determinants and Field Behavior," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2020_22, Max Planck Institute for Research on Collective Goods.
    5. Rute M. Caeiro & Pedro C. Vicente, 2020. "Knowledge of vitamin A deficiency and crop adoption: Evidence from a field experiment in Mozambique," Agricultural Economics, International Association of Agricultural Economists, vol. 51(2), pages 175-190, March.
    6. Jessamyn Schaller & Mariana Zerpa, 2019. "Short-Run Effects of Parental Job Loss on Child Health," American Journal of Health Economics, MIT Press, vol. 5(1), pages 8-41, Winter.
    7. Mayya Zhilova, 2015. "Simultaneous likelihood-based bootstrap confidence sets for a large number of models," SFB 649 Discussion Papers SFB649DP2015-031, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    8. Jaschke Philipp & Sulin Sardoschau & Marco Tabellini, 2021. "Scared Straight? Threat and Assimilation of Refugees in Germany," RF Berlin - CReAM Discussion Paper Series 2136, Rockwool Foundation Berlin (RF Berlin) - Centre for Research and Analysis of Migration (CReAM).
    9. Ghanem, Dalia, 2017. "Testing identifying assumptions in nonseparable panel data models," Journal of Econometrics, Elsevier, vol. 197(2), pages 202-217.
    10. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    11. Ishak, Phoebe W., 2021. "Murder nature weather and violent crime in Brazil," Discussion Papers 2021/2, Free University Berlin, School of Business & Economics.
    12. Grácio, Matilde & Vicente, Pedro C., 2021. "Information, get-out-the-vote messages, and peer influence: Causal effects on political behavior in Mozambique," Journal of Development Economics, Elsevier, vol. 151(C).
    13. Engelhardt, Gary V. & Purcell, Patrick J., 2021. "The minimum wage and annual earnings inequality," Economics Letters, Elsevier, vol. 207(C).
    14. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Central limit theorems and multiplier bootstrap when p is much larger than n," CeMMAP working papers 45/12, Institute for Fiscal Studies.
    15. Shen, Yunyi & Olson, Erik R. & Van Deelen, Timothy R., 2021. "Spatially explicit modeling of community occupancy using Markov Random Field models with imperfect observation: Mesocarnivores in Apostle Islands National Lakeshore," Ecological Modelling, Elsevier, vol. 459(C).
    16. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    17. Rossi, Pauline & Villar, Paola, 2020. "Private health investments under competing risks: Evidence from malaria control in Senegal," Journal of Health Economics, Elsevier, vol. 73(C).
    18. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    19. Hızıroğlu Aygün, Aysun & Kırdar, Murat Güray & Koyuncu, Murat & Stoeffler, Quentin, 2024. "Keeping refugee children in school and out of work: Evidence from the world's largest humanitarian cash transfer program," Journal of Development Economics, Elsevier, vol. 168(C).
    20. Cygan-Rehm, Kamila & Karbownik, Krzysztof, 2022. "The effects of incentivizing early prenatal care on infant health," Journal of Health Economics, Elsevier, vol. 83(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:37:y:2022:i:5:d:10.1007_s00180-022-01210-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.