IDEAS home Printed from https://ideas.repec.org/a/spr/cejnor/v28y2020i2d10.1007_s10100-019-00628-x.html
   My bibliography  Save this article

Application of hidden Markov models to eye tracking data analysis of visual quality inspection operations

Author

Listed:
  • Berna Haktanirlar Ulutas

    (Eskisehir Osmangazi University)

  • N. Fırat Özkan

    (Eskisehir Osmangazi University)

  • Rafał Michalski

    (Wrocław University of Science and Technology)

Abstract

Visual inspection is used in many areas due to the potential high costs of inspection error such as injury, fatality, loss of expensive equipment, scrapped items, rework, or failure to procure repeat business. This study presents an application of hidden Markov models (HMM) to fixations’ sequences analysis during visual inspection of front panels in a home appliance facility. The eye tracking data are gathered when quality control operators perform their tasks. The results support the difference between expert and novice operator. Moreover, the article demonstrates four HMMs with two and three hidden states both for novice and experienced operators and provides analysis and discussion of the outcomes.

Suggested Citation

  • Berna Haktanirlar Ulutas & N. Fırat Özkan & Rafał Michalski, 2020. "Application of hidden Markov models to eye tracking data analysis of visual quality inspection operations," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 28(2), pages 761-777, June.
    • Handle: RePEc:spr:cejnor:v:28:y:2020:i:2:d:10.1007_s10100-019-00628-x
    DOI: 10.1007/s10100-019-00628-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10100-019-00628-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10100-019-00628-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jerzy Grobelny & Rafal Michalski, 2017. "Applying hidden Markov models to visual activity analysis for simple digital control panel operations," WORking papers in Management Science (WORMS) WORMS/17/06, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    2. Rafal Michalski & Jerzy Grobelny, 2016. "An eye tracking based examination of visual attention during pairwise comparisons of a digital product’s package," WORking papers in Management Science (WORMS) WORMS/16/14, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    3. John Liechty & Rik Pieters & Michel Wedel, 2003. "Global and local covert visual attention: Evidence from a bayesian hidden markov model," Psychometrika, Springer;The Psychometric Society, vol. 68(4), pages 519-541, December.
    4. Kristian Lukander & Miika Toivanen & Kai Puolamäki, 2017. "Inferring Intent and Action from Gaze in Naturalistic Behavior: A Review," International Journal of Mobile Human Computer Interaction (IJMHCI), IGI Global, vol. 9(4), pages 41-57, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Laurent Joblot & Magnani Florian & Frédéric Rosin & Robert Pellerin & Mario Passalacqua, 2023. "Protocole expérimental visant l'étude de l’IA centrée sur l'humain dans le contexte de l'Industrie 5.0 : Application en réalité augmentée," Post-Print hal-04142374, HAL.
    2. Jerzy Grobelny & Rafal Michalski & Gerhard-Wilhelm Weber, 2021. "Modeling human thinking about similarities by neuromatrices in the perspective of fuzzy logic," WORking papers in Management Science (WORMS) WORMS/21/09, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    3. Krzysztof Hankiewicz & Gerhard-Wilhelm Weber, 2020. "Human factors in a contemporary organization," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 28(2), pages 579-587, June.
    4. Jerzy Grobelny & Rafal Michalski, 2021. "Hidden Markov models for visual processing of marketing leaflets," WORking papers in Management Science (WORMS) WORMS/21/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jerzy Grobelny & Rafal Michalski, 2020. "Investigating human visual behavior by hidden Markov models in the design of marketing information," WORking papers in Management Science (WORMS) WORMS/20/09, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    2. Rafal Michalski & Jerzy Grobelny & Anna Bezdzietna, 2020. "Column versus tabular layout of paragraphs in message conveyance: visual processing study based on eye-tracking data," WORking papers in Management Science (WORMS) WORMS/20/19, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    3. Jerzy Grobelny & Rafal Michalski, 2021. "Hidden Markov models for visual processing of marketing leaflets," WORking papers in Management Science (WORMS) WORMS/21/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    4. Sam Hui & Eric Bradlow, 2012. "Bayesian multi-resolution spatial analysis with applications to marketing," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 419-452, December.
    5. Krucien, Nicolas & Ryan, Mandy & Hermens, Frouke, 2017. "Visual attention in multi-attributes choices: What can eye-tracking tell us?," Journal of Economic Behavior & Organization, Elsevier, vol. 135(C), pages 251-267.
    6. Savannah Wei Shi & Michel Wedel & F. G. M. (Rik) Pieters, 2013. "Information Acquisition During Online Decision Making: A Model-Based Exploration Using Eye-Tracking Data," Management Science, INFORMS, vol. 59(5), pages 1009-1026, May.
    7. Jerzy Grobelny & Rafal Michalski & Gerhard-Wilhelm Weber, 2021. "Modeling human thinking about similarities by neuromatrices in the perspective of fuzzy logic," WORking papers in Management Science (WORMS) WORMS/21/09, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    8. Lemmens, Aurélie & Croux, Christophe & Stremersch, Stefan, 2012. "Dynamics in the international market segmentation of new product growth," International Journal of Research in Marketing, Elsevier, vol. 29(1), pages 81-92.
    9. Jerzy Grobelny & Rafal Michalski, 2017. "Applying hidden Markov models to visual activity analysis for simple digital control panel operations," WORking papers in Management Science (WORMS) WORMS/17/06, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    10. Rafal Michalski & Joanna Koszela-Kulinska, 2020. "Eye-tracking examination of the anthropological race, gender and verbal-pictorial relative positions on ergonomics of visual information presentation," WORking papers in Management Science (WORMS) WORMS/20/10, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    11. Ricardo Montoya & Oded Netzer & Kamel Jedidi, 2010. "Dynamic Allocation of Pharmaceutical Detailing and Sampling for Long-Term Profitability," Marketing Science, INFORMS, vol. 29(5), pages 909-924, 09-10.
    12. Michel Wedel & Rik Pieters & Ralf Lans, 2023. "Modeling Eye Movements During Decision Making: A Review," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 697-729, June.
    13. Erik Reichle & Jessica Nelson, 2003. "Local vs. global covert visual attention: Are two states necessary? Comment on Liechty et al., 2003," Psychometrika, Springer;The Psychometric Society, vol. 68(4), pages 543-549, December.
    14. LouAnne Boyd & Vincent Berardi & Deanna Hughes & Franceli Cibrian & Jazette Johnson & Viseth Sean & Eliza DelPizzo-Cheng & Brandon Mackin & Ayra Tusneem & Riya Mody & Sara Jones & Karen Lotich, 2022. "Manipulating image luminance to improve eye gaze and verbal behavior in autistic children," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-9, December.
    15. Eric M. Schwartz & Eric T. Bradlow & Peter S. Fader, 2014. "Model Selection Using Database Characteristics: Developing a Classification Tree for Longitudinal Incidence Data," Marketing Science, INFORMS, vol. 33(2), pages 188-205, March.
    16. Clarence Lee & Elie Ofek & Thomas J. Steenburgh, 2018. "Personal and Social Usage: The Origins of Active Customers and Ways to Keep Them Engaged," Management Science, INFORMS, vol. 64(6), pages 2473-2495, June.
    17. John R. Hauser & Glen L. Urban & Guilherme Liberali & Michael Braun, 2009. "Website Morphing," Marketing Science, INFORMS, vol. 28(2), pages 202-223, 03-04.
    18. Oded Netzer & Olivier Toubia & Eric Bradlow & Ely Dahan & Theodoros Evgeniou & Fred Feinberg & Eleanor Feit & Sam Hui & Joseph Johnson & John Liechty & James Orlin & Vithala Rao, 2008. "Beyond conjoint analysis: Advances in preference measurement," Marketing Letters, Springer, vol. 19(3), pages 337-354, December.
    19. Savannah Wei Shi & Hai Che & Lang Jin, 2021. "Strategic Product Displays Across Different Assortment Levels," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 8(3), pages 84-101, September.
    20. V. Kumar & S. Sriram & Anita Luo & Pradeep K. Chintagunta, 2011. "Assessing the Effect of Marketing Investments in a Business Marketing Context," Marketing Science, INFORMS, vol. 30(5), pages 924-940, September.

    More about this item

    Keywords

    Human factors; Visual inspection; Human visual behavior; Hidden Markov models; Eye tracking technology;
    All these keywords.

    JEL classification:

    • C00 - Mathematical and Quantitative Methods - - General - - - General
    • D01 - Microeconomics - - General - - - Microeconomic Behavior: Underlying Principles
    • D03 - Microeconomics - - General - - - Behavioral Microeconomics: Underlying Principles
    • D24 - Microeconomics - - Production and Organizations - - - Production; Cost; Capital; Capital, Total Factor, and Multifactor Productivity; Capacity
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D87 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Neuroeconomics
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • L15 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Information and Product Quality
    • L16 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Industrial Organization and Macroeconomics; Macroeconomic Industrial Structure

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:cejnor:v:28:y:2020:i:2:d:10.1007_s10100-019-00628-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.