IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v16y2024i5p158-d1388307.html
   My bibliography  Save this article

Optimization of Wheelchair Control via Multi-Modal Integration: Combining Webcam and EEG

Author

Listed:
  • Lassaad Zaway

    (Laboratory of Computer Embedded System, National School of Engineering of Sfax, University of Sfax, Sfax 3029, Tunisia
    National School of Engineering of Gabes, University of Gabes, Gabes 6029, Tunisia)

  • Nader Ben Amor

    (Laboratory of Computer Embedded System, National School of Engineering of Sfax, University of Sfax, Sfax 3029, Tunisia)

  • Jalel Ktari

    (Laboratory of Computer Embedded System, National School of Engineering of Sfax, University of Sfax, Sfax 3029, Tunisia)

  • Mohamed Jallouli

    (Laboratory of Computer Embedded System, National School of Engineering of Sfax, University of Sfax, Sfax 3029, Tunisia)

  • Larbi Chrifi Alaoui

    (Laboratory of Innovative Technologies, University of Picardie Jules Verne, 80000 Amiens, France)

  • Laurent Delahoche

    (Laboratory of Innovative Technologies, University of Picardie Jules Verne, 80000 Amiens, France)

Abstract

Even though Electric Powered Wheelchairs (EPWs) are a useful tool for meeting the needs of people with disabilities, some disabled people find it difficult to use regular EPWs that are joystick-controlled. Smart wheelchairs that use Brain–Computer Interface (BCI) technology present an efficient solution to this problem. This article presents a cutting-edge intelligent control wheelchair that is intended to improve user involvement and security. The suggested method combines facial expression analysis via a camera with EEG signal processing using the EMOTIV Insight EEG dataset. The system generates control commands by identifying specific EEG patterns linked to facial expressions such as eye blinking, winking left and right, and smiling. Simultaneously, the system uses computer vision algorithms and inertial measurements to analyze gaze direction in order to establish the user’s intended steering. The outcomes of the experiments prove that the proposed system is reliable and efficient in meeting the various requirements of people, presenting a positive development in the field of smart wheelchair technology.

Suggested Citation

  • Lassaad Zaway & Nader Ben Amor & Jalel Ktari & Mohamed Jallouli & Larbi Chrifi Alaoui & Laurent Delahoche, 2024. "Optimization of Wheelchair Control via Multi-Modal Integration: Combining Webcam and EEG," Future Internet, MDPI, vol. 16(5), pages 1-16, May.
    • Handle: RePEc:gam:jftint:v:16:y:2024:i:5:p:158-:d:1388307
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/16/5/158/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1999-5903/16/5/158/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cesaltina Pacheco Pires & Soumodip Sarkar & Luísa Carvalho, 2008. "Innovation in services -- how different from manufacturing?," The Service Industries Journal, Taylor & Francis Journals, vol. 28(10), pages 1339-1356, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maria JOSE SILVA & Gastão SOUSA & Jacinta MOREIRA & Jorge SIMÕES, 2011. "Innovation Activities in the Service Sector: Empirical Evidence from Portuguese Firms," Journal of Knowledge Management, Economics and Information Technology, ScientificPapers.org, vol. 1(6), pages 1-17, October.
    2. Hervas-Oliver, Jose-Luis & Sempere-Ripoll, Francisca & Boronat-Moll, Carles, 2012. "Process innovation objectives and management complementarities: patterns, drivers, co-adoption and performance effects," MERIT Working Papers 2012-051, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    3. Bernhard Dachs & Sabine Biege & Martin Borowiecki & Gunter Lay & Angela Jäger & Doris Schartinger, 2014. "Servitisation of European manufacturing: evidence from a large scale database," The Service Industries Journal, Taylor & Francis Journals, vol. 34(1), pages 5-23, January.
    4. Andræs Barge-Gil, 2013. "Open Strategies and Innovation Performance," Industry and Innovation, Taylor & Francis Journals, vol. 20(7), pages 585-610, October.
    5. Paus, Eva & Robinson, Michael, 2022. "Firm-level innovation, government policies and the middle-income trap: insights from five Latin American economies," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), August.
    6. Maria de Lurdes Calisto & Soumodip Sarkar, 2017. "Innovation and corporate entrepreneurship in service businesses," Service Business, Springer;Pan-Pacific Business Association, vol. 11(3), pages 581-600, September.
    7. Maria Chiara Di Guardo & Francesca Cabiddu, 2015. "E-service innovation: combining directed and practice-based approaches," The Service Industries Journal, Taylor & Francis Journals, vol. 35(1-2), pages 81-95, January.
    8. Jesse Arman & Joshua Shackman, 2010. "The impact of financial planning designations on financial planner income," The Service Industries Journal, Taylor & Francis Journals, vol. 32(8), pages 1393-1409, November.
    9. Bourke, Jane & Roper, Stephen & Love, James H., 2020. "Innovation in legal services: The practices that influence ideation and codification activities," Journal of Business Research, Elsevier, vol. 109(C), pages 132-147.
    10. Adamu Jibir & Musa Abdu, 2021. "Human Capital and Propensity to Protect Intellectual Properties as Innovation Output: the Case of Nigerian Manufacturing and Service Firms," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 12(2), pages 595-619, June.
    11. Antonella Cappiello, 2020. "The Digital (R)evolution of Insurance Business Models," American Journal of Economics and Business Administration, Science Publications, vol. 12(1), pages 1-13, January.
    12. Elisabeth Bublitz & Michael Fritsch & Michael Wyrwich, 2015. "Balanced Skills and the City: An Analysis of the Relationship between Entrepreneurial Skill Balance, Thickness, and Innovation," Economic Geography, Clark University, vol. 91(4), pages 475-508, October.
    13. Roberto Álvarez & Claudio Bravo-Ortega & Andrés Zahler, 2015. "Innovation and Productivity in Services: Evidence from Chile," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 51(3), pages 593-611, May.
    14. Rana Mostaghel & Pejvak Oghazi & Hooshang M. Beheshti & Magnus Hultman, 2012. "Adoption of enterprise systems and radio frequency identification among service firms," The Service Industries Journal, Taylor & Francis Journals, vol. 32(15), pages 2435-2443, January.
    15. Marta Peris-Ortiz & Manuel Rodenes Adam, 2011. "Editorial-Creativity and innovation," The Service Industries Journal, Taylor & Francis Journals, vol. 31(12), pages 1903-1905, February.
    16. Afrifa, Godfred Adjapong & Amankwah-Amoah, Joseph & Yamoah, Fred & Acquaye, Adolf & Syllias, Johnny & Quaye, Enoch Nii Boi, 2022. "Regional development, innovation systems and service companies’ performance," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    17. Elisenda Jové‐Llopis & Agustí Segarra‐Blasco, 2020. "Why does eco‐innovation differ in service firms? Some insights from Spain," Business Strategy and the Environment, Wiley Blackwell, vol. 29(3), pages 918-938, March.
    18. Luísa Carvalho & Maria José Madeira & João Carvalho & Dulcineia Catarina Moura & Filipe P. Duarte, 2018. "Cooperation for Innovation in the European Union: Outlook and Evidences Using CIS for 15 European Countries," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 9(2), pages 506-525, June.
    19. Luisa Carvalho, 2011. "Market structures, strategy and innovation in services A study applied to the tourism sector," CEFAGE-UE Working Papers 2011_27, University of Evora, CEFAGE-UE (Portugal).
    20. Chung-Jen Wang & Chang-Yen Tsai, 2014. "Managing innovation and creativity in organizations: an empirical study of service industries in Taiwan," Service Business, Springer;Pan-Pacific Business Association, vol. 8(2), pages 313-335, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:16:y:2024:i:5:p:158-:d:1388307. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.