IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-29197-5.html
   My bibliography  Save this article

Noncontact human-machine interaction based on hand-responsive infrared structural color

Author

Listed:
  • Shun An

    (Shanghai Jiao Tong University)

  • Hanrui Zhu

    (Shanghai Jiao Tong University)

  • Chunzhi Guo

    (Shanghai Jiao Tong University)

  • Benwei Fu

    (Shanghai Jiao Tong University)

  • Chengyi Song

    (Shanghai Jiao Tong University)

  • Peng Tao

    (Shanghai Jiao Tong University)

  • Wen Shang

    (Shanghai Jiao Tong University)

  • Tao Deng

    (Shanghai Jiao Tong University)

Abstract

Noncontact human-machine interaction provides a hygienic and intelligent approach for the communication between human and robots. Current noncontact human-machine interactions are generally limited by the interaction distance or conditions, such as in the dark. Here we explore the utilization of hand as an infrared light source for noncontact human-machine interaction. Metallic gratings are used as the human-machine interface to respond to infrared radiation from hand and the generated signals are visualized as different infrared structural colors. We demonstrate the applications of the infrared structural color-based human-machine interaction for user-interactive touchless display and real-time control of a robot vehicle. The interaction is flexible to the hand-interface distance ranging from a few centimeters to tens of centimeters and can be used in low lighting condition or in the dark. The findings in this work provide an alternative and complementary approach to traditional noncontact human-machine interactions, which may further broaden the potential applications of human-machine interaction.

Suggested Citation

  • Shun An & Hanrui Zhu & Chunzhi Guo & Benwei Fu & Chengyi Song & Peng Tao & Wen Shang & Tao Deng, 2022. "Noncontact human-machine interaction based on hand-responsive infrared structural color," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-29197-5
    DOI: 10.1038/s41467-022-29197-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-29197-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-29197-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Oluwaseun A. Araromi & Moritz A. Graule & Kristen L. Dorsey & Sam Castellanos & Jonathan R. Foster & Wen-Hao Hsu & Arthur E. Passy & Joost J. Vlassak & James C. Weaver & Conor J. Walsh & Robert J. Woo, 2020. "Ultra-sensitive and resilient compliant strain gauges for soft machines," Nature, Nature, vol. 587(7833), pages 219-224, November.
    2. Pingqiang Cai & Changjin Wan & Liang Pan & Naoji Matsuhisa & Ke He & Zequn Cui & Wei Zhang & Chengcheng Li & Jianwu Wang & Jing Yu & Ming Wang & Ying Jiang & Geng Chen & Xiaodong Chen, 2020. "Locally coupled electromechanical interfaces based on cytoadhesion-inspired hybrids to identify muscular excitation-contraction signatures," Nature Communications, Nature, vol. 11(1), pages 1-12, December.
    3. Wei Gao & Sam Emaminejad & Hnin Yin Yin Nyein & Samyuktha Challa & Kevin Chen & Austin Peck & Hossain M. Fahad & Hiroki Ota & Hiroshi Shiraki & Daisuke Kiriya & Der-Hsien Lien & George A. Brooks & Ron, 2016. "Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis," Nature, Nature, vol. 529(7587), pages 509-514, January.
    4. Xinge Yu & Zhaoqian Xie & Yang Yu & Jungyup Lee & Abraham Vazquez-Guardado & Haiwen Luan & Jasper Ruban & Xin Ning & Aadeel Akhtar & Dengfeng Li & Bowen Ji & Yiming Liu & Rujie Sun & Jingyue Cao & Qin, 2019. "Skin-integrated wireless haptic interfaces for virtual and augmented reality," Nature, Nature, vol. 575(7783), pages 473-479, November.
    5. Jin Ge & Xu Wang & Michael Drack & Oleksii Volkov & Mo Liang & Gilbert Santiago Cañón Bermúdez & Rico Illing & Changan Wang & Shengqiang Zhou & Jürgen Fassbender & Martin Kaltenbrunner & Denys Makarov, 2019. "A bimodal soft electronic skin for tactile and touchless interaction in real time," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    6. Minglu Zhu & Zhongda Sun & Tao Chen & Chengkuo Lee, 2021. "Low cost exoskeleton manipulator using bidirectional triboelectric sensors enhanced multiple degree of freedom sensory system," Nature Communications, Nature, vol. 12(1), pages 1-16, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jinrong Wang & Weibin Lin & Zhuo Chen & Valeriia O. Nikolaeva & Lukman O. Alimi & Niveen M. Khashab, 2024. "Smart touchless human–machine interaction based on crystalline porous cages," Nature Communications, Nature, vol. 15(1), pages 1-12, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dongjin Kim & Baekgyeom Kim & Bongsu Shin & Dongwook Shin & Chang-Kun Lee & Jae-Seung Chung & Juwon Seo & Yun-Tae Kim & Geeyoung Sung & Wontaek Seo & Sunil Kim & Sunghoon Hong & Sungwoo Hwang & Seungy, 2022. "Actuating compact wearable augmented reality devices by multifunctional artificial muscle," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    2. Shuo Li & Yong Zhang & Xiaoping Liang & Haomin Wang & Haojie Lu & Mengjia Zhu & Huimin Wang & Mingchao Zhang & Xinping Qiu & Yafeng Song & Yingying Zhang, 2022. "Humidity-sensitive chemoelectric flexible sensors based on metal-air redox reaction for health management," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    3. Zhongda Sun & Minglu Zhu & Xuechuan Shan & Chengkuo Lee, 2022. "Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    4. Matthew S. Brown & Louis Somma & Melissa Mendoza & Yeonsik Noh & Gretchen J. Mahler & Ahyeon Koh, 2022. "Upcycling Compact Discs for Flexible and Stretchable Bioelectronic Applications," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    5. Shuxing Mei & Haokun Yi & Jun Zhao & Yanting Xu & Lan Shi & Yajie Qin & Yizhou Jiang & Jiajie Guo & Zhuo Li & Limin Wu, 2024. "High-density, highly sensitive sensor array of spiky carbon nanospheres for strain field mapping," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    6. Shaomei Lin & Weifeng Yang & Xubin Zhu & Yubin Lan & Kerui Li & Qinghong Zhang & Yaogang Li & Chengyi Hou & Hongzhi Wang, 2024. "Triboelectric micro-flexure-sensitive fiber electronics," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    7. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    8. Bekir Aksoy & Yufei Hao & Giulio Grasso & Krishna Manaswi Digumarti & Vito Cacucciolo & Herbert Shea, 2022. "Shielded soft force sensors," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    9. Won Bae Han & Gwan-Jin Ko & Kang-Gon Lee & Donghak Kim & Joong Hoon Lee & Seung Min Yang & Dong-Je Kim & Jeong-Woong Shin & Tae-Min Jang & Sungkeun Han & Honglei Zhou & Heeseok Kang & Jun Hyeon Lim & , 2023. "Ultra-stretchable and biodegradable elastomers for soft, transient electronics," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    10. Sangha Kim & Seongjin Park & Jina Choi & Wonseop Hwang & Sunho Kim & In-Suk Choi & Hyunjung Yi & Rhokyun Kwak, 2022. "An epifluidic electronic patch with spiking sweat clearance for event-driven perspiration monitoring," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    11. Pengwei Wang & Xiaohao Ma & Zhiqiang Lin & Fan Chen & Zijian Chen & Hong Hu & Hailong Xu & Xinyi Zhang & Yuqing Shi & Qiyao Huang & Yuanjing Lin & Zijian Zheng, 2024. "Well-defined in-textile photolithography towards permeable textile electronics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    12. Xi Tian & Qihang Zeng & Selman A. Kurt & Renee R. Li & Dat T. Nguyen & Ze Xiong & Zhipeng Li & Xin Yang & Xiao Xiao & Changsheng Wu & Benjamin C. K. Tee & Denys Nikolayev & Christopher J. Charles & Jo, 2023. "Implant-to-implant wireless networking with metamaterial textiles," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    13. Itsuki Kageyama & Karin Kurata & Shuto Miyashita & Yeongjoo Lim & Shintaro Sengoku & Kota Kodama, 2022. "A Bibliometric Analysis of Wearable Device Research Trends 2001–2022—A Study on the Reversal of Number of Publications and Research Trends in China and the USA," IJERPH, MDPI, vol. 19(24), pages 1-19, December.
    14. Guorui Li & Tuck-Whye Wong & Benjamin Shih & Chunyu Guo & Luwen Wang & Jiaqi Liu & Tao Wang & Xiaobo Liu & Jiayao Yan & Baosheng Wu & Fajun Yu & Yunsai Chen & Yiming Liang & Yaoting Xue & Chengjun Wan, 2023. "Bioinspired soft robots for deep-sea exploration," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    15. Taemin Kim & Yejee Shin & Kyowon Kang & Kiho Kim & Gwanho Kim & Yunsu Byeon & Hwayeon Kim & Yuyan Gao & Jeong Ryong Lee & Geonhui Son & Taeseong Kim & Yohan Jun & Jihyun Kim & Jinyoung Lee & Seyun Um , 2022. "Ultrathin crystalline-silicon-based strain gauges with deep learning algorithms for silent speech interfaces," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    16. Guanhua Long & Wanlin Jin & Fan Xia & Yuru Wang & Tianshun Bai & Xingxing Chen & Xuelei Liang & Lian-Mao Peng & Youfan Hu, 2022. "Carbon nanotube-based flexible high-speed circuits with sub-nanosecond stage delays," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    17. Wenbo Liu & Youning Duo & Jiaqi Liu & Feiyang Yuan & Lei Li & Luchen Li & Gang Wang & Bohan Chen & Siqi Wang & Hui Yang & Yuchen Liu & Yanru Mo & Yun Wang & Bin Fang & Fuchun Sun & Xilun Ding & Chi Zh, 2022. "Touchless interactive teaching of soft robots through flexible bimodal sensory interfaces," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    18. Bangfeng Wang & Yiwei Li & Mengfan Zhou & Yulong Han & Mingyu Zhang & Zhaolong Gao & Zetai Liu & Peng Chen & Wei Du & Xingcai Zhang & Xiaojun Feng & Bi-Feng Liu, 2023. "Smartphone-based platforms implementing microfluidic detection with image-based artificial intelligence," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    19. Yuan Zhang & Junlong Yang & Xingyu Hou & Gang Li & Liu Wang & Ningning Bai & Minkun Cai & Lingyu Zhao & Yan Wang & Jianming Zhang & Ke Chen & Xiang Wu & Canhui Yang & Yuan Dai & Zhengyou Zhang & Chuan, 2022. "Highly stable flexible pressure sensors with a quasi-homogeneous composition and interlinked interfaces," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    20. Shuzhi Liu & Jianmin Zeng & Zhixin Wu & Han Hu & Ao Xu & Xiaohe Huang & Weilin Chen & Qilai Chen & Zhe Yu & Yinyu Zhao & Rong Wang & Tingting Han & Chao Li & Pingqi Gao & Hyunwoo Kim & Seung Jae Baik , 2023. "An ultrasmall organic synapse for neuromorphic computing," Nature Communications, Nature, vol. 14(1), pages 1-10, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-29197-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.