IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-33021-5.html
   My bibliography  Save this article

Topographic design in wearable MXene sensors with in-sensor machine learning for full-body avatar reconstruction

Author

Listed:
  • Haitao Yang

    (National University of Singapore)

  • Jiali Li

    (National University of Singapore)

  • Xiao Xiao

    (Southern University of Science and Technology)

  • Jiahao Wang

    (National University of Singapore)

  • Yufei Li

    (National University of Singapore)

  • Kerui Li

    (National University of Singapore)

  • Zhipeng Li

    (National University of Singapore)

  • Haochen Yang

    (University of Maryland)

  • Qian Wang

    (National University of Singapore)

  • Jie Yang

    (National University of Singapore)

  • John S. Ho

    (National University of Singapore)

  • Po-Len Yeh

    (Realtek)

  • Koen Mouthaan

    (National University of Singapore)

  • Xiaonan Wang

    (Tsinghua University)

  • Sahil Shah

    (University of Maryland)

  • Po-Yen Chen

    (University of Maryland
    Maryland Robotics Center)

Abstract

Wearable strain sensors that detect joint/muscle strain changes become prevalent at human–machine interfaces for full-body motion monitoring. However, most wearable devices cannot offer customizable opportunities to match the sensor characteristics with specific deformation ranges of joints/muscles, resulting in suboptimal performance. Adequate wearable strain sensor design is highly required to achieve user-designated working windows without sacrificing high sensitivity, accompanied with real-time data processing. Herein, wearable Ti3C2Tx MXene sensor modules are fabricated with in-sensor machine learning (ML) models, either functioning via wireless streaming or edge computing, for full-body motion classifications and avatar reconstruction. Through topographic design on piezoresistive nanolayers, the wearable strain sensor modules exhibited ultrahigh sensitivities within the working windows that meet all joint deformation ranges. By integrating the wearable sensors with a ML chip, an edge sensor module is fabricated, enabling in-sensor reconstruction of high-precision avatar animations that mimic continuous full-body motions with an average avatar determination error of 3.5 cm, without additional computing devices.

Suggested Citation

  • Haitao Yang & Jiali Li & Xiao Xiao & Jiahao Wang & Yufei Li & Kerui Li & Zhipeng Li & Haochen Yang & Qian Wang & Jie Yang & John S. Ho & Po-Len Yeh & Koen Mouthaan & Xiaonan Wang & Sahil Shah & Po-Yen, 2022. "Topographic design in wearable MXene sensors with in-sensor machine learning for full-body avatar reconstruction," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33021-5
    DOI: 10.1038/s41467-022-33021-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-33021-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-33021-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Daeshik Kang & Peter V. Pikhitsa & Yong Whan Choi & Chanseok Lee & Sung Soo Shin & Linfeng Piao & Byeonghak Park & Kahp-Yang Suh & Tae-il Kim & Mansoo Choi, 2014. "Ultrasensitive mechanical crack-based sensor inspired by the spider sensory system," Nature, Nature, vol. 516(7530), pages 222-226, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hailong Yu & Zhenqing Hu & Juan He & Yijun Ran & Yang Zhao & Zhi Yu & Kaiping Tai, 2024. "Flexible temperature-pressure dual sensor based on 3D spiral thermoelectric Bi2Te3 films," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    2. Haitao Yang & Shuo Ding & Jiahao Wang & Shuo Sun & Ruphan Swaminathan & Serene Wen Ling Ng & Xinglong Pan & Ghim Wei Ho, 2024. "Computational design of ultra-robust strain sensors for soft robot perception and autonomy," Nature Communications, Nature, vol. 15(1), pages 1-15, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shuxing Mei & Haokun Yi & Jun Zhao & Yanting Xu & Lan Shi & Yajie Qin & Yizhou Jiang & Jiajie Guo & Zhuo Li & Limin Wu, 2024. "High-density, highly sensitive sensor array of spiky carbon nanospheres for strain field mapping," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Shaomei Lin & Weifeng Yang & Xubin Zhu & Yubin Lan & Kerui Li & Qinghong Zhang & Yaogang Li & Chengyi Hou & Hongzhi Wang, 2024. "Triboelectric micro-flexure-sensitive fiber electronics," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    3. Quanxia Lyu & Shu Gong & Jarmon G. Lees & Jialiang Yin & Lim Wei Yap & Anne M. Kong & Qianqian Shi & Runfang Fu & Qiang Zhu & Ash Dyer & Jennifer M. Dyson & Shiang Y. Lim & Wenlong Cheng, 2022. "A soft and ultrasensitive force sensing diaphragm for probing cardiac organoids instantaneously and wirelessly," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    4. Chong Li & Xinxin Liao & Zhi-Ke Peng & Guang Meng & Qingbo He, 2023. "Highly sensitive and broadband meta-mechanoreceptor via mechanical frequency-division multiplexing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    5. Yar, Adem & Karabiber, Abdulkerim & Ozen, Abdurrahman & Ozel, Faruk & Coskun, Sahin, 2020. "Flexible nanofiber based triboelectric nanogenerators with high power conversion," Renewable Energy, Elsevier, vol. 162(C), pages 1428-1437.
    6. Xinlei Shi & Xiangqian Fan & Yinbo Zhu & Yang Liu & Peiqi Wu & Renhui Jiang & Bao Wu & Heng-An Wu & He Zheng & Jianbo Wang & Xinyi Ji & Yongsheng Chen & Jiajie Liang, 2022. "Pushing detectability and sensitivity for subtle force to new limits with shrinkable nanochannel structured aerogel," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    7. Kyowon Kang & Seongryeol Ye & Chanho Jeong & Jinmo Jeong & Yeong-sinn Ye & Jin-Young Jeong & Yu-Jin Kim & Selin Lim & Tae Hee Kim & Kyung Yeun Kim & Jong Uk Kim & Gwan In Kim & Do Hoon Chun & Kiho Kim, 2024. "Bionic artificial skin with a fully implantable wireless tactile sensory system for wound healing and restoring skin tactile function," Nature Communications, Nature, vol. 15(1), pages 1-15, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33021-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.