A key challenge in haptics is designing human-human communications involving touch to facilitate positive effects on social interactions. An important consideration in designing social touch is understanding the effect of social stimuli on perception, in addition to that of a physical stimulus, because social touch always involves a partner. This study presents an experiment to demonstrate that facial expressions induce haptic perception. We developed a human–agent interaction system on a display in which participants moved the mouse cursor to click the target icon while the agent behaved as if it pulled the cursor back in the opposite direction, showing either a negative or neutral face. The perceived force during the interaction was quantified by the control display ratio using a psychophysical approach. The results show that the negative face induced a significantly greater perceived force than the neutral face. In addition, the perceived force correlated with the individual’s evaluation of the facial expression; that is, the more unpleasant or aroused they perceived the facial expression to be, the more force they perceived. This study sheds light on the design of social touch performed by people who have physical or mediated contact with each other in physical space or cyberspace. (IEEE Transactions on Haptics 2023)

Five Selected Papers

  1. Nana Matsuyama, Soichiro Matsuda, Taku Hachisu:
    Can Facial Expressions Induce Haptic Perception?
    IEEE Transactions on Haptics, vol. 16, no. 4, pp. 634-639, 2023.
  2. 松山菜々,松田壮一郎,蜂須拓:
    エージェントの表情変化により生起する力覚の評価,
    日本バーチャルリアリティ学会論文誌,vol. 27,no. 4,pp. 283-290,2022.
  3. 松山菜々,松田壮一郎,蜂須拓:
    エージェントの表情により生起する触覚の評価のための表情設計に関する基礎検討,
    日本機械学会ロボティクス・メカトロニクス講演会2023,XXX,愛知,2023/6/28-7/1.
  4. 松山菜々,松田壮一郎,蜂須拓:
    エージェントの表情により生起する力覚評価のための運動計測システムの予備検討,
    第27回日本バーチャルリアリティ学会大会論文集,1C2-5,北海道,2022/9/12-14.
  5. 松山菜々,蜂須拓:
    エージェントの表情操作による疑似力覚提示手法の検討,
    日本バーチャルリアリティ学会ハプティクス研究会第27回研究会,pp. 7-10,オンライン開催,2021/11/29-30.

Demonstration

Click here.

Video

  • IEEE World Haptics Conference 2023 / IEEE Transactions on Haptics