Lorenzo Masia

Haptics in Bimanual Manipulation

In virtual reality based rehabilitation, bimanual exercises can be performed by exploiting haptic rendering techniques that allow object manipulation with two haptic devices. Haptic interaction generally involves spherical end-effectors with invariant shapes. During object manipulation in VR, this impacts the ability to determine the real position of the end effector after the collision between it and the haptic interface point.

 Humans synergically exploit both visual and haptic information when performing manipulation tasks. The mechanisms behind visuo-haptic integration have been a topic of great debate for more than a century. Early studies on sensory influence stated that vision was the dominant sense. However, it is now commonly accepted that the two sensory channels are weighted based on their reliability and appropriateness. When spatial interaction tasks are concerned, the visuo-haptic coupling is characterized by strong visual dominance; the sense of touch is favoured in tasks that require the perception of texture and material properties. Accordingly, it is argued that visual cues afford more efficient bimanual handling in VR. 

The present study sought to examine whether additional visual information regarding the penetration of the wrists into the virtual object (i.e., the color and shape of the spheres changed according to the level of force exerted by the subject) leads to improved bimanual task performance in a virtual environment. To this end, six neurologically healthy participants performed an object manipulation task with haptic feedback (haptic condition) and with haptic feedback as well as additional visual cues (haptic+visual condition).

Fig. 1. (a) Wrist robots used in the study; (b) Mapping between virtual environment (VR) and wrist movements. The virtual environment consisted of two spheres, a cardboard carton representing the object to be manipulated (with a superimposed countdown timer), and a semitransparent carton representing the to-be-reached target. The horizontal displacement of the sphere is controlled by wrist flexion/extension (FE), while the vertical displacement is controlled by wrist adduction/abduction  AA); (c) Target positions shown during the experiment. Each position was randomly presented, for a total of 10 repetitions per condition; (d,e) Visual feedback used for the two conditions: (d) when haptic cues were provided the shape of the spheres did not change if a collision occurred, (e)while in the haptic+visual condition the shape and colour of the spheres deformed according to the haptic interface point (HIP) into the virtual object



Results demonstrated that interlimb coordination was enhanced during the haptic+visual condition. It is speculated that the presence of visual information provides a more natural way for individuals to exploit inter-limb coordination synergies, and may have useful implications for VR game development and post-stroke rehabilitation protocols.



1    Sara Contu, Charmayne Hughes, Lorenzo Masia. Influence of Visual Information on Bimanual Haptic Manipulation. IEEE International Conference on Robotic Rehabilitation 2015, 11-14 August 2015, Singapore
2    Francesca Marini, Valentina Squeri, Assunta Riva, Leonardo Cappello, Luca Doglio, Pietro Giovanni Morasso, Lorenzo Masia  Adaptive Wrist Robot Training in Pediatric Rehabilitation IEEE International Conference on Robotic Rehabilitation 2015, 11-14 August 2015, Singapore
3    Leonardo Cappello, Sara Contu, Juergen Konczak and Lorenzo Masia. Wrist proprioceptive acuity: a comprehensive robot-aided assessment 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2015)
4    Sara Contu, Leonardo Cappello, Juergen Konczak and Lorenzo Masia. Preliminary analysis of non-dominant proprioceptive acuity and interlimb asymmetry in the human wrist 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2015)
5    S. El-Khoury, I. Batzianoulis, C. W. Antuvan, S. Contu, L. Masia, S. Micera and A. Billard. 'EMG-based learning approach for estimating wrist motion'. 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2015)




IEEE BIOROB 2016 (clickhere)



  • L. Masia, Nanyang Tech. University
  • S. Kukreja, National University of Singapore



New Journal on Rehabilitation Technology

Journal of Rehabilitation and Assistive Technologies Engineering (click here)

Lorenzo MASIA (Associate Editor)



Journal Topics

Research Topic (click here)





International Conference on Rehabilitation Robotics

Singapore 11th-14th August 2015 Hosted by NTU

General Chair: Wei Tech ANG

Program Chair: Lorenzo MASIA



Lorenzo MASIA Editor of Biorob 2014



Hot the NEW WrisBot




visit the robot report website for a comprehensive view of robotic business worldwide and other great info!