Tangible images and video

We add haptic interaction modality to visual rendering and common video communication across the internet. Haptic forces are either retrieved from images or video or efficiently exchanged as asynchronous data streams across the internet. We research how to do it in the most efficient way and without modifications of the existing video communication applications. We devise methods supporting haptic interactions done with common desktop haptic devices, video cameras as well as with Microsoft Kinect, Leap Motion controller and wearable devices. We are working on applying the proposed methods to medical simulations and electronic shopping applications.

YouTube videos:

Image-based virtual arthroscopy

Tangible photo

Tangible poster

Tangible image

References

 

The paper files can be downloaded from ResearchGate. I will be also happy to email you the paper files by request.

Journals

  1. Zhang X., Goezele M., Sourin A., Tangible Images of Real Life Scenes, Computers & Graphics, Elsevier, v.64: 62-73, 2017  DOI: 10.1016/j.cag.2017.02.004          
  2. Rasool S., Hou X., Liu Y., Sourin A, Sourina O. Neurocognitive Tools for Assessing Haptic Interaction with Tangible Images, International Journal of Psychophysiology, Elsevier, v. 108, p.147, 2016. DOI: 10.1016/j.ijpsycho.2016.07.427
  3. Rasool S., Sourin A. Real-time haptic interaction with RGBD video streams. The Visual Computer, Springer, 2016, DOI 10.1007/s00371-016-1224-1
  4. Zhang X, Sourin A. Image-inspired Haptic Interaction, Journal of Computer Animation and Virtual Worlds, Wiley, 26:311–319, May, DOI: 10.1002/cav.1643, 2015.
  5. Rasool S., Sourin A. Image-driven Haptic Rendering, Transactions on Computational Science XXIII, Journal Subline LNCS 8490, 58-77, 2014.                                 
  6. Yasmin S., Sourin A. Image-Based Virtual Palpation, Transactions on Computational Science, Journal Subline LNCS, vol. 7848, 61-80, 2013
  7. Rasool S., Sourin A. Image-driven virtual simulation of arthroscopy, The Visual Computer, Springer, 29(5): 333-355, 2013.

Conferences

  1. Zhang X., Ningshuang C., Sourin A., Adding a Sense of Touch to Online Shopping: Does it Really Help? Computer Graphics International 2017, CGI 2017, 27-30 June 2017, Yokohama, ACM
  2. Rasool S., Hou X, Liu Y, Sourin A, Sourina O. Assessing Haptic Video Interaction with Neurocognitive Tools, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC2016), Budapest, 3057-3062, 2016.
  3. Zhang X., Goesele M., and Sourin A., Haptic Interaction with a Polygon Mesh Reconstructed from Images. In. Proc. 2016 Int Conf on Cyberworlds, Chongqing, China, 28-30 Sept., 2016, 49-56.
  4. Rasool S., Sourin A. Haptic Interaction with Video Streams Containing Depth Data, In Proc 2015 Int Conf on Cyberworlds, 173-180, 2015. 
  5. Chen K., Zhang X., Rasool S., Johan H., and Sourin A. Multisensory Experience with Images. In Proc 2014 Int Conf on Cyberworlds, 389-392, 2014
  6. Rasool S., Sourin A, Pestrikov V., Kagda F. Virtual Knee Arthroscopy using Haptic Devices and Real Surgical Images, 16th International Conference on Human-Computer Interaction (HCI 2014), LNCS 8529 “Digital Human Modeling and applications in Health, Safety, Ergonomics and Risk Management”, Springer, pp.436-447, 2014.
  7. Rasool S., Sourin A., Pestrikov V., Kagda F. Modeling Arthroscopic Camera with Haptic Devices in Image-based Virtual Environments, In Proc 2014 IEEE Haptics Symposium (Haptics 2014), 24-26 February, pp. 403-408, 2014.
  8. Rasool S., Sourin A., Xia P., Weng B., Kagda F., Towards Hand-Eye Coordination Training in Virtual Knee Arthroscopy, In Proc 19th ACM Symposium on Virtual Reality Software and Technology (VRST2013), ACM SIGGRAPH, Singapore, 6-9 October, 2013, pp.17-26.
  9. Pestrikov V., Sourin A., Towards Making Panoramic Images in Virtual Arthroscopy, In Proc 2013 Int Conf on Cyberworlds, IEEE Computer Society, Japan, 21-23 October, 2013, pp. 48-51.
  10. Rasool S., Sourin A., Image-driven Haptic Rendering in Virtual Environments, In Proc 2013 Int Conf on Cyberworlds, IEEE Computer Society, Japan, 21-23 October, 2013, pp. 286-293.
  11. Rasool S, Sourin A, Kagda F, Image-driven Haptic Simulation of Arthroscopic Surgery, MMVR 2013, pp.337-343.
  12. Rasool S, Sourin A, Image-driven Haptic Interaction, In Proc. Asia-Oceania Top University League in Engineering conference (AOTULE 2012), Malaysia, Kuala-Lumpur, 24-25 November 2012.
  13. Rasool S, Sourin A. Tangible Arthroscopic Images, Computer Graphics International (CGI 2012), Bournemouth, UK, 2012, ISBN 978-1-85899-283-9.
  14. Rasool S, Sourin A. Tangible Images. ACM SIGGRAPH Asia 2011, Technical Sketch, ACM, December 2011.                                                                                           
  15. Rasool S, Sourin A. Haptic Interaction with 2D Images. In Proc ACM VRCAI 2011, December 2011, ACM, pp.13-22
  16. Rasool S, Sourin A. Towards Tangible Images and Video in Cyberworlds – Function-based Approach. In Proc 2010 Int conf on Cyberworlds, IEEE, pp. 92-96, 2010