Natural Interaction Design for Navigation in Virtual Environment of Sino-Portuguese Architecture in Museum

Kosin  KALARAT; Sasithorn  RATTANARUNGROT

doi:10.48048/wjst.2021.6493

Authors

Kosin KALARAT Division of Multimedia Technology and Animation, School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand
Sasithorn RATTANARUNGROT Division of Multimedia Technology and Animation, School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand

DOI:

https://doi.org/10.48048/wjst.2021.6493

Keywords:

Virtual Reality, Virtual Environment, Virtual Museum, Natural Interaction, Culture Heritage

Abstract

Virtual Environment (VE) is an artificial environment created for providing the information in Virtual Reality (VR). The audiences are able to obtain the information via interaction to the environment. Virtual Reality for Culture heritage buildings, which are inherited from past generations and maintained in the present, is an interested topic because its contents often built for giving the information and knowledge about the past to the new generation in virtual museums. However, there is a limitation of Virtual Reality (VR) applications in reproducing cultural sites as most of these applications are not successful in catching public’s attention and involvement. In this research, we focus on using Natural Interaction (NI) interfaces based on a body movement in Virtual Reality for museums to grab attention from audience and to increase public’s involvement. This paper presents the development of Natural Interaction using Microsoft Kinect to define the new grammar of gesture for Sino Portuguese Architecture which is a cultural heritage of Thailand. Results of early tests improved the prototype in progress which alllows more complexity in natural interchanges and connection between users and virtual world. The final result was evaluated after the system was installed in Peranakannitat museum and by interviewing 6 docents. It was found that our system was easy to use as it took only about 3 - 5 min to familiarize the system for navigation in the virtual environment without recognizing the grammar of gesture commands.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References

Official Fine Art Department. The Explore of Phuket History, 1987.

P Tepsing and W Watanasin. 2004, Decorative ornament on facade of Sino-Portuguese building in Phuket province from Department of Educational Foundation. Master Thesis, Faculty of Liberal Art, Prince of Songkla University, Thailand.

E Pietroni, A Pagano and C Rufa. The etruscanning project: Gesture-based interaction and user experience in the virtual reconstruction of the regolini-galassi tomb. In: Proceedings of the IEEE Digital Heritage International Congress. 2013, p. 653-60.

J Zara. Virtual Reality and Cultural Heritage on the Web. In: Proceedings of the 7th International Conference on Computer Graphics and Artificial Intelligence. 2004, p. 101-12.

P Aiello, F D'Elia, SD Tore and M Sibilio. A constructivist approach to virtual reality for experiential learning. E-Learn. Digit. Media 2012; 9, 317-24.

L Baraldi, F Paci, G Serra, L Benini and R Cucchiara. Gesture recognition using wearable vision sensors to enhance visitors’ museum experiences. IEEE Sens. J. 2015; 15, 2705-14.

T Alisi, A Del Bimbo and A Valli. Natural interfaces to enhance visitors’ experiences. In: Proceedings of the IEEE Multimedia. 2005, p. 80-5.

ML Rayan. Narrative as Virtual Reality: Immersion and interactivity in literature and electronic media for Baltimore and London. Hopkins University Press, HB, 2001, p. 259-62.

E Pietroni, C Ray, C Rufa, D Pletinckx and I Van Kampen. Natural interaction in VR environments for cultural heritage and its impact inside museums: The etruscanning project. In: Proceedings of the IEEE 18th International Conference on Virtual Systems and Multimedia. 2012, p. 339-46.

M Carrozzino and M Bergamasco. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cult. Herit. 2010; 11, 452-8.

B Leibe, T Starner, W Ribarsky, Z Wartell, D Krum, B Singletary and L Hodges. The perceptive workbench: Toward spontaneous and natural interaction in semi-immersive virtual environments. In: Proceedings of IEEE Virtual Reality 2000. 2000, p. 13-20.

G Castellano, R Bresin, A Camurri and G Volpe. Expressive control of music and visual media by full-body movement. In: Proceedings of the Conference on New Interfaces for Musical Expression 2007. 2007, p. 390-1.

L Rodrigues da Silva, LS Garcia and L Silva. Gesture vocabulary for natural interaction with virtual museums. In: Proceedings of the 16th International Conference on Enterprise Information Systems. 2014, p. 5-13.

G Castellano, SD Villalba and A Camurri. Recognizing human emotions from body movement and gesture dynamics. In: Proceedings of the 2nd International Conference on Affective Computing and Intelligent Interaction. Lisbon, 2007.

E Pietroni. Natural interaction in VR environments for Cultural Heritage: The virtual reconstruction of the Regolini Galassi Tomb in Cerveteri. Archeol. Calc. 2013; 24, 231-47.