Using a Natural User Interface to Enhance the Ability to Interact with Reconstructed Virtual Heritage Environments

Silviu Butnariu, Alexandru Georgescu, Florin Gîrbacia

Abstract


Virtual Reality (VR) techniques are used to create computer-simulated environments which enable new forms of cultural entertainment. One critical problem is how to design the 3D virtual environments (VE) and what methods should be used for interaction, in order to offer an entertaining experience in an open approach.  This paper focuses on the added value of gaming methods for 3D reconstruction and interaction with 3D representations of cultural heritage assets using a NUI designed for games. The impact of game mechanics and interaction was investigated by developing a VE of a medieval burg (Brasov, Transylvania). The VE development involves high quality 3D reconstruction of the burg, creating a collection of gestures to interact with the VE, and their implementation and testing within the VE. The paper also includes a qualitative and quantitative evaluation of the implemented system, as tested by subjects who carried out a navigation session in the VE.


Full Text:

PDF

References


Champion E. (2008). Otherness of Place: Game-based Interaction and Learning in Virtual Heritage Projects. International Journal of Heritage Studies, 14, 210 – 228.

Noh Z. ; Shahrizal Sunar M. ; Pan Z. (2009). A Review on Augmented Reality for Virtual Heritage System, Learning by Playing. Game-based Education System Design and Development, Lecture Notes in Computer Science, 5670, 50-61

Pescarin S. (2012). Ancient Landscape Reconstruction, in 1st Digital Cultural Heritage Workshop, The Cyprus Institute, Nicosia, Cyprus.

Rua H.; Alvito P. (2011). Living the Past: 3D Models, Virtual Reality and Game Engines as Tools for Supporting Archaeology and the Reconstruction of Cultural Heritage – the Case-Study of the Roman Villa of Casal De Freiria, Journal of Archaeological Science, 38, 3296-3308.

Beraldin J.-A.; Picard M.; El-Hakim S.; Godin G., Borgeat L., et al. (2005). Virtual Reconstruction of Heritage Sites: Opportunities and Challenges Created by 3d Technologies, in The International Workshop on Recording, Modeling and Visualization of Cultural Heritage, Ascona, Switzerland.

Mansor I.; Puteri S.J.; Maisarah A.; Nurul S. A. L.; Nor Zalifa Z. A. (2007). Virtual Reality in Heritage Studies and Historical Reconstruction through Animation – a Case Study of a 16th Century University Complex in the Ottoman World, in 7th International Conference on Construction Applications of Virtual Reality, Penn State University, USA.

Popovici D. M.; Querrec R.; Bogdan C. M.; Popovici N. (2010). A Behavioral Perspective of Virtual Heritage Reconstruction, Int. J. of Computers, Communications & Control, V, 8.

de Heras Ciechomski P.; Ulicny B.; Cetre R.; Thalmann D. (2004). A Case Study of a Virtual Audience in a Reconstruction of an Ancient Roman Odeon in Aphrodisias, in VAST-04The 5th International Symposium on Virtual Reality, Archaeology and Cultural Heritage,.

3D Virtual World Second Life (accesed on 13 November 2013). Available online: http://secondlife.com/

Anderson E. F.; McLoughlin L.; Liarokapis F.; Peters C.; Petridis P. et al. (2010). Developing Serious Games for Cultural Heritage: A State-of-the-Art Review, Virtual Reality, 14, 255-275.

de Chiara R. (2006). Real Positioning in Virtual Environments Using Game Engines, in Eurographics Italian Chapter Conference ed. by R. De Amicis and G. Conti, The Eurographics Association, p. 6.

Gabellone F. (2009). Ancient Contexts and Virtual Reality: From Reconstructive Study to the Construction of Knowledge Models, Journal of Cultural Heritage, 10, e112-e117.

Bianco G.; Gallo A.; Bruno F.; Muzzupappa M. (2013). A Comparative Analysis between Active and Passive Techniques for Underwater 3D Reconstruction of Close-Range Objects, Sensors, 13, 11007-11031.

Lanitis A.; Stylianou G. (2009). e-Restoration of Faces Appearing In Cultural Heritage Artefacts, in Proceedings of 15th International Conference on Virtual Systems and Multimedia, VSMM '09, Vienna, 15-20.

Zhang X.; Blaas J.; Botha C.; Reischig P.; Bravin A., et al. (2012). Process for the 3d Virtual Reconstruction of a Microcultural Heritage Artifact Obtained by Synchrotron Radiation CT Technology Using Open Source and Free Software, Journal of Cultural Heritage, 13, 5.

Yilmaz, H. M.; Yakar M.; Yildiz F. (2008). Documentation of historical caravansaries by digital close range photogrammetry. Automation in Construction, 17(4), 489-498.

Núñez Andrés, A.; Buill Pozuelo, F.; Regot Marimón, J.; de Mesa Gisbert. (2012). A. Generation of virtual models of cultural heritage. Journal of Cultural Heritage, 13(1), 103-106.

de Mesa A.; Regot J.; Núñez M. A.; Buill F. (2009). Métodos y procesos para el levantamiento de reconstrucción tridimensional gráfica de elementos del patrimonio cultural. La iglesia de Sant Sever de Barcelona, Revista EGA, 14,82-89.

Styliadis A. D. (2007). CAAD for Demolished Buildings Modeling with Reverse Engineering Functionality, Cadastre Journal RevCAD, 7, 41-74.

Carrozzino M.; Evangelista C.; Brondi R.; Lorenzini C.; Bergamasco M. (2012) Social Networks and Web-Based Serious Games as Novel Educational Tools. Procedia Computer Science, 15, 303-306.

Chevrier C.; Charbonneau N.; Grussenmeyer P.; Perrin J-P. (2010). Parametric Documenting of Built Heritage: 3D Virtual Reconstruction of Arhitectural Details. International Journal of Arhitectural Computing, 8 (2), 131-147.

Ulicny B.; Thalmann D. (2002). Crowd Simulation for Virtual Heritage, Proceedings of First International Workshop on 3D Virtual Heritage, 28-32.

Johnston D. (2004). 3D Games Engines as a New Reality, in 4th Annual CM316 , Conference on Multimedia Systems http://mms.ecs.soton.ac.uk/ mms2004/abstracts.php , Southampton University, UK, p. 8.

Tyberghein J.; Sunshine E.; Richter F.; Gist M.; van Brussel C. (2010). Developing Video Games and Virtual Environments with the Crystal Space Engine, (www.crystalspace3d.org)

Brasov map, accessed on 24 October 2013 from http://art-historia.blogspot.ro/2009/04/afisele-art-historia.html

Oltean V.; Radu M.; Marin E.; Nussbächer G.Brașov (2004). Brașov Monografie Comercialã, Camera de Comerț și Industrie Brașov, ISBN: 973-0-03514-8, Brașov, 40-52.

Oltean V. (2010). Configurația Istorică și Bisericească a Brașovului, (Sec. XIII – XX), Ed. Andreiana, ISBN 978-606-8106-19-9, Sibiu, 14-88.

Georgescu A. C.; (2013). Navigarea și interacționarea prin gesturi în oraşe medievale reconstruite virtual, Master Dissertation thesis at Universitatea Transilvania Brașov, Brașov, 1-82.

(1)http://www.googleartproject.com/museums/ altesnational; (2) http://www.viagensimagens.com/; (3) http://www.google.com/earth/index.html; (4) http://www.learn.columbia.edu/ha/html/medieval.html; (5) http://www.panoramicearth.com/; (6) http://www.secretsofparis.com/heathers-secret- blog/virtual-tour-of-medieval-paris.html; (7) http://www.youtube.com/watch?v= _DeqEnsme 7c&feature=html5_3d; (8) http://www.youtube.com/ watch?v=5U5mSluzZzc; (9) http://www.esri.com/ software/cityengine/ , http://www.procedural.com/ cityengine/ (10) http://www.youtube.com/ watch?v=z-qT5ye9O6Q, http://claudiomarr. blogspot.ro/; (11) http://www.youtube.com /watch?v=sLCQgmWkgI0; (12) https://www. ubisoft.com/en-US/game/assassins-creed/; (13) http://assassinscreed.ubi.com/en-us/games/assassins-creed-2.aspx; (14) http://assassinscreed.ubi.com /en-us/games/assassins-creed-brotherhood.aspx; (15) http://assassinscreed.ubi. com/en-us/games/assassins-creed-revelations.aspx; (16) https:// www.taleworlds.com; (17) http:// www.tornbanner.com/chivalry/esrb/; (18) http:// www.fatsharkgames.com/portfolio_page/war-of-the-roses/; (19) http://www.creative-assembly.com/ game/arena; (20) http://triumphantgoat. blogspot.co.uk/ [or https://www.cryengine.com/ community/viewtopic.php?f=328&t=109027 ]




Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.