The IbnSina Center: An augmented reality theater with intelligent robotic and virtual characters

Abstract

Although numerous early attempts towards the use of robotics in conjunction with virtual characters in order to create augmented reality theater and interactive performances have taken place, the state of the art is still in an initial stage on the pathway towards the full exploitation of the technological as well as creative and artistic potentialities that exist. Here we will present the IbnSina Center, a novel augmented reality interactive theatre installation, named after the famous polymath of the 10th century, known as Avicenna in the West. The installation consists of a ten-meter stage, multiple stage sensors, a screen, a pseudo-3D holograph transparency, and a seating area for the audience. The stage is populated by a custom-designed humanlike humanoid robot (the ldquoIbnSinardquo robot) and by humans and other entities. The screen and the holograph can display static and moving images, virtual environments as well as online virtual worlds populated by characters, or a windowed / blended mix of the above. The robotic and virtual characters can be autonomous, partially-autonomous, puppetteered, scripted, or real-time-controlled by imitation of human body movements (embodied telepresence). Furthermore, multiple modes of participation of distant humans can be supported: not only through videoconference, but also through control of robots and/or virtual characters. The IbnSina center serves as a platform for multiple purposes: artistic, research as well as educational; and most importantly, the centrality of a progressive character such as IbnSina catalyzes the reconnection of the wider region of the UAE to a past during which scientific inquiry and the arts had flourished; and thus, enables the creation of a future for the region which will emphasize such cultural values.