MagicBookFrom HIT Lab NZ
Sub-ProjectsHuman FactorsThe human factors dynamics of augmented reality (AR) technology, including applications such as the MagicBook, are a relatively unexplored domain. The goal of this research is to describe and evaluate the human factors dynamics of the existing MagicBook technology, and to extend the technology to complex dynamic visualisation, navigation, and control tasks. AR interfaces are still a relatively uncharted territory with respect to both the physical and cognitive ergonomics. In 2D interfaces there are well-tested principles, such as Fitt's law which relates to speed/accuracy tradeoffs. The search for principles that apply in 3D control interfaces is less mature, but there are many useful results from studies of human perception and action that are being integrated into the theoretical basis of the research, including recent results in event perception from the VR lab in the Psychology department at the University of Canterbury. The research makes use of new and existing AR applications using the C and Objective-C languages on the Mac OS X computing platform and a variety of off-the-shelf hardware. Visualisation is via the OpenGL API, using the SOLID software library for physics. A major expectation of this research programme is that it will lead to the development and evaluation of MagicBook interaction metaphors which enable good performance in complex dynamic visualisation, navigation and control tasks. As part of this research, new AR applications are being developed, particularly for interaction with complex multi-dimensional datasets. The developed technologies are likely to be applied in medical, aerospace, and educational domains. As new optical delivery methods such as the virtual retinal display (VRD) become available, ongoing human factors evaluation will be required to guide the effective implementation of end-user applications.
Interaction & NavigationThis research involves the exploration, development and evaluation of new interaction and collaboration techniques, for example the selection of virtual objects simply by looking at them. The research will also examine multi-scale environments and their application to the MagicBook. Currently the user can transition smoothly between two fixed viewing modes: the augmented-reality view and the virtual-reality view. By giving the user full control over the transition, they can view the scene from an arbitrary zoom level. This research will result in a more immersive and interactive experience for its users. In a collaborative setting, it is hoped that these enhancements will make communication between users easier and more natural. This research will result in a more immersive and interactive experience for its users. In a collaborative setting, it is hoped that these enhancements will make communication between users easier and more natural.
Natural Feature TrackingThis project focuses on the implementation of natural feature tracking into the MagicBook. This method of tracking uses features in the scene instead of relying entirely on the markers as is currently required. The existing MagicBook technology necessitates each corner of the marker to be in view at all times, for the 3D image to appear on the page. Utilising natural feature tracking in the MagicBook will help rectify this limitation. The research involves adapting a new version of the ARToolkit for Windows that uses texture tracking of 2D plane structures. A black and white marker is still used in the initialisation process but is no longer needed while tracking: the software tracks in real time the natural features of the plane object. This method is far more robust than just tracking off the markers alone because even if the marker is covered or out of view the 3D images still appears on the page. ARToolKit, Open GL, C, and VRML are the main technologies being used
Publications
Additional ContentImage Gallery
Videos
|
