3D Sound in Augmented Reality

From HIT Lab NZ

Researchers:	Jaka Sodnik , Raphael Grasset
Date:	March, 2006 - Ongoing
Funding:

---

Contents 1 Publications 2 Additional Content 2.1 Image Gallery 2.2 Videos

The basic principle of augmented reality is the combination of real world and 2D or 3D virtual images, which can be seen on a computer screen, head mounted display, etc. While the augmented reality aims to create a 3D or spatial perception of different mixed scenes, we believe that the addition of 3D sound can contribute to a more sensational and realistic perception. Our research focuses on the exploration of different approaches of 3D sound implementations (stereo speakers, surround systems, headphones, etc.).

Since the existing AR applications mainly use Objective-C languages where the visualisation is realized with the use of OpenGL API, we seek a similar approach also for the delivery of audio. One possible solution is the use of Creative OpenAL library which can be very simply co-integrated with the existing OpenGL code. On the other hand, other 3D sound libraries should also be evaluated and tested within the AR environment (DirectShow, FMOD, etc.). The use of predefined sound libraries enables the delivery of spatial sound through different speaker configurations (stereo speakers, surround systems, headphones, etc.). The research focuses primarily on the creation of a high fidelity 3D sound for headphones. For that reason the study of Head Related Transfer Functions is also required.

We expect that the addition of 3D sound to a mixed or augmented reality interface should create a more realistic perception of virtual content in the real world. It should contribute to a better perception of their spatial position and orientation.

In the first stage, some 3D sound is to be added to the "Magic book" project. The animated scenes and characters are planned to be supplied with an interactive sound, whereby different user interactions will affect both the virtual scenes and sounds.

Publications

[2006-OZCHI-SpatialSoundInAR.pdf Spatial Sound Localization in an Augmented Reality Environment]

Sodnik, J., Grasset, R., Dünser, A., Tomazis, S., Billinghurst, M.

In Proceedings of OZCHI 2006, ACM International Conference Proceedings Series, Sydney, Australia, November 2006.

Project: [[{{{project}}}]]

Additional Content

Image Gallery

There are currently no images uploaded...

Videos

There are currently no videos uploaded...