Room acoustics and virtual reality: An implementation of auralisation and 360 degree image techniques to create virtual representations of spaces

Abstract

There has been a huge increase in enthusiasm for virtual reality in recent years. Spatial audio is of significant importance when creating virtual reality content if the experience is to be perceptually congruent. This project aims to intersect the worlds of virtual acoustic auralisation and virtual reality, creating a novel method of demonstrating room acoustic environments with maximal audio visual impact in a user friendly fashion. An open source library of 3D impulse responses together with 360° image/video capture using a variety of techniques will be created in different spaces (and positions within). Various spaces will be measured and analysed including classrooms, music venues, buildings of historical interest and theatres. As well as impulse response (IR) measurements, 360° images will be recorded using photospheres, captured on android smart phones [1] and the Ricoh theta S [2]. Future applications for these impulse responses will be the development of a virtual mixing tool, where the user will be able to experience mixing live performances within an auralised virtual environment, a method of allowing audiences to view and hear auralisations of different seating positions within a space for ticketing and marketing purposes, and the possibility of a real time auralised virtual concert.