Capturing and Rendering Audio for VR
Capturing and Rendering Audio for VR
Date: 25 Mar 2017
See below for location map.
This event is free and open to all but registration is required before 12th March https://www.eventbrite.co.uk/e/aes-uk-north-workshop-on-capturing-and-rendering-of-audio-for-vr-tickets-31840148742
13:00 – 13:30 Registration
13:30 – 14:15 Ambisonic Workflows for Virtual and Augmented Reality, Dr Gavin Kearney, University of York
14:15 – 15:00 Music/Spatial Music Production and Recording for 360 video, Dr Enda Bates, Trinity College Dublin
15:00 – 15:30 Coffee break
15:30 – 16:15 Psychoacoustics of 360VR microphone array design, Dr Hyunkook Lee, University of Huddersfield
16:15 – 17:00 Recording techniques for binaural production, Tom Parnell, BBC R&D
17:15 – 18:30 Additional Loudspeaker 3D sound demos
The rapid rise of VR is increasing the need for 360-degree binaural audio as well as video in order to provide users with a fully immersive and realistic experience. In this half a day workshop, four presenters from the industry and academia will introduce and discuss the theories and practical aspects of various microphone and rendering techniques for 360VR audio, including First-Order Ambisonics (FOA), Higher-Order Ambisonics (HOA), Equal Segment Microphone Array (ESMA), etc. The talks will be accompanied with binaural audio demos. The workshop will be a good opportunity for both industry professionals and students to gain insights into the state-of-the-art technologies and practical production techniques for 360VR audio. The abstracts of the talks are as follows.
Ambisonic Workflows for Virtual and Augmented Reality, Dr Gavin Kearney, University of York
Ambisonics has existed as a method of surround sound capture and reproduction since the 1970s but has found renewed interest of late due to its applicability to Audio for Virtual Reality systems. This talk will look at some of the issues inherent in encoding and decoding VR audio content for binaural-based Ambisonics as well as showcase some of the recent research work at the University of York in this area.
Music/Spatial Music Production and Recording for 360 video, Dr Enda Bates, Trinity College Dublin
In this talk researcher and composer Dr Enda Bates will discuss recording techniques for 360 video music productions, particularly in terms of the various practical issues which arise during recording sessions, the use of spot microphones and post-production, and a comparison of different FOA and HOA microphones. The concept of spatial music and its particular applicability to 360 video/VR is also introduced via a number of example 360 videos and accompanying 360 audio.
Recording techniques for binaural production, Tom Parnell, BBC R&D
Tom will present the recording approach used on two contrasting BBC audio productions – a trial of BBC Proms concerts streamed in binaural sound and the sound for VR fairy-tale The Turning Forest, which was premiered at the 2016 Tribeca Film Festival and is now available on Google Daydream. He will talk about spatial microphone techniques, binaural processing and dynamic (tracked) audio rendering.
Psychoacoustics of 360VR microphone array design, Dr Hyunkook Lee, University of Huddersfield
First-Order Ambisonics (FOA) microphones are currently most popular for 360VR. However, it is also possible to capture audio for 360VR using multiple cardioid microphones configured in a near-coincident fashion, which could offer greater spaciousness and externalisation than the FOA. This talk will introduce psychoacoustic principles for designing such a microphone array, with binaural demos for A/B comparisons.