Under Milk Wood in Headphone Surround Sound
Posted by Chris Pike, Tom Nixon, Dave Evans on , last updated
This year we have been running experiments with in the web browser using HTML5 and MPEG-DASH. Weβve run tests with for Radio 3 and more recently also radio drama for Radio 4, using a 5.1 rendering of our object-based production of .
Now we have added a new feature to the player, headphone surround sound. We are using processing techniques to convert the multichannel surround sound stream to a two channel headphone signal. The aim is to give those listening on headphones the surround sound experience.
This week's Saturday Drama on Radio 4 will be the highly-acclaimed 2003 production of Dylan Thomas' , in celebration of the centenary of the Welsh writer's birth. This production was mixed in surround sound and at the time a 5.1 stream was made available to our audience. This Saturday we are again streaming the play online in 5-channel surround, this time using our player, which works directly in a page on the Radio 4 website. After the broadcast, the play will be available on-demand for 30 days.
The new headphone surround sound feature is possible thanks to a web technology called the . This client-side script API introduces capabilities for audio signal processing in web applications. It has a range of applications, such as music creation and games, or even recreating the sounds of the . ΒιΆΉΤΌΕΔ R&D's is co-chairing with the 's Audio Working Group, which is working on the specification.
To create the headphone surround sound experience, we use the to grab the multichannel audio signal coming from the HTML5 audio element. We can then process this sound source through a Web Audio node graph. The most important feature of the API for headphone surround is the interface. This allows a developer to convolve an audio signal with a chosen impulse response. The Web Audio API specification provides a helpful informative on convolution.
Using , measured using a dummy head microphone, the convolution process can be used to create the impression that a sound source is coming from a specific point in space, when listening on headphones. We have measured impulse responses from a surround sound loudspeaker system using a dummy head microphone, these are two-channel measurements describing the transfer function from the sound source to each ear. These measurements are used to process each channel of the surround sound signal and the results are mixed together to form a two-channel signal for headphones. The resulting effect should be that of the original surround sound mix coming from five virtual loudspeakers, outside of the listener's head. The image below shows the signal flow within the Web Audio API to create this effect, it was created using Firefox . For more background on binaural techniques, you can read this previous R&D or this ΒιΆΉΤΌΕΔ News .
The Web Audio node graph for creating the binaural headphone surround
In this experiment we have made two different binaural processing options available, with impulse responses measured in different acoustic environments. We are also offering a stereo down-mix, where the surround and front-centre channels are added to the front-left and front-right signals to create a two-channel stereo version, as shown in the image below. This is the way that surround sound sources are conventionally processed for listening on headphones (or a stereo loudspeaker system). Since the audio processing is happening in the browser, we can allow users to select their preferred headphone option without needing to provide multiple different streams.
The Web Audio node graph for creating the stereo down-mix
The technique presented here is not the only way to create a headphone surround impression. There are a range of established systems out there for converting surround content to headphones. However using the Web Audio API, we can provide the headphone surround experience without requiring users to install any plug-ins. All that is needed is a modern HTML5-compatible web browser that supports and, for the DASH streaming player, W3C . Currently the only browser that supports both of these features is Google Chrome, but we expect there to be more compatible browsers in the future.
Previously we carried out a of headphone surround systems and found that across a range of ΒιΆΉΤΌΕΔ content they did not yet provide a significant improvement over a stereo down-mix. We believe that these techniques can enhance headphone listening for our audiences though, making existing surround sound content available to audience members using headphones, as in this experiment. One interesting factor is that the quality is dependent on the source material, as well as the processing techniques used. The way that this 'play for voices' has been mixed seems particularly suited to this virtual loudspeaker binaural technique, as often voices are routed to a single loudspeaker rather than being panned between them.
It is important to mention that binaural techinques can also be used to go beyond 5-channel surround experiences, they can be used to create true 3D spatial impression with height and also interactive virtual reality experiences such as the one shown at our . We hope to continue developing our experiments with this technology in the future.
There is a survey at the bottom of the page. We would greatly appreciate your feedback on the experience if you have the time to fill it in. You can also use the hashtag #ΒιΆΉΤΌΕΔR4UMW on Twitter.
Please take a look at this by Rupert Brun, Head of Technology for ΒιΆΉΤΌΕΔ Radio, and our to help you with the set-up.