Â鶹ԼÅÄ

Try Â鶹ԼÅÄ Together with your friends over at Â鶹ԼÅÄ Taster

Running a session is as simple as visiting the Â鶹ԼÅÄ Together web page, pasting a link to a Â鶹ԼÅÄ iPlayer programme, and getting a unique link to send to your friends. Once everyone is in, you can pause or queue up another programme for everybody at any time.

The system is built on top of the Â鶹ԼÅÄ's Standard Media Player and works with almost any Â鶹ԼÅÄ audio or video, so doesn't need any additional software to be installed. Our lookup server parses the pasted link to any Â鶹ԼÅÄ website and talks to the relevant Â鶹ԼÅÄ system to find out how to play the video or audio content on that page. For now, this works with most Â鶹ԼÅÄ iPlayer, Sounds, Bitesize, News, and Sport pages - but let us know if you find any links that don't work as expected!

Â鶹ԼÅÄ Research & Development has a rich track record in experimenting with object-based, multi-device synchronised experiences which increase immersiveness, interactivity and personalisation. We saw an opportunity to use our expertise in this area to create experiences that could bring people together and engage with Â鶹ԼÅÄ programmes. The Â鶹ԼÅÄ Together prototype tests our previous research work, but at a larger scale. It allows us to collect valuable audience feedback on these new communal experiences and has allowed us to combine our knowledge, building upon earlier tests and trials. For example:

• We trialled object-based, multi-screen experiences, showing statistics, infographics or alternative camera angles on additional devices as part of our involvement in .

• We used the same synchronisation system for the spatial audio trial The Vostok-K Incident, where multiple devices in the same room can play different parts of an audio drama scene.
• Â鶹ԼÅÄ R&D has previously looked at synchronising IP-delivered additional content such as audio description or director's commentary to a main video stream.

We wanted to use our existing research to make something that would help people during the current pandemic. We've worked across three teams in R&D and with colleagues in iPlayer and Sounds to make this prototype and release it for testing. Successfully integrating our technology with the Â鶹ԼÅÄ Standard Media Player means we will also be able to carry out synchronised media trials more widely in future.

How it works

A key component of our prototype is a synchronisation service that enables devices across the internet to very accurately synchronise their playback. The service was initially developed and open-sourced as part of :

It works by first getting every participant to synchronise to the server clock ("wall clock" time), and then publishing and subscribing to content timelines derived from this shared understanding of time. The participant devices then report changes in their published timelines via timestamp-containing updates. The server compares timeline updates from all participants which published similar timelines, determines how to reconcile any differences and sends them on to other devices in the session (the timeline subscribers). In lab conditions, this approach can synchronise media to within about 20ms, close enough to show the same frame of video on all devices at the same time. This is well below the threshold in asynchrony that can be perceived by users from across different locations. For this trial, we expect our prototype to perform much better than if users were to try to synchronise by all trying to hit the play button at the same time. In fact, sync'd playback through Â鶹ԼÅÄ Together should be close enough to have a video or voice call at the same time and react to the big reveals in a drama, or enjoy the punchlines in comedy programmes together. We're interested in testing how well our prototype scales, whether it makes for a good experience, and whether this very close synchronisation matters.

On the participant's device, our plugin for the media player runs an adaptation algorithm that compares the current playhead position to the ideal described by the content timeline. It then generates commands to the player - to play, pause, seek, speed up or slow down - to stay in sync with minimal interruption to the end-user. A particular challenge for the team was designing an acceptable adaptation algorithm to work with DASH playback, where the whole video is not downloaded in advance; every seek command may trigger playback delays as the DASH player buffers the video segments not available in its local cache. We attempted to solve this by minimising the number of big jumps, using small speed adjustments instead where feasible, and by estimating how long the buffering will take. However, this is still not perfect in all situations and may need further research work.

What next?

It is hard to replicate real working conditions, such as load distribution in our experimental environments. We don't know yet how well the various components will scale, and releasing the service in its experimental form is a way we can test this.

We also don't really know if there is an appetite for synchronised audio and video in this form. We think that there might be - there are many "experience together" applications launching, hinting at new, sociable ways to consume content. But we don't know who this might be most useful for, nor which kinds of Â鶹ԼÅÄ programmes people want to watch in this way.

It's ready to try out on Â鶹ԼÅÄ Taster now, and you can rate it and share it with friends there. We're looking forward to hearing what you think.

-

Â鶹ԼÅÄ Taster - Try The Vostok-K Incident

Â鶹ԼÅÄ R&D - Vostok-K Incident: Immersive Audio Drama on Personal Devices

Â鶹ԼÅÄ R&D - Immersive Spatial Sound Using Personal Audio Devices

Â鶹ԼÅÄ R&D - Synchronisation to create a Personalised Broadcast

Â鶹ԼÅÄ R&D - Seamless Substitution - Mixing IP and Broadcast Video for Personalised TV