This week we're experimenting with our first fully remote hack, teaming up across 麻豆约拍 R&D to explore ideas around wellbeing in isolation - a topic on many of our minds.
Meanwhile, work across our core projects continues.
Voice and motion
Can we accurately detect body movements and gestures via webcam for multiplayer game interactions? That鈥檚 what we鈥檙e investigating as we adapt one of our prototype audio AR experiences for remote play, currently testing TensorFlow鈥檚 PoseNet for realtime pose estimation.Many of you have been taking part in our Synthetic Voice & Personality Study. As it draws to a close, we鈥檙e preparing to analyse the large amount of quantitative and qualitative data that鈥檚 been gathered, and hope to share the insights soon. In the meantime, our own Barbara Zambrini was interviewed about the project in (page 42).
The recommendations challenge
We want to help join up recommendations for our audiences, between different content products (鈥渃ross-media recommendations鈥�; iPlayer to News, for instance) and different content forms (鈥渕ultimodal content similarity鈥�; audio, video, text). To begin tackling these challenges, we鈥檝e reviewed the 麻豆约拍鈥檚 various metadata formats (discovering significant incompatibilities to overcome) and the degree of user overlap between each product, and we鈥檙e attempting to assemble a full month of multimodal content for analysis (itself a real challenge!).
Meanwhile, we鈥檝e helped to build an offline evaluation system to assess new recommendation algorithms before their deployment, based on our recent work using .What about how people feel when watching or listening to 麻豆约拍 content - could this help inform recommendations? That鈥檚 what our Sentiment User Study is seeking to explore, using a mixture of biometric analysis (via smartwatches for the participants) and self-reporting, the results of which we'll later compare with our automated analysis of programmes. The questions this study raises - data protection, research ethics, medical accuracy and interpretation amongst them - are all being carefully assessed by the team.
Improvements and solutions
The team working on our speech-to-text system are always striving for incremental improvements, approaching the challenge from multiple angles. Most recently these include: successfully separating and removing any non-speech audio in order to reduce the word error rate; increasing performance by merging small custom language models into the larger model; analysing approximately 800,000 麻豆约拍 News articles to detect neologisms that need adding to the STT lexicon (along with their accurate pronunciations); evaluating the potential of .
In our collaboration with - to design a discovery tool for 麻豆约拍 journalists searching news clips - we鈥檙e now focused on distilling the insights from our many conversations with prospective users across the organisation, whilst continuing to iterate.On our strand of work, we鈥檝e been looking at web support on TV devices for . The problem: is the user鈥檚 web browser able to decode HDR and WCG media, and if so is it connected to a compatible display? Our proposed solution: specify new CSS media queries to assess video display capability. We鈥檙e working through the details now - more to come!
And finally...
To end, three bits of exciting news. You can hear our team鈥檚 Alicia Grandjean discuss her News Mood Filter prototype in the latest . We鈥檙e into final preparations (design updates, load testing, release plan) for our synchronised viewing and listening pilot. And a warm welcome to our new Industrial Trainee Ben, who鈥檚 starting work on our ambition to support the public's understanding of machine learning, beginning with some bird identification using My Naturewatch!