HbbTV open to synchronised holograms
Synchronising an augmented-reality experience to a broadcast programme on an HbbTV 2 device.
Version 2 of the HbbTV standard, introduces several new features. Probably the most interesting set of features target at combining mobile devices such as tablets or smartphones with HbbTV devices. These so-called companion-screen features allow creating distributed media experiences, in the sense that the TV experience can be extended from the TV to a secondary device, and provide key enablers for the convergence of TV services and media services for mobile connected devices.
First demonstrations showed applications of the DVB-CSS protocols for Tablet and Smartphone devices, for example by BBC R&D at IBC 2015, IRT at IBC 2016 and the EU project ImmersiaTV IBC 2016. However, DVB-CSS is not limited to these platforms. At IRT we are currently exploring applications of different 360° video, virtual reality (VR) and augmented reality (AR) platforms for viewers and producers of broadcast media. AR platforms include Microsoft’s HoloLens, which allows projecting three-dimensional, virtual objects (holograms) into the user’s field of vision.
We built a virtual display application for HoloLens which plays back video in sync with the running TV programme. On this basis, we created two experiences. In the first one the HoloLens displays a video of a sign-language interpreter next to a (real) TV set which is showing a version of the ARD news magazine “Tagesschau”. The second experience is an experimental short movie which uses the additional display as a stylistic element for story telling.