augmented.org

Concept

The project is a first attempt to bring augmented reality to digital television set top boxes using European standards DVB-x and MHP. Video streams will be overlaid by 3D computer generated images, which fit into the video scene with correct perspective. Tracking data will be handed to the set top box and virtual models will be rendered on top of the video frames. The demo shows a possible scenario to enrich basque sport pelota. Additional information can be superimposed in real-time and manipulated by the viewer and the broadcaster (100% freedom of choice, customizability and real (bi-directional) interactivity). A new three dimensional user interface combined with object and camera tracking allows viewing the game from a free virtual position.

Further information is given in the Publications section. The work was presented at 2006 EuroITV conference in Athens.

Media

Select a video stream in this panel or…

navigate through the virtual representation and eventually pick a camera or observe the game in VR only.

The video shows the virtual environment. Pushing the remote the viewer can alternate his or her viewpoint. Since all objects are supposed to be tracked, the ball and even the players might be represented in full 3D, granting complete freedom of the viewpoint to the viewer. Real-world cameras are represented by small camera symbols and switching into their lenses is shown in the second video below.

This video above shows the general idea: the virtual world serves as an overview and the viewer can observe in VR or pick a real video stream, representated by small CG cameras. In the video stream view the image will be overlaid with 3D objects (here posters on the wall) in real-time. Occlusion is done by a 1bit mask, that is sent alongside the video footage (in the demo precalculated, but real-time is possible). 3D augmented objects can be exchanged with the push of a button (observe changing posters, all done in real-time).