Random people Random location Random misc

Building a video remixing web-site using Annodex

The Annodex Platform is a suite of BSD-licensed tools for creating multimedia web applications. Annodex is an open extension to the open Ogg container format, and makes use of Ogg Theora and Ogg Vorbis for video and audio content tracks. The platform provides two major capabilities over existing web multimedia frameworks:
(1) The ability to access any time point or range within the media as a TCP/IP stream. This allows efficient and accurate video navigation without requiring that the entire video be downloaded to the viewer's machine
(2) The addition of time-aligned text content tracks to multimedia. This can be used for a range of purposes, including subtitling; logically splitting media up into clips; opening multimedia content up to text-based search techniques; creating multimedia with embedded, time-aligned scripts; and much more.

The most recent and most exciting addition to the platform is the new Annodex Plugin for Firefox. This plugin provides a very comprehensive Javascript API, and delivers powerful control over multimedia to web developers. Some features available through the plugin include:
* very fast startup (page load to video start)
* server-side seeking (see capability 1 above)
* full playlist support, with fast video switching (typically < 100ms)
* client-side seeking
* access to time-aligned text content through callbacks
* server-side video segment extraction

Using these features, we believe that web developers can add the following behaviours to their web applications:
* Table-of-contents for video: Users can quickly navigate through a single long video by clicking on links in a table of contents view of the media.
* Online collaborative annotation of video: Users can identify time points or time regions of video that they think are interesting, and attach annotations to these regions. This is a similar feature to the region tagging currently available in flickr, except that the tags refer to time points in the video rather than regions on the image.
* Realtime collaborative annotation: Using our cmmlbot IRC plugin, web developers can add realtime annotation capabilities to media; for example capturing audience annotations while a lecture is in progress.
* Online video remixing: by combining playlist support with server-side segment extraction, developers can allow users to generate their own unique remixes of video content, without touching or modifying the original videos.
* "active" video: Developers can embed javascript functions within text annotation tracks, and create video content that actively modifies its containing web-based UI.

In this tutorial, I will demonstrate the capabilities of the new plugin, including the behaviours listed above, and describe how you can use our framework to add video capabilities to your own web applications. We will then work together to design and create a simple video remixing web application as a live example of how easy it is to develop with Annodex.

Project: Annodex 


Shane Stephens

Shane Stephens is a software engineer at the Commonwealth Science and Industrial Research Organisation (CSIRO), where he works on a range of technologies including Annodex. Shane's main interests are multimedia capabilities and 3D graphics. Shane was a member of the organising committee for the inaugural FOMS (Foundations of Open Media Software) workshop, held in Sydney in early 2007, and has agreed to serve on the committee again for FOMS08. Shane is also Secretary of the Annodex Association for 2007. The Annodex Association is a non-profit organisation dedicated to advocacy, coordination and planning of Annodex technology.

Shane Stephens

Shane Stephens is a software engineer at the Commonwealth Science and Industrial Research Organisation (CSIRO), where he works on a range of technologies including Annodex. Shane's main interests are multimedia capabilities and 3D graphics. Shane was a member of the organising committee for the inaugural FOMS (Foundations of Open Media Software) workshop, held in Sydney in early 2007, and has agreed to serve on the committee again for FOMS08. Shane is also Secretary of the Annodex Association for 2007. The Annodex Association is a non-profit organisation dedicated to advocacy, coordination and planning of Annodex technology.

© 2007 MEL8OURNE LCA2008 and Linux Australia | Linux is a registered trademark of Linus Torvalds | Site map | Valid XHTML 1.0

rja