• Calendar

January 31, Tuesday
12:00 – 14:00

The way we access, store and display video are all derived from "engineering constraints". Entities such as pixels and frames serves as the building blocks of many video applications. These entities where designed to simplify and reduce the cost of manufacturing process. They were not design for depicting the information contained in the scene. For example, video is inherently limited by the sensors bounds (dimensions, frame-rate, resolution, and modality) regardless the content. The best one can do is trade resolution for field-of-view (zoom). In this talk I will show how these building block may be replaced by content driven units, and how these bounds may be exceeded. By combining information from multiple sensors the user can controlled and exceeded some of these bounds. We can increase space and time resolution and combine information from different sensing modalities. The above engineering approach also dominates video user interface. For example, despite the random access of many recent video storage devices (PC, DVD) we are currently accessing video sequentially. The rest of the talk argues in favor of content driven user interfaces. I will begin with a simple content based time-line. An anchoring layer that is robust to acquisition, broadcast and storage types, and is based only on the video's content. Then I will show steps towards object based video interfaces. An approach for segmenting video content that exploits the inherent temporal redundancy in video will be presented. Along this application, I will show that small coherent regions subsume regular pixels when facing a segmentation problem. An importance based user interface, complete the content driven approach for video interfaces. The importance in this case is evaluated by embedding high dimensional video data into low dimension space where properties as local uniqueness may reflect importance