A New Tool for Collaborative Video Search via Content-based Retrieval and Visual Inspection

Abstract

We present a new approach for collaborative video search and video browsing relying on a combination of traditional, indexbased video retrieval complemented with large-scale human-based visual inspection. In particular, a traditional PC interface is used for query-based search using advanced indexing and querying methods (e.g., concept search), whereas a visualization of the database on a tablet is used for pure human-based browsing. Both parts are coupled to compensate for mutual disadvantages; human visual inspection allows for a better, more detailed analysis of the data – also bridging the semantic gap – but comes at the price of an unfiltered database – a disadvantage that is resolved by using the results from the query engine to change visualization order.