University of Worcester Worcester Research and Publications

CASAM: Collaborative Human-machine Annotation of Multimedia.

Hendley, R.J., Beale, R., Bowers, Christopher ORCID:, Georgousopoulos, C., Vassiliou, C., Sergios, P., Moeller, R., Karstens, E. and Spiliotopoulos, D. (2014) CASAM: Collaborative Human-machine Annotation of Multimedia. Multimedia Tools and Applications, 70 (2). pp. 1277-1308. ISSN Print: 1380-7501 Online: 1573-7721

MTAP_CASAM_preprint.pdf - Submitted Version

Download (1MB) | Preview


The CASAM multimedia annotation system implements a model of cooperative annotation between a human annotator and automated components. The aim is that they work asynchronously but together. The system focuses upon the areas where automated recognition and reasoning are most effective and the user is able to work in the areas where their unique skills are required. The system’s reasoning is influenced by the annotations provided by the user and, similarly, the user can see the system’s work and modify and, implicitly, direct it. The CASAM system interacts with the user by providing a window onto the current state of annotation, and by generating requests for information which are important for the final annotation or to constrain its reasoning. The user can modify the annotation, respond to requests and also add their own annotations. The objective is that the human annotator’s time is used more effectively and that the result is an annotation that is both of higher quality and produced more quickly. This can be especially important in circumstances where the annotator has a very restricted amount of time in which to annotate the document. In this paper we describe our prototype system. We expand upon the techniques used for automatically analysing the multimedia document, for reasoning over the annotations generated and for the generation of an effective interaction with the end-user. We also present the results of evaluations undertaken with media professionals in order to validate the approach and gain feedback to drive further research.

Item Type: Article
Additional Information:

This is the pre-print of the published version :
Hendley, Robert, J. and Beale, Russell and Bowers, Christopher and Georgousopoulos, Christos and Vassiliou, Charalampos and Sergios, Petridis and Moeller, Ralf and Karstens, Eric and Spiliotopoulos, Dimitris (2014) CASAM: Collaborative Human-machine Annotation of Multimedia. Multimedia Tools and Applications, 70 (2). pp. 1277-1308. ISSN Print: 1380-7501 Online: 1573-7721

Uncontrolled Discrete Keywords: annotation, synergistic, collaborative, human, artificial intelligence, ontology, video
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Divisions: College of Business, Psychology and Sport > Worcester Business School
Related URLs:
Depositing User: Christopher Bowers
Date Deposited: 06 Mar 2015 08:38
Last Modified: 17 Jun 2020 17:06

Actions (login required)

View Item View Item
Worcester Research and Publications is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.