RepoVizz is an integrated online system capable of structural formatting and remote storage, browsing, exchange, annotation, and visualization of synchronous multi-modal, time-aligned data. Motivated by a growing need for data-driven collaborative research, repoVizz aims to resolve commonly encountered difficulties in sharing or browsing large collections of multi-modal data. At its current state, repoVizz is designed to hold time-aligned streams of heterogeneous data: audio, video, motion capture, physiological signals, extracted descriptors, annotations, et cetera. Most popular formats for audio and video are supported, while Broadcast WAVE or CSV formats are adopted for streams other than audio or video (e.g., motion capture or physiological signals). The data itself is structured via customized XML files, allowing the user to (re-) organize multi-modal data in any hierarchical manner, as the XML structure only holds metadata and pointers to data files. Datasets are stored in an online database, allowing the user to interact with the data remotely through a powerful HTML5 visual interface accessible from any standard web browser; this feature can be considered a key aspect of repoVizz since data can be explored, annotated, or visualized from any location or device. Data exchange and upload/download is made easy and secure via a number of data conversion tools and a user/permission management system.
Keywords: repository, collaborative, exchange, remote, HTML5, multimodal, annotation
RepoVizz is being developed since 2010 within the Music Technology Group (Universitat Pompeu Fabra) thanks to the support of a number of grants and projects including: TECNIO grant by the Catalan government, EU-FP7-FET Project SIEMPRE and EU-FP7-STREP Project PHENICX.
Contact: oscar.mayor@upf.edu
Mayor, O., Llop J., & Maestre E. (2011). RepoVizz: A multimodal on-line database and browsing tool for music performance research. 12th International Society for Music Information Retrieval Conference (ISMIR 2011).
Mayor, O., Llimona Q., Marchini M., Papiotis P., & Maestre E. (2013). repoVizz: a Framework for Remote Storage, Browsing, Annotation, and Exchange of Multi-modal Data. ACM International Conference on Multimedia (ACM MM'13).