Evaluating Feedback Devices for Time-Continuous Mobile Multimedia Quality Assessment
- Author(s)
- Shelley Buchinger, Werner Robitza, Matej Nezveda, Ewald Hotop, Patrik Hummelbrunner, Martijn Sack, Helmut Hlavacs
- Abstract
In January 2014, the new ITU-T P.913 recommendation for measuring subjective video, audio and multimedia quality in any environment has been published. This document does not contain any time-continuous subjective method. However, environmental parameter values are changing continuously in a majority of outdoor and also most indoor environments. To be aware of their impact on the perceived quality, a time-continuous quality assessment methodology is necessary. In previous standards, targeting laboratory-based test settings, a desk-mounted slider of substantial size is recommended. Unfortunately, there are many environments where such a device cannot be used. In this paper, new feedback tools for mobile time-continuous rating are presented and analysed. We developed several alternatives to the generally adopted desk-mounted slider as a rating device. In order to compare the tools, we defined a number of performance measures that can be used in further studies. The suitability and efficacy of the rating scheme based on measurable parameters as well as user opinions is compared. One method, the finger count, seems to outperform the others from all points of view. It was been judged to be easy to use with low potential for distractions. Furthermore, it reaches a similar precision level as the slider, while requiring lower user reaction and scoring times. Low reaction times are particularly important for time-continuous quality assessment, where the reliability of a mapping between impairments and user ratings plays an essential role.
- Organisation(s)
- Vienna Cognitive Science Hub, Research Group Cooperative Systems, Research Group Communication Technologies
- Journal
- Signal Processing: Image Communication
- Volume
- 29
- Pages
- 921-934
- No. of pages
- 14
- ISSN
- 0923-5965
- DOI
- https://doi.org/10.1016/j.image.2014.07.001
- Publication date
- 07-2014
- Peer reviewed
- Yes
- Austrian Fields of Science 2012
- 102013 Human-computer interaction, 102024 Usability research
- Keywords
- ASJC Scopus subject areas
- Software, Signal Processing, Electrical and Electronic Engineering, Computer Vision and Pattern Recognition
- Portal url
- https://ucris.univie.ac.at/portal/en/publications/evaluating-feedback-devices-for-timecontinuous-mobile-multimedia-quality-assessment(77186969-a755-4495-ba75-5729375ec7a7).html