Options
Assessment of QoE for Video and Audio in WebRTC Applications Using Full-Reference Models
Date Issued
2020-03-10
Date Available
2020-12-09T16:45:27Z
Abstract
WebRTC is a set of standard technologies that allows exchanging video and audio in real time on the Web. As with other media-related applications, the user-perceived audiovisual quality can be estimated using Quality of Experience (QoE) measurements. This paper analyses the behavior of different objective Full-Reference (FR) models for video and audio in WebRTC applications. FR models calculate the video and audio quality by comparing some original media reference with the degraded signal. To compute these models, we have created an open-source benchmark in which different types of reference media inputs are sent browser to browser while simulating different kinds of network conditions in terms of packet loss and jitter. Our benchmark provides recording capabilities of the impairment WebRTC streams. Then, we use different existing FR metrics for video (VMAF, VIFp, SSIM, MS-SSIM, PSNR, PSNR-HVS, and PSNR-HVS-M) and audio (PESQ, ViSQOL, and POLQA) recordings together with their references. Moreover, we use the same recordings to carry out a subjective analysis in which real users rate the video and audio quality using a Mean Opinion Score (MOS). Finally, we calculate the correlations between the objective and subjective results to find the objective models that better correspond with the subjective outcome, which is considered the ground truth QoE. We find that some of the studied objective models, such as VMAF, VIFp, and POLQA, show a strong correlation with the subjective results in packet loss scenarios.
Sponsorship
European Commission
European Commission - European Regional Development Fund
Science Foundation Ireland
Other Sponsorship
Insight Research Centre
Regional Government of Madrid
Spanish Government
Ministry of Economy and Competitiveness
Type of Material
Journal Article
Publisher
MDPI
Journal
Electronics
Volume
9
Issue
3
Copyright (Published Version)
2020 the Authors
Language
English
Status of Item
Peer reviewed
This item is made available under a Creative Commons License
File(s)
Owning collection
Scopus© citations
26
Acquisition Date
Mar 28, 2024
Mar 28, 2024
Views
445
Last Week
1
1
Last Month
1
1
Acquisition Date
Mar 27, 2024
Mar 27, 2024
Downloads
298
Last Month
7
7
Acquisition Date
Mar 27, 2024
Mar 27, 2024