36 IEEE Communications Standards Magazine • June 2017
2471-2825/17/$25.00 © 2017 IEEE
Abstract
WebRTC comprises a set of novel technolo-
gies and standards that provide Real-Time Com-
munication on Web browsers. WebRTC makes
simple the embedding of voice and video com-
munications in all types of applications. However,
releasing those applications to production is still
very challenging due to the complexity of their
testing. Validating a WebRTC service requires
assessing many functional (e.g. signaling logic,
media connectivity, etc.) and non-functional (e.g.
quality of experience, interoperability, scalability,
etc.) properties on large, complex, distributed and
heterogeneous systems that spawn across client
devices, networks and cloud infrastructures. In
this article, we present a novel methodology and
an associated tool for doing it at scale and in an
automated way. Our strategy is based on a black-
box end-to-end approach through which we use
an automated containerized cloud environment
for instrumenting Web browser clients, which
benchmark the SUT (system under test), and fake
clients, that load it. Through these benchmarks,
we obtain, in a reliable and statistically signifi-
cant way, both network-dependent QoS (Quality
of Service) metrics and media-dependent QoE
(Quality of Experience) indicators. These are fed,
at a second stage, to a number of testing asser-
tions that validate the appropriateness of the func-
tional and non-functional properties of the SUT
under controlled and configurable load and fail
conditions. To finish, we illustrate our experiences
using such tool and methodology in the context
of the Kurento open source software project and
conclude that they are suitable for validating large
and complex WebRTC systems at scale.
Introduction
Web applications and services are among the
most popular ones in today’s Internet. Due to
this, Web developers are subject to an increas-
ing demand for delivering more complex, scal-
able and reliable applications in less and less time.
The most limiting factor for satisfying this demand
is software verification and validation that may
account for more than 70 percent of the total
development effort [1]. Because of this, during
the last few years, we have witnessed an explo-
sion of DevOps methodologies and tools that aim
to simplify the validation process. Thanks to these,
nowadays Web developers are able to automate
unit and system tests. These tests typically com-
prise one or several probes that query the system
under test (SUT), or any of its components, and
gather simple outcomes as a result. After that,
a set of testing assertions evaluate the system
correctness by comparing such outcomes with
pre-set or model-inferred values. An assertion (or
predicate) is a mechanism for determining wheth-
er a test has passed or failed. It involves compar-
ing an outcome of the SUT with the expected
value.
The popularization of multimedia technologies
among Web developers and, very particularly, the
emergence of WebRTC as a built-in feature of
Web browsers, is significantly increasing the com-
plexity of the testing. WebRTC comprises a set
of standards designed for embedding RTC (Real-
Time Communication) capabilities as part of Web
browsers’ APIs [2]. A recent report predicts that
with Apple and Microsoft supporting WebRTC in
their browsers, there might be 7 billion devices
compliant with WebRTC by 2020 [3].
WebRTC applications cannot be tested using
the usual simple comparison-based assertion. For
example, validating the functional correctness
of a WebRTC application requires the ability to
evaluate aspects such as media connectivity (e.g.
whether the media bits are being sent end-to-end)
or media continuity (e.g. whether the media is
decodable). Assessing non-functional properties
is even more complex. The real-time nature of
WebRTC traffic causes QoS (Quality of Service)
parameters such as network latency, network
jitter or packet loss to affect significantly, and in
non-trivial ways, the end-user’s QoE (Quality of
Experience). Measuring accurately such QoE and
enabling assertions to automate their validation is
a huge challenge.
As an additional complication, testing WebRTC
applications is challenging due to the heteroge-
neous nature of the networks to be traversed in
order to enable P2P communication. Some prob-
lems include clients consuming media behind a
NAT or a firewall. As a result, WebRTC services
involve complex, distributed and heterogeneous
network topologies where failures or inefficiencies
may prevent the service from providing a success-
ful user experience.
All in all, creating reliable and automated tests
for WebRTC applications, services and infrastruc-
tures is a task that cannot be performed in a
simple way based on commonly available state-
of-the-art DevOps tools and methodologies. In
this article, we contribute a solution to this prob-
lem, proposing both a strategy and technologi-
cal toolbox that are suitable for the automated
Boni García, Francisco Gortázar, Luis López-Fernández, Micael Gallego, and Miguel París
REALTIME COMMUNICATIONS IN THE WEB
The authors are with the Universidad Rey Juan Carlos.
WebRTC Testing:
Challenges and Practical Solutions
Digital Object Identifier:
10.1109/MCOMSTD.2017.1700005
资源评论
码流怪侠
- 粉丝: 3w+
- 资源: 651
最新资源
- SoundManager.java
- 永磁同步电机参数调整与预测控制模块：时变工况下的参数不确定性与匹配策略,永磁同步电机参数调整与预测控制模块：时变工况下的参数不确定性与匹配策略,永磁同步电机参数不确定 参数变化 参数失配 参数摄动模块
- C++基础入门.pdf
- 软考-中级-网络工程师-知识点总结.docx
- ,《基于速度同步线性调频小波变换（VSLCT）的时频分析技术研究与应用》,速度同步线性调频小波变（VSLCT）VSLCT是当前线性变的扩展版本 它能有效地缓解拖尾效应，并能动态地响应条件变化提供所需
- ROS工程认知-ROS文件系统结构与编译系统详解
- 两极式三相光伏逆变并网仿真：基于MPPT算法与双环PI调节的LCL型三相逆变系统仿真模型,三相光伏并网系统仿真模型：研究Boost变换器MPPT算法与三相两电平LCL型逆变器的SVPWM调制及控制策略
- ROS环境中C++节点的构建与多节点协调运行机制探讨
- ROS通讯机制-话题通信详解及实例：构建发布/订阅模式实现异步通信
- 优化后的PFC2D颗粒离散元数值模拟试验合集：直剪、单轴与双轴压缩并行高效运行代码集,优化后PFC2D颗粒离散元数值模拟试验合集：高效单直剪与单双轴压缩并行运行代码集,该模型是一个PFC2D颗粒离散元
- 第五次课程服务组实验1：基于仿真的机器人及其应用环境
- 【business-jxd】
- 第6次课 ROS服务.docx
- Abaqus铁路轨道建模及车轨耦合动力响应分析：车轨地基相互作用与弹簧批量施加研究,Abaqus铁路轨道建模及车轨耦合动力响应分析：车轨地基相互作用与弹簧批量施加研究,Abaqus铁路轨道建模，车轨耦
- PCAN-Basic-Windows.zip
- 从0到1的网络安全专家之路 二进制安全和Web安全.zip
资源上传下载、课程学习等过程中有任何疑问或建议，欢迎提出宝贵意见哦~我们会及时处理！
点击此处反馈
