36 IEEE Communications Standards Magazine • June 2017
2471-2825/17/$25.00 © 2017 IEEE
Abstract
WebRTC comprises a set of novel technolo-
gies and standards that provide Real-Time Com-
munication on Web browsers. WebRTC makes
simple the embedding of voice and video com-
munications in all types of applications. However,
releasing those applications to production is still
very challenging due to the complexity of their
testing. Validating a WebRTC service requires
assessing many functional (e.g. signaling logic,
media connectivity, etc.) and non-functional (e.g.
quality of experience, interoperability, scalability,
etc.) properties on large, complex, distributed and
heterogeneous systems that spawn across client
devices, networks and cloud infrastructures. In
this article, we present a novel methodology and
an associated tool for doing it at scale and in an
automated way. Our strategy is based on a black-
box end-to-end approach through which we use
an automated containerized cloud environment
for instrumenting Web browser clients, which
benchmark the SUT (system under test), and fake
clients, that load it. Through these benchmarks,
we obtain, in a reliable and statistically signifi-
cant way, both network-dependent QoS (Quality
of Service) metrics and media-dependent QoE
(Quality of Experience) indicators. These are fed,
at a second stage, to a number of testing asser-
tions that validate the appropriateness of the func-
tional and non-functional properties of the SUT
under controlled and configurable load and fail
conditions. To finish, we illustrate our experiences
using such tool and methodology in the context
of the Kurento open source software project and
conclude that they are suitable for validating large
and complex WebRTC systems at scale.
Introduction
Web applications and services are among the
most popular ones in today’s Internet. Due to
this, Web developers are subject to an increas-
ing demand for delivering more complex, scal-
able and reliable applications in less and less time.
The most limiting factor for satisfying this demand
is software verification and validation that may
account for more than 70 percent of the total
development effort [1]. Because of this, during
the last few years, we have witnessed an explo-
sion of DevOps methodologies and tools that aim
to simplify the validation process. Thanks to these,
nowadays Web developers are able to automate
unit and system tests. These tests typically com-
prise one or several probes that query the system
under test (SUT), or any of its components, and
gather simple outcomes as a result. After that,
a set of testing assertions evaluate the system
correctness by comparing such outcomes with
pre-set or model-inferred values. An assertion (or
predicate) is a mechanism for determining wheth-
er a test has passed or failed. It involves compar-
ing an outcome of the SUT with the expected
value.
The popularization of multimedia technologies
among Web developers and, very particularly, the
emergence of WebRTC as a built-in feature of
Web browsers, is significantly increasing the com-
plexity of the testing. WebRTC comprises a set
of standards designed for embedding RTC (Real-
Time Communication) capabilities as part of Web
browsers’ APIs [2]. A recent report predicts that
with Apple and Microsoft supporting WebRTC in
their browsers, there might be 7 billion devices
compliant with WebRTC by 2020 [3].
WebRTC applications cannot be tested using
the usual simple comparison-based assertion. For
example, validating the functional correctness
of a WebRTC application requires the ability to
evaluate aspects such as media connectivity (e.g.
whether the media bits are being sent end-to-end)
or media continuity (e.g. whether the media is
decodable). Assessing non-functional properties
is even more complex. The real-time nature of
WebRTC traffic causes QoS (Quality of Service)
parameters such as network latency, network
jitter or packet loss to affect significantly, and in
non-trivial ways, the end-user’s QoE (Quality of
Experience). Measuring accurately such QoE and
enabling assertions to automate their validation is
a huge challenge.
As an additional complication, testing WebRTC
applications is challenging due to the heteroge-
neous nature of the networks to be traversed in
order to enable P2P communication. Some prob-
lems include clients consuming media behind a
NAT or a firewall. As a result, WebRTC services
involve complex, distributed and heterogeneous
network topologies where failures or inefficiencies
may prevent the service from providing a success-
ful user experience.
All in all, creating reliable and automated tests
for WebRTC applications, services and infrastruc-
tures is a task that cannot be performed in a
simple way based on commonly available state-
of-the-art DevOps tools and methodologies. In
this article, we contribute a solution to this prob-
lem, proposing both a strategy and technologi-
cal toolbox that are suitable for the automated
Boni García, Francisco Gortázar, Luis López-Fernández, Micael Gallego, and Miguel París
REALTIME COMMUNICATIONS IN THE WEB
The authors are with the Universidad Rey Juan Carlos.
WebRTC Testing:
Challenges and Practical Solutions
Digital Object Identifier:
10.1109/MCOMSTD.2017.1700005
资源评论
码流怪侠
- 粉丝: 2w+
- 资源: 301
最新资源
- 齿轮盖自动组装sw18可编辑全套技术资料100%好用.zip
- comsol辐射不对称BIC 远场赝极化物理表征
- 基于SpringBoot+vue的高校学科竞赛平台.zip
- 毕业设计python医用耗材网上申领系统(源代码+全套毕业文档).zip
- comsol仿真径向偏振光，角向偏振光
- 5.词汇中英文对照表Journey+to+the+West+266页.pdf
- 导套自动供料机sw18可编辑全套技术资料100%好用.zip
- 基于SpringBoot+mybatis的足球青训俱乐部管理后台系统.zip
- 图片生成视频-PixVerseV3.5
- 自动驾驶实时轨迹规划，2022 ICRA 的一个文章复现（顶级机器人会议），参考文档 采用速度路径解耦的方式，linux系统ros，提供场景和源马171（apollo路径规划，autoware路径规
- 大枣烘干机sw16可编辑全套技术资料100%好用.zip
- 14mΩ、1200V耐压 碳化硅MOSFET TO247-4封装
- Python自动化安装
- TESSY 测试 + polySpace 使用教程
- Matlab Simulink：两级式光伏并网系统（光伏板+boost变器+LCL逆变器+电网) 组成部分及功能： 1.主电路：由光伏板+boost变器+LCL逆变器+电网组成，电网电压相电压有效值2
- 307.基于SpringBoot的图书管理系统.zip
资源上传下载、课程学习等过程中有任何疑问或建议，欢迎提出宝贵意见哦~我们会及时处理！
点击此处反馈
