没有合适的资源?快使用搜索试试~ 我知道了~
温馨提示
内容概要:本文探讨了即将发布的高效视频编码标准Versatile Video Coding(VVC)在消费级硬件上进行实时解码的技术挑战与解决方案。相比前一代标准HEVC,VVC提供了更高的压缩率并引入了许多新的复杂处理步骤。文中具体讨论了针对这些新特性优化的软件解码器的实施方案。重点在于利用单指令多数据流(SIMD)技术加速样本操作,通过多线程方式改进CPU资源分配效率,并展示了该优化后的解码器能够实现实时播放高质量HD/UHD视频的能力。此外还对比了不同优化手段所带来的性能提升,如SSE42和AVX2指令集下各项任务的具体提速效果及其局限性。 适用人群:对于关注下一代视频编码技术和希望将其应用于移动设备或者高性能桌面平台的专业人士非常有价值;特别是从事视频编码标准研究和多媒体应用系统开发的研究人员和技术开发者。 使用场景及目标:该工作的最终目的是确保当新版本发布之后,在普通消费者的终端设备比如智能手机和平板电脑上也可以顺利地支持VVC格式的媒体内容播放示例,从而推动市场接受度以及普及。 其他说明:文中提到的所有测试均基于特定硬件环境(Intel Core i9-9980HK处理器),并且作者也考虑到了未来可能出现的应用情景,比如高分辨率流媒体服务和个人电脑游戏等。
资源推荐
资源详情
资源评论
TOWARDS A LIVE SOFTWARE DECODER IMPLEMENTATION
FOR THE UPCOMING VERSATILE VIDEO CODING (VVC) CODEC
Adam Wieckowski, Gabriel Hege, Christian Bartnik, Christian Lehmann, Christian Stoffers,
Benjamin Bross, and Detlev Marpe
Fraunhofer HHI, Video Coding & Analytics, Berlin, Germany
ABSTRACT
Versatile Video Coding (VVC) is the emerging video coding
standard to be finalized by the Joint Video Experts Team in
July 2020. Compared to its predecessor, the High Efficiency
Video Coding (HEVC) standard, VVC provides 50% bit-rate
reduction at comparable visual quality for natural video con-
tent in high-definition (HD) and ultra high-definition (UHD)
resolution. To achieve this, the standard incorporates more
advanced and generalized algorithms, leading to an increase
in computational complexity. This includes for example ad-
ditional in-loop filters, decoder-side motion refinement and
search as well as an increased number of transforms, which
creates a grand challenge for implementers to achieve live de-
coding on general-purpose CPUs.
In this paper, the work on an efficient software decoder
implementation for the upcoming VVC standard is described,
including optimization of sample operations using single in-
struction multiple data (SIMD) instructions and paralleliza-
tion approaches with multithreading. As a result, the pre-
sented decoder can perform live decoding of 10bit HD video
at 60 frames per second (fps) and 10bit UHD video at 30fps
on modern mobile consumer hardware, showcasing that VVC
live decoding is possible already right before finalization of
the standard.
Index Terms— VVC, software decoding, video coding,
SIMD, AVX2, multi-threading.
1. INTRODUCTION
VVC [1][2] is the emerging new video coding standard
jointly developed by the ITU-T Video Coding Experts Group
(VCEG) and the ISO/IEC Moving Pictures Experts Group
(MPEG), and to be finalized in July 2020. VVC provides 50%
bit-rate reduction over HEVC [3] standard and besides that,
VVC is designed to efficiently cope with even higher resolu-
tion, dynamic range and color gamut as well as with a variety
of different applications. This includes adaptive streaming
use cases with reference picture resampling and tem-
poral/spatial scalability, immersive applications using 360-
degree video, and screen-content coding for gaming and
screen sharing applications. The current state of standard de-
velopment is reflected in the specification draft text [1]. Ac-
companying the draft text is the VVC test model (VTM) [4],
which represents a reference software implementation of an
encoder and decoder. Its main focus is for experiments with
new technology and some coarse complexity analysis [5]. Be-
ing a reference implementation, it targets mainly correctness,
completeness and readability and thus, it is not supposed to
be used in production or consumer systems. For those reasons
the software is not properly optimized for performance. It
only has basic SIMD algorithm implementations, and does
not support any parallelization features on the decoder side.
As the comparison with the HEVC test model (HM) [4]
shows, the decoding complexity of the new standard is going
to be about twice that of HEVC [6]. Based on the times re-
ported in [4], for live play-back of UHD video content up to
40 Mbps, a decoder would on average need to be 30 times as
fast as the reference software, for HD content up to 20 Mbps,
7× speed-up is required. Some previous work is available on
VVC encoding complexity reduction [7-9], but to our
knowledge there is no current work on software decoder com-
plexity reduction.
In this paper, an optimized VVC software decoder im-
plementation is presented. As the standard is still under de-
velopment, the decoder is compatible with VVC draft 5 [1]
and VTM-5.2 with further integration and development work
ongoing, targeting compliance with the final standard shortly
after finalization in summer 2020.
2. VERSATILE VIDEO CODING COMPLEXITY
A schematic visualization of a VVC decoder pipeline is
shown in Fig. 1. It resembles the decoder schematics of an
CABAC iQ & iST & iT iLMCS
DBLF
SAO
ALF
Intra
LMCS
Inter
DPB
+
Input bitstream
Output video
Fig.
1: Schematic of a Versatile Video Coding decoder [
10][11].
New pipeline steps are marked cursive.
Authorized licensed use limited to: Carleton University. Downloaded on November 01,2020 at 23:45:16 UTC from IEEE Xplore. Restrictions apply.
资源评论
码流怪侠
- 粉丝: 2w+
- 资源: 374
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- 【岗位说明】石油企业岗位列表.docx
- 【岗位说明】中石化岗位职责.doc
- 【岗位说明】石油石化PMT岗位职责.doc
- 【岗位说明】石油石化设计管理部部门岗位职责.doc
- 【岗位说明】某石化工艺工程师岗位职责.docx
- 【岗位说明】石化设备部工作职责.docx
- 【岗位说明】石油石化采购管理部部门岗位职责.doc
- 【岗位说明】石油化工建设各工种岗位职责02.docx
- 【岗位说明】椰子鸡商业计划书.docx
- 【岗位说明】中石化员工管理制度.docx
- 【岗位说明】培训专员岗位说明书.doc
- 【岗位说明】HR经理岗位职责.doc
- 【岗位说明】劳动关系专员岗位说明书.doc
- 【岗位说明】HR专员岗位职责书.xls
- 【岗位说明】绩效专员岗位职责01.docx
- 【岗位说明】绩效专员岗位说明书.doc
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功