1 INTERNATIONAL ORGANISATION FOR STANDARDISATION
2 ORGANISATION INTERNATIONALE DE NORMALISATION
3 ISO/IEC JTC1/SC29/WG11
4 CODING OF MOVING PICTURES AND ASSOCIATED AUDIO
5 ISO/IEC JTC1/SC29/WG11 Nxxxx
6
7
8
9 INFORMATION TECHNOLOGY -
10 GENERIC CODING OF MOVING PICTURES AND
11 ASSOCIATED AUDIO INFORMATION: VIDEO
12 Recommendation ITU-TÊH.262
13 ISO/IEC 13818-2
14 Draft International Standard
15 Draft of:11 November 94 9:00:007 November 94 0:19:00
Draft International Standard ISO/IEC 13818-2
(11 November 94 9:00:00)Draft Recommendation ITU-TÊH.262 ITU-T Draft Rec. H.262 i
1 CONTENTS
2 CONTENTS ...................................................................................................................i
3 Foreword.........................................................................................................................iii
4 I Introduction.....................................................................................................................iv
5 I.1 Purpose ....................................................................................................................iv
6 I.2 Application ..............................................................................................................iv
7 I.3 Profiles and levels....................................................................................................iv
8 I.4 The scalable and the non-scalable syntax................................................................v
9 1 Scope...............................................................................................................................1
10 2 Normative references......................................................................................................1
11 3 Definitions ......................................................................................................................2
12 4 Abbreviations and symbols.............................................................................................8
13 4.1 Arithmetic operators................................................................................................8
14 4.2 Logical operators.....................................................................................................8
15 4.3 Relational operators.................................................................................................8
16 4.4 Bitwise operators.....................................................................................................9
17 4.5 Assignment..............................................................................................................9
18 4.6 Mnemonics ..............................................................................................................9
19 4.7 Constants .................................................................................................................9
20 5 Conventions ....................................................................................................................10
21 5.1 Method of describing bitstream syntax ...................................................................10
22 5.2 Definition of functions ............................................................................................11
23 5.3 Reserved, forbidden and marker_bit .......................................................................11
24 5.4 Arithmetic precision ................................................................................................11
25 6 Video bitstream syntax and semantics............................................................................13
26 6.1 Structure of coded video data..................................................................................13
27 6.2 Video bitstream syntax............................................................................................25
28 6.3 Video bitstream semantics.......................................................................................39
29 7 The video decoding process............................................................................................63
30 7.1 Higher syntactic structures ......................................................................................63
31 7.2 Variable length decoding.........................................................................................64
32 7.3 Inverse scan .............................................................................................................67
33 7.4 Inverse quantisation.................................................................................................68
34 7.5 Inverse DCT ............................................................................................................73
35 7.6 Motion compensation ..............................................................................................73
36 7.7 Spatial scalability.....................................................................................................90
37 7.8 SNR scalability........................................................................................................103
38 7.9 Temporal scalability ................................................................................................109
39 7.10 Data partitioning......................................................................................................113
40 7.11 Hybrid scalability ....................................................................................................115
41 7.12 Output of the decoding process ...............................................................................116
42 8 Profiles and levels...........................................................................................................119
43 8.1 ISO/IEC 11172-2 compatibility ..............................................................................120
44 8.2 Relationship between defined profiles ....................................................................120
45 8.3 Relationship between defined levels .......................................................................122
46 8.4 Scalable layers.........................................................................................................123
47 8.4.1 Permissible layer combinations...............................................................................124
48 8.5 Parameter values for defined profiles, levels and layers .........................................126
49 Annex A Discrete cosine transform...............................................................................131
50 Annex B Variable length code tables ............................................................................132
51 B.1 Macroblock addressing............................................................................................132
52 B.2 Macroblock type......................................................................................................133
53 B.3 Macroblock pattern..................................................................................................138
54 B.4 Motion vectors.........................................................................................................139
55 B.5 DCT coefficients .....................................................................................................140
56 Annex C Video buffering verifier..................................................................................149
57 Annex D Features supported by the algorithm..............................................................154
ISO/IEC 13818-2 Draft International Standard
ii Draft Recommendation ITU-TÊH.262 ITU-T Draft Rec. H.262(11 November 94 9:00:00)
1 D.1 Overview .................................................................................................................154
2 D.2 Video formats ..........................................................................................................154
3 D.3 Picture quality..........................................................................................................155
4 D.4 Data rate control ......................................................................................................155
5 D.5 Low delay mode ......................................................................................................156
6 D.6 Random access/channel hopping.............................................................................156
7 D.7 Scalability................................................................................................................156
8 D.8 Compatibility...........................................................................................................164
9 D.9 Differences between this specification and ISO/IECÊ11172-2 ..............................164
10 D.10 Complexity ..............................................................................................................167
11 D.11 Editing encoded bitstreams......................................................................................167
12 D.12 Trick modes.............................................................................................................167
13 D.13 Error resilience ........................................................................................................169
14 Annex E Profile and level restrictions...........................................................................178
15 E.1 Syntax element restrictions in profiles ....................................................................178
16 E.2 Permissible layer combinations (see 8.4.1) ............................................................189
17 Annex F Patent statements.............................................................................................192
18 Annex G Bibliography...................................................................................................194
Draft International Standard ISO/IEC 13818-2
(11 November 94 9:00:00)Draft Recommendation ITU-TÊH.262 ITU-T Draft Rec. H.262 iii
1 Foreword
2 The ITU-T (the ITU Telecommunication Standardisation Sector) is a permanent organ of the
3 International Telecommunications Union (ITU). The ITU-T is responsible for studying technical,
4 operating and tariff questions and issuing Recommendations on them with a view to developing
5 telecommunication standards on a world-wide basis.
6 The World Telecommunication Standardisation Conference, which meets every four years, establishes
7 the program of work arising from the review of existing questions and new questions among other
8 things. The approval of new or revised Recommendations by members of the ITU-T is covered by the
9 procedure laid down in the ITU-T Resolution No. 1 (Helsinki 1993). The proposal for
10 Recommendation is accepted if 70% or more of the replies from members indicate approval.
11 ISO (the International Organisation for Standardisation) and IEC (the International Electrotechnical
12 Commission) form the specialised system for world-wide standardisation. National Bodies that are
13 members of ISO and IEC participate in the development of International Standards through technical
14 committees established by the respective organisation to deal with particular fields of technical
15 activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
16 international organisations, governmental and non-governmental, in liaison with ISO and IEC, also
17 take part in the work.
18 In the field of information technology, ISO and IEC have established a joint technical committee,
19 ISO/IEC JTC1. Draft International Standards adopted by the joint technical committee are circulated
20 to national bodies for voting. Publication as an International Standard requires approval by at least
21 75% of the national bodies casting a vote.
22 This specification is a committee draft that is being submitted for approval to the ITU-T, ISO-
23 IEC/JTC1 SC29. It was prepared jointly by SC29/WG11, also known as MPEG (Moving Pictures
24 Expert Group), and the Experts Group for ATM Video Coding in the ITU-T SG15. MPEG was formed
25 in 1988 to establish standards for coding of moving pictures and associated audio for various
26 applications such as digital storage media, distribution and communication. The Experts Group for
27 ATM Video Coding was formed in 1990 to develop video coding standard(s) appropriate for B-ISDN
28 using ATM transport.
29 In this specification Annex A, Annex B and Annex C contain normative requirements and are an
30 integral part of this specification. Annex D, Annex E, Annex F and Annex G are informative and
31 contain no normative requirements.
32 ISO/IEC
33 This International Standard is published in four Parts.
34 13818-1 systems Ñ specifies the system coding of the specification. It defines a multiplexed
35 structure for combining audio and video data and means of representing the
36 timing information needed to replay synchronised sequences in real-time.
37 13818-2 video Ñ specifies the coded representation of video data and the decoding process
38 required to reconstruct pictures.
39 13818-3 audio Ñ specifies the coded representation of audio data.
40 13818-4 conformanceÑ specifies the procedures for determining the characteristics of coded
41 bitstreams and for testing compliance with the requirements stated in
42 13818-1, 13818-2 and 13818-3.
ISO/IEC 13818-2 Draft International Standard
iv Draft Recommendation ITU-TÊH.262 ITU-T Draft Rec. H.262(11 November 94 9:00:00)
1 I Introduction
2 I.1 Purpose
3 This Part of this specification was developed in response to the growing need for a generic coding
4 method of moving pictures and of associated sound for various applications such as digital storage
5 media, television broadcasting and communication. The use of this specification means that motion
6 video can be manipulated as a form of computer data and can be stored on various storage media,
7 transmitted and received over existing and future networks and distributed on existing and future
8 broadcasting channels.
9 I.2 Application
10 The applications of this specification cover, but are not limited to, such areas as listed below:
11 BSS Broadcasting Satellite Service (to the home)
12 CATV Cable TV Distribution on optical networks, copper, etc.
13 CDAD Cable Digital Audio Distribution
14 DSAB Digital SoundAudio Broadcasting (terrestrial and satellite broadcasting)
15 DTTB Digital Terrestrial Television Broadcasting
16 EC Electronic Cinema
17 ENG Electronic News Gathering (including SNG, Satellite News Gathering)
18 FSS Fixed Satellite Service (e.g. to head ends)
19 HTT Home Television Theatre
20 IPC Interpersonal Communications (videoconferencing, videophone, etc.)
21 ISM Interactive Storage Media (optical disks, etc.)
22 MMM Multimedia Mailing
23 NCA News and Current Affairs
24 NDB Networked Database Services (via ATM, etc.)
25 RVS Remote Video Surveillance
26 SSM Serial Storage Media (digital VTR, etc.)
27 I.3 Profiles and levels
28 This specification is intended to be generic in the sense that it serves a wide range of applications,
29 bitrates, resolutions, qualities and services. Applications should cover, among other things, digital
30 storage media, television broadcasting and communications. In the course of creating this
31 specification, various requirements from typical applications have been considered, necessary
32 algorithmic elements have been developed, and they have been integrated into a single syntax. Hence
33 this specification will facilitate the bitstream interchange among different applications.
34 Considering the practicality of implementing the full syntax of this specification, however, a limited
35 number of subsets of the syntax are also stipulated by means of "profile" and "level". These and other
36 related terms are formally defined in clauseÊ 3 of this specification.
37 A ÒprofileÓ is a defined subset of the entire bitstream syntax that is defined by this specification.
38 Within the bounds imposed by the syntax of a given profile it is still possible to require a very large
39 variation in the performance of encoders and decoders depending upon the values taken by parameters
40 in the bitstream. For instance it is possible to specify frame sizes as large as (approximately) 2
14
