AbstractHigh Efficiency Video Coding (HEVC) is a recently

developed video coding standard by Joint Collaborative Team on

Video Coding (JCT-VC). It proves coding efficiency about half in
point of bit rate reduction compared with H.264/MPEG-4 AVC. In
transform process of HEVC, there is skip mode only for 4x4 transform
blocks; however, for screen contents, it is helpful to extend transform
block size for transform skip and has great coding performance. In this
paper, we proposed early termination scheme for transform skip mode
and scan order modification for computational time. The experimental
results show 9% ~ 16% of saving time with small BD-PSNR loss.

KeywordsTransform skip mode, discrete cosine transform, high
efficiency video coding, HEVC.
I. INTRODUCTION
ITH the popularity and the demand of high resolution
video increased rapidly, new video codec technologies
which has better coding efficiency than H.264/MPEG-4 AVC
[1] proposed for past few years. Finally, as the successor of
H.264/MPEG-4 AVC, the high efficiency video coding
(HEVC) [2] was recently finalized by the Joint Collaborative
Team on Video Coding (JCT-VC) consists of members in
ISO/IEC MPEG and ITU-T VCEG. HEVC performs half
bit-rate reduction compared to H.264/MPEG-4 AVC High
Profile with the similar subjective video quality. The main
difference between H.264/MPEG-4 AVC and HEVC is the
basic unit of coding structure. H.264/MPEG-4 AVC utilize only
16x16 blocks which has fixed block size regardless of video
characteristics. However, HEVC uses basic units with variable
block size (8x8 to 64x64) which can adaptively encode the high
resolution video [3]. A coding tree unit (CTU) has three coding
tree blocks (CTBs) that are one luma and two chroma
components and has the related syntax elements. HEVC divide
CTU to coding units (CUs) employed quadtree structure, and

This research was supported by the MSIP (Ministry of Science, ICT &
Future Planning), Korea, under the ITRC(Information Technology Research
Center) support program supervised by the NIPA(National IT Industry
Promotion Agency)" (NIPA-2013-H0301-13-1011).
D. Lee is with the Department of Electronics and Computer Engineering,
Hanyang University, 222, Wangsimni-ro, Seongdong-gu, Seoul, Korea (e-mail:
dky1006@gmail.com).
H. Kim is with the Department of Electronics and Computer Engineering,
Hanyang University, 222, Wangsimni-ro, Seongdong-gu, Seoul, Korea
(e-mail: khd1207@gmail.com).
J. Jeong is with the Department of Electronics and Computer Engineering,
Hanyang University, 222, Wangsimni-ro, Seongdong-gu, Seoul, Korea
(corresponding author to provide phone: +82-2-2220-4369;
e-mail:jjeong@hanyang.ac.kr).
CUs also can be separated into multiple prediction units (PUs)
and transform units (TUs). PU is basic unit of prediction
(intra-picture prediction and inter-picture prediction) and it is
specified by splitting types. For each TU, integer transform
based on DCT (discrete cosine transform) and quantization is
applied. TU can be divided into half size of TUs followed by
residual quadtree (RQT). The best sizes and modes for each
CTU are determined by rate-distortion cost (RD cost), and
HEVC finally can get bit-streams to binarize and entropy-code
with transform coefficients.
The remainder part of this paper is organized as follows.
Section II describes properties of DCT and technologies for
transform skip mode (TSM). The proposed algorithm for TSM
is specified in Section III. Experimental results and analysis are
shown in Section IV. Finally, we conclude our proposed
algorithms in Section V.
II. BACKGROUNDS
A. Properties of Discrete Cosine Transform
For signal processing and image compression, one of the
most commonly used transform method is DCT. Since the
cosine transform has outstanding energy compaction for highly
correlated signals like images and video sequences, DCT yields
great coding performance with video codec [4].


Fig. 1 Basis functions of DCT

As shown in Fig. 1, a basis function of left-upper position
represents direct current (DC) component and right-bottom
bases of DCT are high-frequency components in 8x8 block
image. Also, first row of basis function represents vertical edges
and first column shows horizontal edges. If the most of DCT
coefficients congregate at nearby DC component, we can easily
compress images with quantization which removes relatively
Early termination of transform skip mode for
High Efficiency Video Coding
Do-Kyung Lee, Miso Park, Hyung-Do Kim and Je-Chang Jeong
W

Proceedings of the 2014 International Conference on Communications, Signal Processing and Computers
ISBN: 978-1-61804-215-6 177


small amount of high-frequencies.


Fig. 2 Transform coefficient for complex region and flat region

For example, 8x8 DCT coefficients for screen contents are
described in Fig. 2, and the test sequence is
SlideEditing_1280x720 that has flat regions and also has high
frequency region like text and menu icons. In complex region,
coefficients spread out whole area except DC, and relatively
more distributed in high frequency region than low frequency
region. It is not efficient to apply DCT transform to this
complex area for video codec because there is lots of important
information on high frequency region. On the contrary, in flat
region, whole energy of the block concentrates only DC
component and we can simply disregard the rest of coefficients.

B. Transform Skip Techniques for HEVC
When the development of HEVC is in progress, a lot of
experts contributed proposals about transform techniques with
experimental results. Especially, proposals about transform skip
method have been the focused for screen contents which is high
resolution video sequences of playing computer games, editing
documents and remote access. Therefore, transform skip for
codec was adopted in HEVC to increase the coding efficiency
for screen contents.
At 6
th
meeting of JCT-VC in Torino, Italy, M. Mrak with
British Broadcasting Corporation (BBC) contributed proposal
document was about transform skip mode [5]. It is about
skipping row or column transforms or both of transforms based
on RD cost, and they implemented it in HM3.2 for intra-coded
blocks. They got gains of 0.2% BD-rate average for all intra
coded configurations.
C. Lan of Xidian Univ. proposed transform skipping
technique at 9
th
meeting hold in Geneva [6]. They apply
transform skip method only for 4x4 intra predicted TU and,
based on RD-cost, HM selects transform skip mode or 44
DCT. Intra transform skipping has a great coding performance
for screen contents test sequences which is Class F and they
have small gains for Class A, B, C, D and E.
X. Peng with Microsoft and Xidian Univ. extends intra
transform skipping of C. Lans method to inter coded blocks [7].
It is applied only for 4x4 TU and there are no changes in motion
estimation and compensation, quantization, de-blocking filter
and entropy coding. For Class F, they obtained gains about
1.8% for random access and 3.0% for low delay.
For HEVC range extension, X. Peng contributes a technique
to transform skip at large size TU [8]. The author experiments
transform skip for large size TU, i.e., 8x8, 16x16 and 32x32 at
HM10.1_RExt3.0 anchor. For Class F and screen contents of
4-4-4 color format, the technique led to 0.9% ~ 2% BD-BR gain.
Although there is coding efficiency; however, it is inevitable
increasing encoding time. Since the time consumption of HM
encoder and decoder has been one of the important issues of
HEVC standardization, we study a novel attempt for early
termination of TSM.
III. PROPOSED ALGORITHMS
A. Early Termination of Transform Skip Mode
The main idea is based on the assumption that if the
magnitude of high frequency coefficients is larger than low
frequency coefficients, the traditional transform technique for
the video codec is not efficient to compress video sequences, as
we mentioned in Section II-A.


(a)


(b)
Fig.3 Partition of DC and AC area for 8x8 TU (a) and 16x16 TU (b)

To calculate magnitudes of DC and AC area, we use absolute
sum of each coefficients because DCT coefficients can have
both of positive and negative number. First, we pre-check
energy of AC area as follows:

Proceedings of the 2014 International Conference on Communications, Signal Processing and Computers
ISBN: 978-1-61804-215-6 178


1 2 3
( , ) , ,
_ _ ( , )
x y ac ac ac
sum abs ac coeff x y

.
(1)

coeff(x,y) means DCT coefficient located (x, y), and (x, y) is
relative location of left-upper coefficient of TU. ac
1
, ac
2
, ac
3

have 4 coefficients respectively and located corner areas as
shown in Fig. 3 (a) and (b). The reason why we firstly calculate
these areas is that, in complex region, there are tendencies of
DCT coefficients are gathered at each corner of ACs, as shown
in Fig. 2. If sum_abs_ac equal to zero, we do not apply
transform skip mode to current TU and if it is not, we calculate
absolute sum of DC and AC regions by

( , )
_ _ ( , )
x y DC
sum abs DC coeff x y

(2)
( , )
_ _ ( , )
i
i
x y AC
sum abs AC coeff x y

.
1, 2, 3 for i
(3)

If sum_abs_DC is larger than accumulated sum_abs_AC
i
,
TSM is not applied for current TU because energy compaction
of current block is suitable for DCT. Otherwise, we add TSM as
a candidate of DCT mode and determine the best mode by
comparing RD-cost.

B. Scan Order Modification
For more speed enhancement, we modify scan patterns when
we calculate sum of absolute values, following characteristics of
coefficients.


Fig. 4 Scan order for early termination

The scan order is described in Fig. 4. The order of AC part is
AC
3
, AC
1
and AC
2
, and it is determined experimentally. For
each of AC
i
, the scan order is followed by arrows; since, the ac
1
,
ac
2
, ac
3
part have larger coefficients than others at edges and
text. Finally, we compare sum_abs_DC with accumulated
sum_abs_AC
i
as soon as the calculation of one row or column of
AC
i
is finished. If sum_abs_AC
i
is larger than sum_abs_DC,
TSM is added to DCT of HEVC. The entire procedure of
proposed algorithm is described in Fig. 5.


Fig. 5 Flowchart for proposed algorithms

IV. EXPERIMENTAL RESULTS
The proposed early termination method for transform skip
mode is implemented in HM 12.0. We utilize the data set used
for the HEVC standard development and additionally, for
screen contents, we make our test sequences which are ICSP
test1 and ICSP test3, as shown in Fig. 6 and Fig. 7. For
experiments, all intra (AI) configuration of HEVC Main Profile
is used, and largest coding unit size is 64x64 and QP = 22, 27,
32 and 37. As a measure of consuming time, Time is defined
as follows,

(%)
( ( 12.0) ( ))
1 .
( 12.0)
Time
Time HM Time proposed method
Time HM

(4)

Table 1. Experimental results for proposed algorithms
BD-BR BD-PSNR Time BD-BR BD-PSNR Time
Average -0.790 0.103 108% -0.790 0.103 106%
Sequences
ET_TSM + SOM (MAX_TS =8) ET_TSM (MAX_TS =8)
104%
ChinaSpeed -0.655 0.060 -0.655 0.060
BasketballDrillText -0.164 0.009 -0.164 0.009
106%
108%
109%
0.129 106%
ICSP test3 -0.934 0.128 -0.934 0.128 107%
ICSP test1 -0.906 0.129 -0.906 108%
109%
SlideEditing -1.462 0.235 -1.462
SlideShow -0.616 0.057 -0.616 103%
109%
0.057 105%
0.235 112%



Proceedings of the 2014 International Conference on Communications, Signal Processing and Computers
ISBN: 978-1-61804-215-6 179


MAX_TS means maximum size of TU for transform skip,
and if MAX_TS is set to 8, we allow TSM for 4x4 and 8x8 TUs.
The experimental results for proposed algorithms are
summarized in Table 1, and it compared with HM 12.0. Early
termination for TSM (ET_TSM) has better coding efficiency in
point of BD-bitrate (BD-BR) and BD-peak-to-noise-ratio
(PSNR). The average Y-PSNR increased 0.103 dB and bit-rate
decreased 0.790 % with increasing time consuming. However,
we improve computation complexity of proposed algorithms by
the scan order modification (SOM) method. As we can be seen
in Table 1, ET_TSM + SOM reduce encoding time without any
loss of coding efficiency.
In Table 2, whole proposed algorithms (ET_TSM + SOM)
are compared with HM12.0 (MAX_TS is set to 8 and 16). HM
with extension of TSM and proposed algorithm both have good
coding efficiency for Class F (screen contents). Proposed
algorithm reduces computational complexity about 9% ~ 14%
compared with HM with small BD-rate loss.
V. CONCLUSIONS
In this paper, we proposed algorithms for TSM of HEVC
transform coding. The proposed algorithm consisted of early
termination of TSM and scan order modification for speed
improvement reduce computation time of HM encoder with
extension of TSM. Using characteristics of DCT coefficients,
we can efficiently selects whether TSM is applied for HM or not,
and by changing scan order of calculating sum of absolute
values, we also save computational time of transform process of
HM. Therefore, our proposed algorithms are efficient for screen
contents and its application.
REFERENCES
[1] T. Wiegand, G. J. Sullivan, G. Bjntegaard, and A. Luthra, Overview of
the H.264/AVC video coding standard, IEEE Trans. Circuits Syst.
Video Technol., vol. 13, no. 7, pp. 560576, Jul. 2003.
[2] B. Bross, W.-J. Han, G. J. Sullivan, J.-R. Ohm, and T. Wiegand, High
Efficiency Video Coding (HEVC) Text Specification Draft 10, document
JCTVC-L1003, ITU-T/ISO/IEC Joint Collaborative Team on Video
Coding (JCT-VC), Jan. 2012.
[3] G. J. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, Overview of the
Table 2. Experimental results for proposed algorithms
BD-rate BD-PSNR Time BD-rate BD-PSNR Time BD-rate BD-PSNR Time BD-rate BD-PSNR Time
NebutaFestival -0.009 0.001 117% -0.012 0.0009 126% -0.007 0.001 102% -0.009 0.001 108%
PeopleOnStreet -0.070 0.004 118% -0.080 0.0046 127% -0.029 0.002 107% -0.033 0.002 118%
SteamLocomotiveTrain -0.004 0.000 118% 0.001 0.0000 126% 0.004 0.000 107% 0.002 0.000 109%
Traffic -0.016 0.001 117% -0.024 0.0013 125% -0.002 0.000 107% -0.001 0.000 95%
BasketballDrive -0.046 0.001 115% -0.064 0.0019 123% -0.036 0.001 109% -0.018 0.001 111%
BQTerrace -0.157 0.009 118% -0.183 0.0102 125% -0.085 0.005 109% -0.093 0.005 109%
Cactus -0.102 0.004 117% -0.109 0.0040 125% -0.045 0.002 108% -0.050 0.002 109%
Kimono -0.013 0.000 116% -0.004 0.0002 124% -0.004 0.000 107% -0.004 0.000 108%
ParkScene -0.048 0.002 118% -0.050 0.0023 125% -0.014 0.001 107% -0.014 0.001 108%
BasketballDrill -0.246 0.012 116% -0.253 0.0123 125% -0.127 0.006 108% -0.153 0.007 109%
BQMall -0.149 0.009 117% -0.161 0.0096 126% -0.083 0.005 109% -0.083 0.005 111%
PartyScene -0.230 0.018 122% -0.249 0.0192 128% -0.155 0.012 110% -0.155 0.012 112%
RaceHorses -0.122 0.008 117% -0.119 0.0081 125% -0.073 0.005 109% -0.070 0.005 110%
BasketballPass -0.152 0.009 118% -0.162 0.0095 125% -0.078 0.005 108% -0.074 0.004 110%
BQ Square -0.128 0.008 120% -0.122 0.0074 129% -0.071 0.004 109% -0.066 0.004 110%
BlowingBubbles -0.283 0.025 118% -0.289 0.0260 127% -0.142 0.013 111% -0.169 0.015 113%
RaceHorses -0.063 0.004 118% -0.068 0.0047 127% 0.005 -0.001 109% 0.002 -0.001 109%
FourPeople -0.033 0.002 116% -0.025 0.0015 124% 0.016 -0.001 108% 0.018 -0.001 109%
Johnny -0.081 0.003 113% -0.123 0.0050 120% -0.025 0.001 108% -0.020 0.001 110%
KristenAndSara -0.073 0.004 114% -0.095 0.0048 122% -0.015 0.001 108% -0.020 0.001 111%
BasketballDrillText -0.305 0.016 117% -0.318 0.0168 124% -0.135 0.007 108% -0.131 0.007 109%
ChinaSpeed -0.902 0.083 115% -1.007 0.0926 122% -0.677 0.062 109% -0.743 0.068 111%
ICSP test1 -1.856 0.265 115% -2.158 0.3077 120% -0.933 0.133 110% -0.955 0.136 111%
ICSP test3 -1.595 0.218 114% -1.833 0.2494 120% -0.906 0.124 110% -0.968 0.132 112%
SlideEditing -2.193 0.352 116% -2.537 0.4072 123% -1.438 0.231 113% -1.678 0.271 116%
SlideShow -0.806 0.075 113% -0.875 0.0815 117% -0.614 0.057 107% -0.562 0.052 108%
-0.297 0.033 117% -0.334 0.0377 124% -0.170 0.020 108% -0.181 0.021 110%
MAX_TS =8 Proposed (MAX_TS =16) Proposed (MAX_TS =8) MAX_TS =16
Class A
2560x1600
Classes Test Sequences
Class B
1920x1080
OverallAverage
Class C
WVGA
Class E
720p
Class F'
(Screen
Contents)
Class D
WQVGA




Fig. 6 Screen shot of ICSP test1


Fig. 7 Screen shot of ICSP test3

Proceedings of the 2014 International Conference on Communications, Signal Processing and Computers
ISBN: 978-1-61804-215-6 180


High Efficiency Video Coding (HEVC) standard, IEEE Trans. Circuits
Syst. Video Technol., vol. 22, no. 12, pp. 16481667, Dec. 2012.
[4] Anil K. Jain, Fundamentals of digital image processing, Prentice hall,
1989, 1st ed. pp. 150-154.
[5] M. Mrak, and A. Gabrellini, Transform skip mode, JCTVC-F077, Torino,
Italy, July, 2011.
[6] C. Lan, Intra transform skipping, JCTVC-I0408, Geneva, Switzerland,
May, 2012.
[7] X. Peng, Inter transform skipping, JCTVC-J0237, Stockholm, Sweden,
July, 2012.
[8] X. Peng, Non-RCE2: Transform skip on large TUs, JCTVC-N0288,
Vienna, Austria, July, 2013.

Do-Kyung Lee received a B.S degree from the School of Electrical
Engineering College of Engineering Chung-Ang University, Korea, in 2010.
He is currently puersuing a Ph. D. candidate in Electronic and Computer
Engineering at Hanyang University. His research interests include fast motion
estimation, true motion estimation and video codec.
Miso Park received a B.S degree the Department of Electronics and Computer
Engineering from Hanyang University, Korea, in 2013. She is currently
pursuing a M.S in Electronic and Computer Engineering at Hanyang
University. Her research interests include video processing, and high efficiency
video codec.
Hyung-Do Kim received a B.S degree the Department of Electronics and
Computer Engineering from Hanyang University, Korea, in 2013. He is
currently puersuing a M.S in Electronic and Computer Engineering at Hanyang
University. His research interests include fast motion estimation and video
codec.
Je-Chang Jeong received a BS degree in electronic engineering from Seoul
National University, Korea, in 1980, an MS degree in electrical engineering
from the Korea Advanced Institute of Science and Technology in 1982, and a
PhD degree in electrical engineering from the University of Michigan, Ann
Arbor, in 1990. From 1982 to 1986, he was with the Korean Broadcasting
System, where he helped develop teletext systems. From 1990 to 1991, he
worked as a postdoctoral research associate at the University of Michigan, Ann
Arbor, where he helped to develop various signal-processing algorithms.
From 1991 through 1995, he was with the Samsung Electronics Company,
Korea, where he was involved in the development of HDTV, digital
broadcasting receivers, and other multimedia systems. Since 1995, he has
conducted research at Hanyang University, Seoul, Korea. His research interests
include digital signal processing, digital communication, and image and audio
compression for HDTV and multimedia applications. He has published
numerous technical papers.
Dr. Jeong received the Scientist of the Month award in 1998, from the Ministry
of Science and Technology of Korea, and was the recipient of the 2007 IEEE
Chester Sall Award and 2008 ETRI Journal Paper Award. He was also honored
with a government commendation in 1998 from the Ministry of Information
and Communication of Korea.
Proceedings of the 2014 International Conference on Communications, Signal Processing and Computers
ISBN: 978-1-61804-215-6 181