P1: IML/FFX P2: IML/FFX QC: IML/FFX T1: IML
MOBK019-FM MOBK019-Kehtarnavaz.cls May 9, 2006 16:51
Real-Time Image and Video
Processing: From Research
to Reality
P1: IML/FFX P2: IML/FFX QC: IML/FFX T1: IML
MOBK019-FM MOBK019-Kehtarnavaz.cls May 9, 2006 16:51
Copyright © 2006 by Morgan & Claypool
All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in
any form or by any means—electronic, mechanical, photocopy, recording, or any other except for brief quotations
in printed reviews, without the prior permission of the publisher.
Real-Time Image and Video Processing: From Research to Reality
Nasser Kehtarnavaz and Mark Gamadia
www.morganclaypool.com
1598290525 paper Kehtarnavaz/Gamadia Real-Time Image and Video Processing
1598290533 ebook Kehtarnavaz/Gamadia Real-Time Image and Video Processing
DOI 10.2200/S00021ED1V01Y200604IVM005
A Publication in the Morgan & Claypool Publishers’
SYNTHESIS LECTURES ON IMAGE, VIDEO & MULTIMEDIA PROCESSING
Lecture #5
First Edition
10987654321
Printed in the United States of America
P1: IML/FFX P2: IML/FFX QC: IML/FFX T1: IML
MOBK019-FM MOBK019-Kehtarnavaz.cls May 9, 2006 16:51
Real-Time Image and Video
Processing: From Research
to Reality
Nasser Kehtarnavaz and Mark Gamadia
University of Texas at Dallas, USA
SYNTHESIS LECTURES ON IMAGE, VIDEO & MULTIMEDIA PROCESSING #5
M
&C
Morgan
&
Claypool Publishers
P1: IML/FFX P2: IML/FFX QC: IML/FFX T1: IML
MOBK019-FM MOBK019-Kehtarnavaz.cls May 9, 2006 16:51
iv
ABSTRACT
This book presents an overview of the guidelines and strategies for transitioning an image
or video processing algorithm from a research environment into a real-time constrained en-
vironment. Such guidelines and strategies are scattered in the literature of various disciplines
including image processing, computer engineering, and software engineering, and thus have
not previously appeared in one place. By bringing these strategies into one place, the book is
intended to serve the greater community of researchers, practicing engineers, industrial profes-
sionals, who are interested in taking an image or video processing algorithm from a research
environment to an actual real-time implementation on a resource constrained hardware plat-
form. These strategies consist of algorithm simplifications, hardware architectures, and software
methods. Throughout the book, carefully selected representative examples from the literature
are presented to illustrate the discussed concepts. After reading the book, the readers are exposed
to a wide variety of techniques and tools, which they can then employ for designing a real-time
image or video processing system of interest.
KEYWORDS
Real-time image and video processing, Real-time implementation strategies, Algorithmic sim-
plifications for real-time image and video processing, Hardware platforms for real-time image
and video processing, Software methods for real-time image and video processing
P1: IML/FFX P2: IML/FFX QC: IML/FFX T1: IML
MOBK019-FM MOBK019-Kehtarnavaz.cls May 9, 2006 16:51
v
Contents
1. Real-Time Image and Video Processing Concepts . ..............................1
1.1 Introduction .............................................................1
1.2 Parallelism in Image/Video Processing Operations...........................1
1.2.1 Low-Level Operations ............................................3
1.2.2 Intermediate-Level Operations.....................................4
1.2.3 High-Level Operations............................................5
1.2.4 Matrix–Vector Operations .........................................5
1.3 Diversity of Operations in Image/Video Processing ..........................5
1.4 Definition of “Real-Time”.................................................6
1.4.1 Real-time in Perceptual Sense ......................................6
1.4.2 Real-time in Software Engineering Sense ...........................7
1.4.3 Real-time in Signal Processing Sense ...............................8
1.4.4 Misinterpretation of Concept of Real-time ..........................8
1.4.5 Challenges in Real-time Image/Video Processing ....................9
1.5 Historical Perspective .....................................................9
1.5.1 History of Image/Video Processing Hardware Platforms..............9
1.5.2 Growth in Applications of Real-time Image/Video Processing .......11
1.6 Trade-Off Decisions ....................................................11
1.7 Chapter Breakdown .....................................................12
2. Algorithm Simplification Strategies ...........................................15
2.1 Introduction ............................................................15
2.2 Core Simplification Concepts ............................................16
2.2.1 Reduction in Number of Operations ...............................16
2.2.2 Reduction in Amount of Data ....................................18
2.2.3 Simplified Algorithms. . . .........................................19
2.3 Examples of Simplifications ..............................................19
2.3.1 Reduction in Number of Operations ...............................20
2.3.2 Reduction of Data ...............................................24
2.3.3 Simple Algorithms...............................................29
2.4 Summary ...............................................................31
