EE 5356 - Spring 2013

Digital Image Processing

Instructor: Dr.K.R.Rao

Department of Electrical Engineering
(Office): 530 NH
(Phone): (817)272-3478
(E-mail): rao@uta.edu
(Web site): http://www-ee.uta.edu/EEDept/Faculty/rao.htm
(Office hours): M 11AM-1200PM, W 300-400PM

Course Information and Announcements:

Matlab links:

http://www.math.ufl.edu/help/matlab-tutorial/

http://www.math.mtu.edu/~msgocken/intro/node1.html

Interesting links

1) DIP course by Dr. Bernd Girod (EE, Stanford) ( includes an interesting set of projects )

2) Stanford course on "Applied Vision Sciences for Digital Camera"

Packages on Image Processing

1) Image Processing On Line (IPOL)

2) Python Imaging Library (PIL)

3) Open CV

4) Sparse Modeling

First day of classes: January 15 2013.
Spring break : 12 - 16th March 2013.
Last day of classes : 4th May 2013.

Syllabus2013

GTA

Reference books in SEL (06/15/2012)

Video Codec Standards List (01/23/2012)

Current Video Coding Standards (02/03/2012)

Fundamentals of Color Image Processing (02/22/2012)

Important Student Support Services Available:

The University of Texas at Arlington provides a variety of resources and programs designed to help students develop academic skills, deal with personal situations, and better understand concepts and information related to their courses. These resources include tutoring, major-based learning centers, developmental education, advising and mentoring, personal counseling, and federally funded programs. For individualized referrals to resources for any reason, students may contact the Maverick Resource Hotline at 817-272-6107 or visit www.uta.edu/resources for more information.

Midterm and Exams

Test 1, Spring 2012: Possible Questions

Test 2, Spring 2012/ 2013: Possible Questions (1) , Possible Questions(2)

Final Exam, Spring 2012: Possible Questions More Possible Questions- 1 More Possible Questions- 2

Class Notes:

Chapter wise problems from Text-Book ( Dr. A.K. Jain)

Chapter 2: Part1 Part2 Part3 (solutions)

Chapter 4: Note1 Note2 (changes on p. 39a) Note3 (new) Solutions Leibnitz Rule Tables 4.1/4.2 Table4.3

PPT : Image Quantization ( from Technical University of Cluj-Napoca, Romania )

VIDEO: Introduction to Quantization , Lloyd Max Quantizer , (Dr.S N Merhcant, EE, IIT Bombay, India )

Chapter 5:         Note        Solutions
Chapter 7:         Note1      Note2   Note3   Solutions image segmentation
Chapter 8:         Notes1 (changes on page14a,14b,20,21)

Notes2, Notes3, Notes4, Solutions Fig. 5.29 Fig. 5.30/p. 268, Figs. 8.10 &8.12 image restoration pp.463-464, Gonzalez & Woods, Digital Image Processing 2/E, NJ: Prentice Hall, 2002.

Problems Final Solution
Chapter 11: Notes1 Notes2 Notes3 Notes4 Solutions DPCM Predictor Entropy and Huffman Coding HuffmanTree

image compression

Projects (List of projects) (Protocol)

Project no.

Project title

Due date

1	Zooming with Interpolation , Hint	Thu, Jan 31 2013
1A	Lloyd-Max Quantizer for Rayleigh pdf , Hint	Thu, Feb 14 2013
2	Quantization (Pseudocode)	Thu, Feb 21 2013
3	Color Transformation part1 * (Pseudocode)	Thu, Feb 28 2013
3A	Color Transformation part2, Hint (Pseudocode)	Tue, Mar 19 2013
3B	Color Transformation part3 *	Tue, Mar 19 2013
4	Nonlinear filters, Hint	Tue, Mar 19, 2013
4A	DFT, Root & Zonal Filters (Pseudocode)	Sun, Mar 24 2013
5	Histogram equalization, Hint (Link)	Tue, Mar 26, 2013
5A	Inverse Gaussian Filter (IGF) (Expected O/p)	Thu, Mar 28 2013
5B	Low-pass and high-pass filters, Hint	Fri, April 5, 2013
6	Edge Detection	Fri, April 5 2013
6A	Image Bit Planes (DELETED)	Thu, April 4 2013
7	Inverse & Wiener Filtering Hint ( Expected O/p)	Fri, April 12 2013
7A	Constrained Least Squares Restoration	Sat, April 13 2013
7B	Geometric Mean Filter	Sat, April 13 2013
8	2-D DPCM ( Expected O/p+tricks on matlab)	Fri, April 19 2013
9	Lossless Predictive Coding ( Expected O/p)	Sat, April 20 2013
10	Progressive to Interlaced and Interlaced to Progressive conversion (interlaced.doc) ( Expected O/p) ( Pseudocode)	Thu, May 2 2013
11	SSIM Structural similarity index **	Thu, May 2 2013
12	Universal Image Quality Index UIQI theory	Thu, May 2 2013
13	Atmospheric turbulence Project Hint	Thu, May 2 2013

Projects 8-11 Hint

* For projects 3, 3A, and 3B, Hint on color conversion: http://www.cs.rit.edu/~ncs/color/t_convert.html
* For projects 3, 3A, and 3B, please access files, Assig1, Assig2, Assig3, Final and theirs solutions from Digital Video Coding and Compression by Dr. H.R.Wu.

** Hint: access SSIM pp slides by Dr. Zhou Wang.

Late Submission Policy

The penalty for late assignments is -5% per day (pro-rated over 24 hours).
After 10 days late, the deductions cease; the maximum loss of points is 50%. As long as you turn an assignment in by the end of the semester, it could still be worth as much as half-credit. This is to encourage you to eventually complete the assignment, even if you can't get it in on time initially.

P.S : These are individual projects. However discussions, consulting, help with other students and GTA is fine. Projects must not be copied from others. Results, conclusions must be original.

Previous Exams

Spring 2003

Spring 2004

Spring 2006

Spring 2007

Spring 2008

Spring 2009

Spring 2010

Final & sol

Spring 2011

Spring 2012

Spring 2013

Spring 20--

Spring 20--

Exam1 / Solution

Exam2/Solution

Final Exam

Exam 1/ Solution

Exam2/ Solution

Final /Solution

Exam 1/ Solution

Exam 2/ Solution

Test Images

Lena512.bmp (512*512)
Girl.bmp (512*512)
girl256color.zip (raw file) (256*256)
Baboon.bmp (512*512)
Cameraman.bmp (256*256)
Goldhill.bmp (256*256)
Flowers.bmp (500*362)
boat512.gif (512*512)

elaine.512.tiff (512*512)

Video sequences

The following sequences are recorded at 30 fps in YUV, QCIF format (176x144,4:2:0).
Akiyo (300 frames) Foreman (90 frames) Carphone (90 frames)

The following sequences are recorded at 30 fps in YUV, CIF format (352x288,4:2:0).
Foreman (90 frames) Football (90 frames) News (90 frames) Stephan (90 frames)

Useful Papers on SSIM

Z. Wang et al. "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Processing, vol. 13, no. 4, pp.600-612, Apr. 2004.
Z. Wang, E. Simoncelli, and A. Bovik, “Multi-scale structural similarity for image quality assessment,” in Proc. 37th IEEE Asilomar Conf. Signal, Syst. Comput. , Nov. 2003, vol. 2, pp. 1398–1402.
L. Zhang, L. Zhang, X. Mou, and D. Zhang. “FSIM: A feature similarity index for image quality assessment”, IEEE Trans. Image Processing, vol. 20, no. 8, pp. 2378-2386, Aug. 2011.

Files

KLT | KLT2 |KLT3 |KLT4
DFT - Part1 | DFT- Part2
Fast Fourier Transform DFT
DCT1 |DCT2 | DCT3 | DCT4
DST
VQ
DIP references 01/14/2012
DIP review papers 01/14/2012
DIP ieee trans 01/14/2012
1a) MPLBOOKS1, 1b) MPLBOOKS2, 1c) MPLBOOKS3, 1d) MPLBOOKS4 01/21/2012
DIP CD lists 4/2/10 , MPL Facilities 11/24/09
DIP database 4/2/10 Database1(Jan 6 2012), ResearchTopics1 (Jan 6 2012)
Performance criteria
Image quality measures 11/07/07 , ref , BD-PSNR site , BD-PSNR file 10/29/08
Dr.Xin Li's website
Bit allocation matrix 02/05/07
Comparison of discrete transforms 12/19/07
SSIM by Dr. Zhou Wang, UT Arlington 01/28/08
SSIM by AjayKumar (01/19/12)
DPCM comparison of various predictors 02/04/09
DPCM coding part1 (updated 03/09/12) DPCM coding part 2 (updated 03/09/12)
Video codec standards review (04/30/12)
Video codec standards review ppt (06/22/10)
UIQI/SSIM (01/28/12)

File 1, file 2, file 3, file 4, file 5, and file 6, from Professor W.C. Siu, PhD, DIC, CEng, FIEE, FHKIE, SrMIEEE

(Chair Professor and Director Centre for Multimedia Signal Processing

Department of Electronic and Information Engineering, Hong Kong Polytechnic University) 04/09/07

Digital Image Processing Files by Dr. Zhou Wang

Digital Video Coding and Compression by Dr. H.R.Wu
	Notice Outline1 Outline2 Tutorial1 Tutorial2 Tutorial3 Tutorial4 Tutorial5 Tutorial6 Assig1 Assig1sol Assig2 Assig2sol Assig3 Assign3sol Final Finalsol

Digital Image and Video Processing files by Dr. Min Wu

lecture1 - An Introduction
lecture2 - Human Visual Perception
lecture3 - Point Operations
lecture4 - Signal Processing: From 1-D to 2-D (m-D)
lecture5 - Fourier Transform and Spatial Filtering
lecture6 - Edge Detection and Basics on 2-D Random Signal
lecture7 - Image Restoration
lecture8 - Wiener Filtering for Image Restoration & Basics on Image Compression
lecture9 - Quantization
lecture10 - Unitary Transform
lecture11 - Transform Coding and JPEG
lecture12 - Subband and Wavelet Coding
lecture13 - Wavelet Coding and Related Issues
lecture14 - Optimal Bit Allocation and Unitary Transform in Image Compression
lecture15 - Basics on Video Coding
lecture16 - MPEG Video Coding
lecture17 - MPEG Video Coding and Beyond
lecture18 - More on Motion Analysis
lecture19 - Video Content Analysis and Streaming
lecture20 - General Framework & Issues of Image Analysis and Video Streaming
lecture21 - Data Hiding in Images
lecture22 - Image Forensics
lecture23 - Image Forensics & Feature Extraction
lecture24 - Medical Imaging Topic: Radon Transform & Inverse Radon Transf.
lecture25 - Back Projection for Radon Construction and Multi-dimensional Sampling
lecture26 - Lattice Sampling
lecture27 - Texture Analysis and Synthesis

Older files by Dr. Min Wu

Notice 1)An introduction 2)Visual Perception 3)Point Operations 4)Signal Processing
5)F.T. and Spatial Filtering 6)2D Random Signals 7)Image Restoration 8)Image Compression
9)Unitary Transforms 10)JPEG 11)Wavelet Based Image Coding 12)Video Coding and MPEG
13)Video 14)Motion 15)Sampling 16)Data Hiding 17)Medical Imaging

H.264/AVC
	H.264 review H.264 seminar YCgCo Residual Color Transform H.264 standard H.264 systems H.264 FRExt H.264 slides Research topics

Video Coding Standards
	B.Girod, "Overview : Video Coding Standards ", Stanford University Coursework (04/22/10)

Video compression basics by Sanjiv Malik (06/18/10)

http://www.slideshare.net/sanjivmalik/video-compression-basics

The link also includes presentation slides on Video, Image, Audio and Speech codecs

Stanford University's course EE398A : Image and Video Compression
	http://www.stanford.edu/class/ee398a/index.htm - Link to the course web page http://www.stanford.edu/class/ee398a/handouts.htm - Link to course handouts http://www.stanford.edu/class/ee398a/projects/reports/Hampapur_Ni.pdf - A Novel Trained KLT Method for Image Compression - Vinay Raj Hampapur, Wendy Ni http://www.stanford.edu/class/ee398a/projects.htm - List of projects

MPEG-2 video compression

MPEG-2 video compression by Sarnoff corporation 04/13/08
.

Image/Video compression (04/27/07)

http://www.eee.bham.ac.uk/WoolleySI/teaching/4U/index.htm
http://www.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.html
http://www.cvn.columbia.edu/courses/Summer2007/ELENE4830.html
http://web.mit.edu/afs/athena/course/6/6.344/www/Video/teaching_MIT6344.html
http://www.autosophy.com/videcomp.htm
http://www.wave-report.com/tutorials/VC.htm
http://www.bretl.com/mpeghtml/MPEGindex.htm
http://vsr.informatik.tu-chemnitz.de/~jan/MPEG/HTML/mpeg_tech.html

VIDEO LECTURES regarding DIP and DSP from different universities 01/24/08
http://freevideolectures.com/signals.html 　

Tutorial by Iain Richardson

1. 4x4 Transform and Quantization in H.264

You can find lot of video lecture from IIT and IISc

http://nptel.iitm.ac.in/

World wide video lectures

http://freevideolectures.com/

These are major sites and some more are personal website of each professor which would be helpful as well.

UTA Library Resources 01/24/08

SPIE digital library http://spiedigitallibrary.aip.org ,or access through UTA Library 04/11/08

The Proceedings of SPIE – v . 1200, 1990 – Current
Optical Engineering – v . 29, 1990 – Current
Journal of Electronic Imaging – v . 1, 1992 – Current
Journal of Biomedical Optics – v . 1, 1996 – Current
Journal of Microlithography, Microfabrication, and Microsystems – v . 1, 2002 – Current
Journal of Applied Remote Sensing – v . 1, 2007 – Current
Journal of Nanophotonics – v . 1, 2007 - Current
　

ELSEVIER Publications 02/17/09
	Visit http://library.uta.edu/ Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> J -> Journal of Visual Communication and Image Representation Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> S -> Signal Processing Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> S -> Signal Processing: Image Communication

MATLAB Educational Sites 03/02/09

Tutorial Slides (06/29/10)

MATLAB BOOKS　

http://faculty.ksu.edu.sa/hedjar/Documents/MATLAB_Educational_Sites.htm

EURASIP Journals on signal and image processing and other areas.
http://www.eurasip.org/ With special papers etc in their "EURASIP Open Library."

List of (UTA) holdings of EURASIP journals. This link will work inside the UTA proxy-domain.

Any books or papers not available (accessible) from UTA library can be requested via interlibrary loan, online.

ELSEVIER Publications
	Visit http://library.uta.edu/ Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> J -> Journal of Visual Communication and Image Representation Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> S -> Signal Processing Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> S -> Signal Processing: Image Communication