EE 5359 - Multimedia Processing

Important Student Support Services Available: The University of Texas at Arlington provides a variety of resources and programs designed to help students develop academic skills, deal with personal situations, and better understand concepts and information related to their courses. These resources include tutoring, major-based learning centers, developmental education, advising and mentoring, personal counseling, and federally funded programs. For individualized referrals to resources for any reason, students may contact the Maverick Resource Hotline at 817-272-6107 or visit www.uta.edu/resources for more information.

PROJECT PROPOSAL :

Due date: Tuesday, Feb 19 2013

Format: Presentation with PP slides.

INTERIM REPORT :

Due date: Thursday, Mar 21 2013

Format: Short Report and PP slides with preliminary results to be orally presented.

DRAFT of FINAL REPORT :

Due date: Thursday, Apr 25 2013

Format: Report containing a lot of figures, tables, graphs and references with ftp and websites should be submitted two weeks prior to final submission.
(This will give time to make changes/addition etc.)

FINAL PROJECT REPORT :

Due date: Thursday, May 2 2013

Format: Hardcopy & Softcopy of report and ppt slides submission, oral presentation with ppt slides.

REPORT GUIDELINES :

Project Report Guide

Thesis Guide (3/01/2012)

First day of classes: January 15 2013.
Spring break : 12 - 16th March 2012.
Last day of classes : 4th May 2012.

Please note the project is not a paper study. Implementation/comparison based on standard metrics is required, besides conclusions, further research etc. Include lots of tables/graphs/images/block diagrams etc. Please go through previous projects (proposals/ppt slides, final project report/ppt slides etc.). pl access thesis guide for format/syntax etc.

TUTORIALS :

1. MPEG-2 Video Compression by Isnardi of Sarnoff Corporation

MPEG-2 tutorials

3. Digital Image and Video Processing files by Dr. Min Wu

lecture1 - An Introduction
lecture2 - Human Visual Perception
lecture3 - Point Operations
lecture4 - Signal Processing: From 1-D to 2-D (m-D)
lecture5 - Fourier Transform and Spatial Filtering
lecture6 - Edge Detection and Basics on 2-D Random Signal
lecture7 - Image Restoration
lecture8 - Wiener Filtering for Image Restoration & Basics on Image Compression
lecture9 - Quantization
lecture10 - Unitary Transform
lecture11 - Transform Coding and JPEG
lecture12 - Subband and Wavelet Coding
lecture13 - Wavelet Coding and Related Issues
lecture14 - Optimal Bit Allocation and Unitary Transform in Image Compression
lecture15 - Basics on Video Coding
lecture16 - MPEG Video Coding
lecture17 - MPEG Video Coding and Beyond
lecture18 - More on Motion Analysis
lecture19 - Video Content Analysis and Streaming
lecture20 - General Framework & Issues of Image Analysis and Video Streaming
lecture21 - Data Hiding in Images
lecture22 - Image Forensics
lecture23 - Image Forensics & Feature Extraction
lecture24 - Medical Imaging Topic: Radon Transform & Inverse Radon Transf.
lecture25 - Back Projection for Radon Construction and Multi-dimensional Sampling
lecture26 - Lattice Sampling
lecture27 - Texture Analysis and Synthesis

4. Image Quality Assessment by Dr. Zhou Wang

SSIM tutorial

Multi-Scale SSIM by Dr. Zhou Wang, UT Arlington 02/08/2011

SSIM Website by Dr. Zhou Wang, UT Arlington 02/08/2011

3-SSIM paper by Li, Bovik 02/08/2011

SSIM by AjayKumar 01/19/2012

SSIMF (feature based SSIM) : L. Zhang, L. Zhang, X. Mou, and D. Zhang. “FSIM: A feature similarity index for image quality assessment”, IEEE Trans. Image Processing, vol. 20, no. 8, pp. 2378-2386, Aug. 2011.

5. Digital Image Processing Files by Dr. Zhou Wang

6. ITU-T VICA Workshop files

1. Video Compression : Which Scenario? by Fulvio Moschetti
2. Exploration Work in MPEG Video by Jens-Rainer Ohm
3. Overview of International Video Coding Standards (preceding H.264) by Gary J. Sullivan
4. New Techniques for Improved Video Coding by Thomas Wiegand
5. Perceptual Encoder Optimization by David McNally

7. ISPACS - Keynote Speech

1. Intelligent and Ubiquitous Multimedia Services through Interactive Digital Broadcasting by Jar-Ferr (Kevin) Yang
2. Coding Technologies for Speech and Audio Signals by Takehiro Moriya of NTT Communication Science Labs.
3. Lecture A: Digital Media Revolution by C.-C. Jay Kuo
4. Lecture B: Digital Media Revolution by C.-C. Jay Kuo

8. Tutorial by Iain Richardson

1. 4x4 Transform and Quantization in H.264

9. Video Coding Standards

B.Girod, "Overview : Video Coding Standards ", Stanford University Coursework (04/22/10)

10. Stanford University Online classes - EE398A : Image and Video Compression

http://www.stanford.edu/class/ee398a/index.htm - Link to Course Web Page

http://www.stanford.edu/class/ee398a/handouts.htm - Link to course handouts

http://www.stanford.edu/class/ee398a/projects/reports/Hampapur_Ni.pdf - A Novel Trained KLT Method for Image Compression - Vinay Raj Hampapur, Wendy Ni

http://www.stanford.edu/class/ee398a/projects.htm - List of projects

EE5359 RESEARCH PROJECTS :

Please access all the files from courses EE5351, EE5355, EE5356.
Database (Jan 6 2012)

ResearchTopics (Jan 6 2012)
dipreviewpapers 01/14/2012 (For all these projects please access this file )
dipieeetrans 01/14/2012
dipref.doc 01/14/2012
MPL Slides 01/24/2012

INTDCT3.pdf ; INTDCT4.pdf ;

Papers : Comparison of INTDCTs ; Performance/Comparison of JM and Intel IPP H.264 Codec ;

P.S. Projects delayed will be penalized by 10 points (10%) for each day. After 10 days they will not be considered any more.

List of Recent Theses / Projects :

Student Name	Thesis / Project Title	Reports
A. Ravi	Performance analysis/comparison of Dirac video codec with H.264 video codec	2009 Proposal ; PPT ; Thesis ; Paper
H. Murugan	Multiplexing/ De-multiplexing H.264 video with AAC audio bit-streams, achieving lip sync	2007 Proposal ; PPT ; Thesis ; Paper
J. Abraham*	Low Complexity AVS-China Part-2 video using data mining techniques	Proposal ; PPT
J. Padia	Complexity reduction for VP6 to H.264 Transcoder using motion vector reuse	2010 Proposal ; PPT ; Thesis
P. Agawane	Implementation and evaluation of residual color transform	2008 Proposal ; PPT ; Thesis ; Paper
R. Veerla⁺	Advanced image coding	Proposal ; PPT ; Project ; Paper
R. Pereira	MPEG-2 to H.264 Transcoding	2005 Proposal ; PPT ; Paper
S. Venkatrav	H.264 based side information generation in Wyner ziv coding	2010 PPT ; Thesis ; Paper
T. Purushotham	Low complexity H.264 encoder using machine learning	2010 Proposal ; PPT ; Thesis ; Paper
V. Vijaykumar	Low complexity H.264 to VC-1 Transcoding	2010 Proposal ; PPT ; Thesis ; Paper
V. Kolkeri	Error concealment techniques in H.264 for Video transmission over wireless networks	2009 Proposal ; PPT ; Thesis
S. Basavanhalli	Optimization of H.264 baseline decoder on ARM 9TDMI processor	2005 PPT ; Thesis
M. Krishnan	Implementation and performance analysis of 2D order 16 integer transform in H.264 and AVS - China for HD video coding	2010 Proposal ; PPT ; Thesis
S. Sharma	Trancoding of H.264 bit-stream to MPEG-2 bit-stream	2007 PPT ; Thesis ; Paper
S. Devaraju⁺	A study on AVS-M video standard	Project ; Paper
S. Sridhar	Multiplexing/ De-multiplexing AVS-china video with AAC audio bit-streams, achieving lip sync	2010 PPT ; Thesis ; Paper
N. Siddaraju⁺	Multiplexing/ De-multiplexing H.264 video with HE-AAC audio bit-streams, achieving lip sync	PPT ; Project ; Paper
T.Bhatia	Optimization of H.264 High profile decoder for Pentium 4 Processor	2005 Proposal ; PPT ; Thesis
T. Isabelle	Image rotation, mirroring and interpolation in wavelet domain	2008 Proposal ; Thesis ; Paper
R. Hiremath⁺	Evaluation of JPEG and JPEG-LS for high definition and low complexity image compression	2008 Proposal
H. Yadav	optimization of deblocking filter in H.264 for real time implementation.	2006 PPT ; Thesis ; Paper
C. Chukka⁺	Universal Image Quality index (UIQI) and SSIM comparison	Project
A. Urs	Multiplexing/ De-multiplexing Dirac video with AAC audio bit stream	2011 Proposal ; PPT ; Thesis; Paper
P. Ramolia	Low complexity AVS-M using machine learning algorithm C4.5	2011 PPT ; Thesis
Swaroop	Low complexity H.264 encoder using machine learning for streaming applications	2011 Proposal ; PPT ; Thesis
S. Subbarayappa	Implementation and Analysis of Directional Discrete Cosine Transform in Baseline Profile in H.264	2012 Proposal ; PPT ; Thesis
T. Saxena	Reducing the encoding time of H.264 Baseline Profile using parallel programming techniques	2012 Proposal; Thesis; PPT
T. Sathe	Complexity reduction of H.264/AVC Motion Estimation using OpenMP	2012 Proposal ; PPT ; Thesis
S. Muniyappa	Implementation of complexity reduction algorithm for intra mode selection in H.264/AVC Video Coding	2011 Proposal; PPT ; Thesis
S. Chakraborty	Fingerprint enhancement by directional filtering	2011 Proposal; PPT; Thesis; Paper
A. Kulkarni	Fast Inter-prediction Mode Decision Algorithm for H.264 Video Encoder	2012 Paper Proposal ; PPT ; Thesis
G. Hansda	Super-Resolution with better edge enhancement	2012 PPT ; Thesis
S. Gangavati	Complexity Reduction of H.264 using Parallel Programming	2012 PPT ; Thesis
P. Anjanappa	Performance Analysis and Implementation of Mode Dependent DCT/DST in H.264/AVC	2012 PPT ; Thesis Document
D. P. Kumar	Complexity Reduction for HEVC Intraframe Luma mode decision using image statistics and neutral networks	2013 PPT; Proposal; Thesis Document
Pavan Kumar Gajalla	Efficient HEVC loss less coding using sample based angular intra prediction (SAP)	2013 Proposal; Thesis Document; Presentation
Bhavana Prabhakar	Implementation of an adaptive block filter on sub-blocks of a macroblock in H.264/AVC	2013 PPT; Proposal; Thesis Document

+ Project
* Dissertation Proposal

EE5359 interim report presentation schedule.doc

EE5359final schedule.doc

Technical Talk :

New Algorithms and FPGA Implementations for Fast Motion Estimation In H.264/AVC - Talk_Feb11_2011 02/17/11

By Prof. Tokunbo Ogunfunmi , Signal Processing Research Lab (SPRL), Department of Electrical Engineering , Santa Clara University, CA - 95053

Tampere University of Technology, Ph.D thesis : Kemal Ugur, “ Improved prediction methods for low complexity, high quality video coding” 8 Nov. 2010. - Thesis 02/17/11

You can find lot of video lecture from IIT and IISc

http://nptel.iitm.ac.in/

World wide video lectures

http://freevideolectures.com/

1. Image & Video Codecs :

JBIG
- JBIG-1, JBIG-2
JPEG Family
- JPEG Standard : JPEG1, JPEG2
- JPEG-LS : http://www.hpl.hp.com/loco (HP's Software Implementation available)
- JPEG-2000 : JPEG2000 JPEG2000EXT JPEG2000SLIDES JPEG2000STD
  JPEGCHARILIOS1, JPEGCHARILIOS2,JPEG2000EUSIPCO2000
- JPEGXR : JPEGXR JPEGXR1
  
  Project Ideas:
- W.D.Neve et al, "Improved BSDL - based content adaptation for JPEG 2000 HD photo and JPEG(XR)", SP:IC, vol.24, issue 6, pp. 452-467, July 2010.
MPEG Family :
- MPEG-1
- MPEG-2
- H.262
- MPEG-4 part 2 (Visual)
- MPEG-7
- MPEG-21
H.264 (MPEG-4 part 10)
- H.264 slides, H.264 standard 2007, H.264 test, H.264 encode http://www.itu.int/rec/T-REC-H.264-201003-I
- H.264 / MPEG-4 part 10 (All levels and profiles) 4:4:4 profile, Multiview coding, Scalable coding, Residual color transform
- Error resilience / concealment in H.264
- Error concealment in H.264 video transmission over wireless networks Vineeth: Thesis, PPT, Vineeth Paper.
  - Apply these error concealment techniques to other video coding standards such as VC-1 (SMPTE), AVS China, Dirac (BBC) and VP-8 of On2 technologies.
Project Ideas:
- Review the Description of the multiplexing method as defined in the standard of MPEG-2 TS (Transport Stream) and PS (Program Stream) multiplexer : its application for Audio-Video transmission in ATSC (Advanced Television Systems Committee) and DVB (Digital Video Broadcast).
  Try to suggest possible modifications, if any, to adopt H.264 as the video of the TS.
- P. Carrillo, H. Kalva and T. Pin, " Low complexity H.264 video encoding", SPIE. vol.7443, paper # 74430A, Aug. 2010.,
  Applications of digital image processing. By applying machine learning to video coding, the authors are able to reduce the complexity of highly optimized encoder by about 63%. This is based on reducing the complexity in mode selection 16x16 to 4x4 block sizes for ME/MC in inter frames which is computationally exhaustive.
  This may be very useful in mobile devices (SMBA project - Korea).
  Pl implement this algorithm (simulation)and verify the results obtained in this paper.
- P. Carrillo, H. Kalva and T. Pin, " Low complexity H.264 video encoding", SPIE. vol.7443, paper # 74430A, Aug. 2010.,
  Apply this technique to VC-1 of SMPTE (WMV-9) for reducing implementation Complexity
HEVC
- H.265 Key Technical Areas(KTA) h.265 h.265a
- HEVC.pdf

HEVC REFERENCES (updated: Jan 6 2012)
HEVC4 03/07/11
HEVCETRI 04/24/11

H.264 JM Software and X264

1.J Ren, N Kehtarnavaz, M Budagavi, Computationally efficient mode selection in H. 264/AVC video coding, IEEE Transactions on Consumer Electronics, Volume: 54 Issue:2, pp: 877 - 886,2008.

2. AP Miettinen, V Hirvisalo, Scalability of parallel workloads: the effects of granularity and scheduling in video processing, http://research.nokia.com/files/splst09_miettinen_hirvisalo.pdf

They refer this paper as:

L. Merritt, “x264: A High Performance H.264/AVC Encoder,” [online] http://neuron2.net/library/avc/overview_x264_v8_5.pdf.

overview_x264_v8_5[1].pdf

x264 Reference Software in C++

Links for lectures on Video Coding concepts

Links for lectures on Audio Coding concepts

Following shows some of the capabilitis of x264.

As of August 2008, x264 implements more features than any other H.264 encoder.
x264 has some notable psychovisual enhancements which help to increase the visual quality.
x264 has won awards in the following codec comparisons:
    Doom9's 2005 codec shoot-out
    Third Annual MSU MPEG-4 AVC/H.264 Video Codec Comparison, 2006
    Fourth Annual MSU MPEG-4 AVC/H.264 Video Codec Comparison, 2007
    Fifth Annual MSU MPEG-4 AVC/H.264 Video Codec Comparison, 2009
    Sixth Annual MSU MPEG-4 AVC/H.264 Video Codec Comparison, 2010(here is the detail of the result)
x264 has SIMD acceleration on x86, PowerPC (using AltiVec), and ARM7 (using NEON) platforms.
In April 2010, the x264 project announced full Blu-ray compliant video encoding capability making x264 the first Blu-ray compliant free software H.264 encoder.

The history of x264 is as follows. x264 was originally developed by Laurent Aimar, who stopped development in 2004 after being hired by ATEME. Loren Merritt then took over development. Today, x264 is primarily developed by Laurent Aimar, Loren Merritt, Eric Petit (OS X), Min Chen (vfw/asm), Justin Clay (vfw), Måns Rullgård, Radek Czyz, Christian Heine (asm), Alex Izvorski, Alex Wright and Jason Garrett-Glaser. It is a free software library and application for encoding video streams into the H.264/AVC format.

Getting x264
The latest x264 source code can always be found by anonymous Git repository:
# git clone git://git.videolan.org/x264.git
Or grab a daily tarball.
You can browse the source on-line.
Unofficial builds for Windows are available from Jarod, techouse, or Sharktooth.

References:
Official website: http://www.videolan.org/developers/x264.html
Official Forum: http://doom10.org//
Wikipeida: http://en.wikipedia.org/wiki/X264

M.S.Richer et al, "Special issue on global digital television, technology and services" proceedings of the IEEE, vol.94, pp 37-43, Jan 2006

AVS
- L.Yu, S.Chen, and J.Wang, "Overview of AVS-video coding standards", J.VCIP Articles in press. AVS-China
- Multiplexing AVS video and AVS audio coded bitstreams, demultiplexing the two coded bitstreams, decoding and achieving lip-sync
- (Audio video coding reference software. ftp://159.226.42.57/public/avs_doc/avs_software ) 06/24/08
- AVS Part 1 by Cui Bin doc, ppt 09/09/09*
- AVS P7mobile 06/12/08
- A Study on AVS-M Video Standard : Doc, ppt
- AVS zengquiangprofile 06/12/08
- avs_fcd1.0 06/12/08
- avs_m_fcd_20050112 06/12/08
- AVSjizhunprofile 06/12/08
- AVSDRM 06/30/08
- AVSH264 06/30/08
- AVS2DVLC 06/30/08
- AVSMC 06/30/08
- AVS baseline codec
- A Literature review on AVS Codec by Swaminathan ppt1, ppt2, ppt3
- AVS References
- "Efficient video coding using legacy algorithmic approaches" - J. Chen et al, IEEE Trans. multimedia (under review). This has lots of projects.

Fractal-Based Video Codec
- Fractal-Based Video Codec, fractalsref
Wyner-Ziv Codec
- Wyner-ziv1, Wyner-ziv1 h263 transcoder, Wyner-ziv1 h.264 abstract, Wyner-ziv1 kim1 & kim2, Wyner ziv papers
Dirac Codec
- Dirac Video Codec (by BBC) (http://dirac.sourceforge.net/index.html)
- (files: Dirac 1, Dirac 2, Dirac 3) Dirac References Aruna Ravi Thesis Thesis doc, pdf, ppt, Aruna Ravi - JVCIR Manuscrpit Draft
- Dirac Pro (Dirac intraframe Coding only)
- VC - 2 Conformance Specification (2/16/2012)
On2's TrueMotion Codecs
- VP6 from On2 06/24/08
  The On2 VP6 codec: how it works
- VP7 from On2 06/24/08
  VP7 video codec and "golden frames"
- VP8 from On2
  High compression+low complexity
- VP9 and VP10 references
WMV/SMPTE - VC-1 Codec
- VC-1 - A technical Overview
- WMV-9 Microsoft (VC-1 of SMPTE) ,
- WMV9 WMV9B WMV9A WMV9B WMV9slides WMV9VC1slides
- Dr Rao has these documents : SMPTEVC1, SMPTEVC1A
AIC
- AIC, AIC1, AIC2, AIC3 06/12/08 AIC4 AIC5 AIC6 AIC7 AICzhang
RealVideo
- RV10 (Real Video from real networks)
- https://helixcommunity.org
ATSC (Advanced Television Systems Committee)
- ATSC website, ATSC Mobile DTV
- ATSC DTV standard (G.A.Davidson et al, "ATSC video and audio coding", Proc. IEEE, vol. 94, pp. 60-74, Jan.2006
- ATSC Mobile DTV Candidate Standard
  Implement and evaluate this.
- ATSC A/72 H.264 in DTV
DICOM
- DICOM Digital imaging and communications in medicine
  
  ftp://medical.nema.org/medical/dicom
  
  Project Ideas:
  
  Develop 3-D compression algorithms for medical images preserving the diagnostic capabilities
  
  (see file dicom1)

Transcoders
- H.264 to H.263 Transcoder
- H.264 to AVS China Transcoder
- AVS China to VP6 transcoder, Swaminathan proposal
- AVS to H.264 Transcoder
  - (See the paper Z. Wang et al, "A fast intra mode decision algorithm for AVS to H.264 transcoding ", IEEE ICME pp. 61-64, July 2006) 06/24/08
- H.264/AVC to MPEG-2 Transcoder
  - S.Moiron et al, "Video transcoding from H.264/AVC to MPEG-2 with reduced complexity" (In Press) SPIC, online 21 June, 2010.
  - S.Moiron et al, "Video transcoding from H.264/AVC to MPEG-2 with reduced computational complexity" (In Press) SP:IC, 10 June, 2010.
- MPEG-2 to H.264/AVC Transcoder
- Wyner - Ziv to H.264 Transcoder
- VP8 to H.264 transcoder*
- H.264 to VP8 transcoder*
- VP6 to H.264 transcoder
  - (white paper from On2 Technologies, Inc. on their latest product - VP7 (licensed by adobe) and VP6 which is currently the codec for Flash video.
  - The link to download the personal edition of VP7 from On2 website - http://www.on2.com/index.php?496 ) 06/24/08
  - Padia: H264 to VP6 Abstract
- VC-1 to H.264 transcoder,
  - See the paper J-B Lee and H.Kalva "An efficient algorithm for VC-1 to H.264 video transcoding in progressive compression ",IEEE ICME, pp.53-56, July 2006) 06/24/08
- H.264 to VC1 transcoder
  proposal, ppt
- Bit-stream re-writing, unlike transcoding
  - this allows for lossless conversion of an SVC ( scalable video coding ) bit stream into a single layer AVC bit stream
  - see A.Segall and J.Zhao, "Bit-stream rewriting for SVC -to-AVC conversion", IEEE ICIP 2008, pp.2776-2779, San Diego, CA, Oct. 2008.
Foveated Image Coding
- File Zhouwang 3.ppt ( Rate scalable foveated image and vide communications by Zhou Wang)
- Foveated image quality assessment
- Embedded Foveation image coding
- Foveation SVC
Performance Evaluation
- A/53 ATSC DTV standard
  Implementation and evaluation
- A/153 ATSC mobile DTV standard
  Implementation and evaluation
  also error concealment techniques (Note: H.264/AVC is adopted in this.)
- VP8
  Implementation, performance evaluation and comparison with H.264
- Dirac and H.264 performance evaluation : Aruna Ravi Thesis doc, pdf, ppt, ArunaRavi_JVCIR
  
  Project Ideas:
  - See: S.-T. Hsiang, " A new subband/wavelet framework for AVC/H.264 intraframe coding and performance comparison with motion-JPEG 2000", SPIE/VCIP, vol.6822, pp. 68220P-1 through 12, Jan. 2008.
    Implement this new intraframe scalable coding.
  - See D. Marpe et al, "Performance evaluation of motion- JPEG 2000 in comparison with H.264/AVC operated in pure intra coding mode", proc. SPIE, vol.5266, pp.129-137, Feb.2004.
    Implement this performance comparison.
  - See R.G.de Oliveria and R.L.de Queiroz "Intra prediction versus wavelets and lapped transforms in an H.264/AVC coder", IEEE ICIP 2008, pp.137-140, San Antonio, TX, 2008.
    Implement lapped transforms/wavelets in H.264/AVC intra coding and compare the performance.
Comparisons
- Comparison of various still frame image coding techniques
- Comparision of various standards 08/27/2010
- Different Standards 08/27/2010
- Comparison of all still frame image coding technique
  - H.264 I frame only and Dirac Pro I frame only.
  - JPEG, JPEGLS, JPEG2000, JPEGXR,
- Comparison of the main or baseline/simple profile of MPEG-2 and H.264:
  - Review the two standards in detail.
  - Compare in terms of complexity, video quality , bit rates, compression ratio, advantages and disadvantages.
  - Also, discuss various existing transcoding methods between the two standards.
- Blockeffect -
  - Compare, evaluate and discuss various blocky distortion minimization techniques in block based (hybrid) DCT codecs at low bit rates and ways to minimize the blocky structure.
  - Also run the simulation using standard test images.
Subjective Quality Measures
- Structural Similarity Index (SSIM) SSIMH.264 SSIMProject1 SSIMZhou-Wang
- JND/VDM of Sarnoff Corp.

SMPTE- VC2
- VC - 2 Conformance Specification (2/16/2012)

Other Topics
- T-DMB - (Terrestrial digital multimedia broadcasting),
  - see S.Cho et al, "System and services of terrestrial digital multimedia broadcasting (T-DMB)", IEEE Trans. Broadcasting, vol.53, pp. 171-177, March 2007.
  - K.-Y.Kim et al, "Efficient generation of scalable transport stream for high quality service in T-DMB", ETRI Journal. vol.31, pp.65-67, Feb. 2010.
- Mixed Raster Content
  - MRC
  - R. de queiroz, R. Buckley and M. Xu, "Mixed Raster Content (MRC) model for compound image compression", photonics west, SPIE, vol. 3653, PP, 1106-1117, San Jose, CA, Jan.1999.
- All zero block detection technique
  - All zero block detection(quantized DCT coefficients of prediction error block are zeros) can lead to early termination of motion estimation(ME) process in hybrid coding (inner frame prediction aided by motion estimation - motion compensated prediction error goes through transform - DCT - quantization and coding). All zero block detection technique is useful for fast ME.
  - See papers in files MEMC1, MEMC2, MEMC3, MEMC4 specially references 14-30.
  - Review, compare and develop fast ME techniques based on early termination ( all zero block detection).
- "Modeling quantization matrices for perpetual image/video encoding",
  - see the paper by H.Zhang and G.Cote, SPIE vol. 6822, pp. 682210-1 through 682210-8, San Jose, CA, Jan., 2008.
- Wavelets and lapped transforms in an H.264/AVC coder,
  - IEEE ICIP2008, pp137-140. R.G.de oliveira and R.L. de queiroz
- Multiple description coding

Information on the Internet
- This Appendix lists web sites maintained by standards bodies, fora, consortia, alliances, research institutes, private organizations, Universities, industry, professional / technical societies etc. The list is quite extensive and every effort is made to compile this list up to date. In view of the rapid changes, some sites may no longer exist and new ones may have been developed.
  The main objective is to provide the reader with the wealth of information available on the Internet.
- Video compression basics by Sanjiv Malik (06/21/10) : http://www.slideshare.net/sanjivmalik/video-compression-basics The link also includes presentation slides on Video, Image, Audio and Speech codecs.
- JPEG : http://en.wikipedia.org/wiki/JPEG MJPEG : http://en.wikipedia.org/wiki/Motion_JPEG MPEG : http://en.wikipedia.org/wiki/MPEG Digital Video : http://en.wikipedia.org/wiki/DV
- Video Codec standards list (01/23/2012)
- video codec standards review (02/24/11)
- Video codec standards review ppt (06/22/10)
- The matlab code for computing BD-Bitrate and BD-PSNR is found in this link:
  
  http://www.mathworks.com/matlabcentral/fileexchange/27798-bjontegaardmetric/content/bjontegaard.m

2. Audio Codecs

HE-AAC v2 Audio (ISO/IEC 14496-3)
J.M. Boyce, " The US digital television broadcasting transition", IEEE Signal Processing magazine, Vol. 26, pp.112-110, May 2010
ATSC M/H DTV Braodcasting (Advanced Televsion Systems Committee, Mobile/Handheld); supports handheld and in-car devices.
This candidate standard is based on video (H.264) audio HE-AAC v2.2.
MPEG-1 audio
MPEG-2 audio
AC3 AC3ref
AAC MPEGAAC
AAC + SBR (HE-AAC)
MP3 + SBR (MP PRO)
WMA (Windows Media Audio)-Microsoft MPEGAAC
AVS-China Audio MPEGAAC
AVS-China Audio (with SBR)MPEGAAC
ISPACSKS3 audio 06/24/08
SBR 06/24/08 SBR FILES
SBRAACPLUS 06/24/08
SBRSLIDES 06/24/08
SMPTEVC1 06/24/08
SMPTEVC1testmaterials 06/24/08
Enhanced AC-3 standard of ATSC (see the paper cited in ATSC DTV standard)
MPEG 1 Layer3 (MP3) , MPEG-2 AAC and HE-AAC. Discuss encoder decoder block diagrams, advantages and disadvantages.
MPEG Surround audio coder, "ISO/IE C230003-1 Information Technology - MPEG audio technologies-Part 1, MPEG Surround, Feb. 2007.
Scalable audio coding http://mpeg.chiariglione.org
Spatial audio coding http://digital-media-project.org
Joint speech and music coding
ATSC audio codec (AC3EAC3) A9R628.pdf
ATSC website
Audio and Speech Coding 02/18/11
AVSP3AUDIOFCD 02/18/11

FILES : (08/24/09)

1a) MPLBOOKS1, 1b) MPLBOOKS2, 1c) MPLBOOKS3, 1d) MPLBOOKS4 2)dipcdlist 3)dipieeetrans 4)diplabfacilities 5)dipref 6)dipreviewpapers (01/21/2012)

PREVIOUS PROJECTS :

Projects (Spring 2013)
Sapna Vasudevan	Porting of Fast Intra Prediction in HM7.0 to HM9.2. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Abhijith Jagannath	Analysis of adaptive GOP algorithms for efficient HEVC compression. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Harshdeep B Jain	Comparative and performance analysis of HEVC and H.264 intra frame coding and JPEG 2000. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Valay Shah	Study and optimization of deblocking filter in H.265 and its advantages over H.264/AVC. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Kushal Shah	Time optimization of HEVC encoder over x86 processors using SIMD. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Shantanu Kulkarni	Transcoding from H.264/AVC to High Efficiency Video Coding (HEVC). PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Shaheer Ahmed	Encoding H.264 by thread level parallelism. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Sanket Save	Andriod book finder. PPT; Proposal; InterimPPT; FinalPPT; FinalReport
Nayana Parashar	3D-Extension of HEVC. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Aditya Sharma	MAV-ID card processing using camera images. PPT; Proposal; InterimPPT; InterimReport; FinalPPT; FinalReport
Projects (Spring 2012)
Kaustubh Vilas Dhonsale	Overview and comparison of H.264/MPEG-4 part 10 or AVC video coding standard and audio video standard (AVS) of China as compression standard for video. PPT ; Proposal ; InterimRep. ; InterimPPT ; Final Rep. ; FinalPPT
Pavan Kumar Reddy Gajjala	Implementation and study of unified loop filter in H.264. PPT ;Proposal ; InterimRep. ; InterimPPT ; Final Rep. ; FinalPPT
Vinoothna Gajula	Optimizing baseline profile in H.264/AVC video coding by parallel programming and fast intra and inter predictions. PPT ; Proposal ; InterimPPT ; Final Rep. ; FinalPPT
Sudeep Prakash Gangavati	Video compression standard for high definition video: A comparative study of H.264, Dirac Pro and AVS part 2. PPT ; Proposal ; InterimRep. ; InterimPPT ; Final Rep. ; FinalPPT
Saurabh Ghorpade	Real time H.264 decoder implementation in robot control. PPT ; Proposal ; Interim Rep. ; InterimPPT ; Final Rep. ; FinalPPT
Ritika Jain	Study of iris recognition schemes. PPT ; Proposal ; InterimRep ; InterimPPT ; Final Rep. ; FinalPPT
Bhavna Prabhakar	Adaptive interpolation filter for H.264/AVC. PPT ; Proposal ; InterimRep. ; InterimPPT ; Final Rep. ; Final PPT
Yashas Prakash	Study and implementation of G.719 audio codec and performance analysis of G.719 with AAC(advanced audio codec) and HE-AAC(High efficiency-advanced audio codec) audio codecs. PPT ; Proposal ; InterimRep. ; InterimPPT ; Final Rep. ; FinalPPT
Saumya Vijaykumar Raval	Implementation and performance analysis of Dirac video coding standard and comparison with AVS China. PPT ; Proposal ; Interim Rep. ; InterimPPT ; Final Rep. ; FinalPPT
Biju Shrestha	Investigation of image quality of Dirac, H.264 and H.265. PPT ; Proposal ; Interim Rep. ; InterimPPT ; Final Rep. ; FinalPPT
Gokul Krishna Srinivasan	Implementation, comparison and literature review of spatio-temporal and compressed domains object detection. PPT ; Proposal ; InterimRep. ; InterimPPT ; Final Rep. ; FinalPPT
Anuja Prasad Kulkarni	Medical imaging. PPT ; Proposal ; InterimRep. ; InterimPPT ; Final Rep. ; FinalPPT
Sumedha Phatak	Study and implementation of Video compression standards (H.264/AVC and Dirac). PPT ; Proposal ; Interim Rep. ; InterimPPT ; Final Rep. ; FinalPPT
Amee Ghanshyam Solanki	Implementation and performance analysis of H.264 intra frame coding, JPEG, JPEG-LS, JPEG-2000 and JPEG-XR. PPT ; Proposal ; Interim Rep. ; InterimPPT ; Final Rep. ; FinalPPT

Projects (Spring 2011)
Priyadarshini Anjanappa	Implementation and Analysis of Directional DCT in H.264 Reference Software. PPT ; Proposal; Final Report; Final PPT
Spoorthy Priya Yerabolu	Low Complexity rate control for VC-1 to H.264 Transcoding. PPT ; Proposal; Final Report; Final PPT
Sreya Chakraborty	Smooth Streaming over wireless networks. PPT ; Proposal; Final Report; Final PPT
Vamsi Vegunta	AVS CHINA: Implementation and performance evaluation of all video profiles. interim, proposal, ppt; Final Report; Final PPT
Tejas Sathe	Fast Inter and Intra Mode Decision Algorithm based on Thread Level Parallelism in H.264 Video Coding. PPT ; Proposal; Final Report; Final PPT
Vajani Vidur	Performance analysis of AVS-M and its application in mobile environment. PPT ; Proposal; Final Report; Final PPT
Sharan K. Chandrashekar	Implementation of H.264/AVC, AVS China Part 7 and Dirac Video Coding Standards. PPT ; Proposal; Final Report; Final PPT
Murtaza Mustafa Zaveri	Error concealment techniques in H.264 video transmission over wireless networks. PPT ; Proposal; Final Report; Final PPT
Hardeepsinh Jadeja	MPEG-2 to H.264 Transcoder in Baseline Profile. PPT ; Proposal; Final Report; Final PPT
Gaurav Hansda	Fast decision of block size, prediction mode and intra block for H.264 intra prediction. PPT ; Proposal; Final Report; Final PPT
Vigneshwaran Sivaravindiran	Moving object detection in compressed domain. PPT ; Proposal; Final Report; Final PPT
Irfan Kerawalla	DVB-SH system for Handheld devices. PPT ; Proposal; Final Report; Final PPT
Prasanna Venkatesh Palani	Vehicle license plate detection algorithm based on statistical characteristics in HIS color model. PPT ; Proposal; Final Report; Final PPT
Keyur Shah	Implementation, performance analysis & comparison of VP8 & H.264. PPT ; Proposal; Final Report; Final PPT
Ehsan Syed	Digital watermarking. PPT ; Proposal ; Interimreport ; Interimppt; Final Report; Final PPT
Kushal Kunigal	FPGA implementation of H.264 video encoder. PPT ; Proposal ; Interimppt ; Interimreport; Final Report; Final PPT

Projects (Fall2010)
Abrar Ahmed Syed (abrar.syed@mavs.uta.edu)	Digital Watermarking ppt proposal final report final ppt
Amruta Kulkarni(amruta.kulkarni@mavs.uta.edu)	Complexity Reduction Algorithm for intra prediction in H.264 ppt proposal final ppt final report
Datchaini Rajendran(dhatchaini.rajendran@mavs.uta.edu)	Study of AC-3, AAC and HE-AAC Audio Codecs proposal ppt final report final ppt
Darshan S Alagad(darshan.alagud@gmail.com)	Study on fractal image compression proposal ppt final ppt final report
Kiran Jonnavittula (kiran.jvp@gmail.com)	Performance analysis of H.264, JM and FFMPEG proposal ppt final report final ppt
Sadaf Ahamed (sadaf.ahamed@mavs.uta.edu)	Hybrid error concealment method based on H.264 standard for wireless transmission ppt proposal final ppt final report
Shreyanka Subbarayappa(shreyanka87@gmail.com)	Comparitive study of H.264 intra frame coding, JPEG, JPEG-LS,JPEG 2000 and JPEG XR ppt proposal final ppt final report
Santosh K Muniyappa(santosh.kumarmuniyappa@mavs.uta.edu)	Performance analysis of JM, X264 and Intel IPP in H.264. ppt ; proposal ; Report.doc
Suvinda M Srikanteiah(suvinda.mudignesrikantaiah@mavs.uta.edu)	Performance analysis of integer DCTs of different block sizes proposal ppt final report final ppt
Touseef Khan (touseef.khan@mavs.uta.edu)	Comparitive study of H.264, AVS China Part 7 and Dirac. proposal ; ppt ; report.docx
Rajesh Radhakrishnan(rajesh.radhakrishnan@mavs.uta.edu)	Stastical analysis and evaluation of spatio temporal and compression domain moving object detection ppt propsal final report final ppt

Projects (Spring 2010)
Chukka Chaitanya	UIQI & SSIM (Perceptual Visial Quality) ppt doc
Fulani Sanil H	Compressive Sampling ppt, proposal doc
Kharwandikar Poonam Sushil	Image Coding Standards Comparison (H.264, DIRAC PRO, JPEG 2000) ppt, doc
Makwana Bhumika Navinchandra	H.264 implementation . All profiles , Performance Analysis ppt, doc
Mukkamala Siddhartha	Performance Analysis and Comparison of H.264 and VP6 ppt doc
Mehta Jay Kamal	AVS China Part 7 Mobile Applications (Jiben Profile) ppt doc
Purushottam Thejaswini	Low complexity H.264 Encoder for Mobile Applicaitons ppt,ppt,doc , Report
Shivakkumaran Sriniveditha	A>A153 (ATSC) H.264 baseline profile over mobile/handheld devices ppt doc

Projects (Fall2009)
Ashwini Urs	Performance analysis of Dirac video codec with AVS China and AAC (audio codec)Proposal, proposalppt, projectppt, project
Babu Aswathappa	Rate distortion optimization using SSIM in H.264 I-frame encoder ppt, doc
Pragnesh Ramolia	Low complexity AVS-M by implementing data mining algorithm: proposal, ppt, doc
Subramanya M V	Wyner-Ziv codec : ppt, doc
Vidhya Vijaykumar	H.264 to VC-1 transcoder. proposal, interim, ppt, doc
Suchethan Swaroop	Performance analysis and comparison of JM software and Intel IPP H.264 encoder and decoder: ppt, doc
Thejaswini P	Medical image diagnostics using phase only correlation : proposal, ppt, doc
Swaminathan S	AVS video and AAC (audio) encode multiplex/demultiplex, decode and maintain lip sync. ppt, doc
Naveen Siddaraju	Study and comparison between H.264/MPEG -4 part 10 AVC main profile and AVS China part2. proposal, interim, ppt. doc
Madhu Krishnan	Compressive sensing for video acquisition ppt, doc
Jennie Abraham	Performance analysis and comparison of AVS-China, H.264 and Dirac proposal, ppt, doc
Nikshep Patil	Performance Analysis of H.264 Encoder on TMS320C64x+ and ARM 9E proposal doc ppt.pptx document report

Projects (Spring 2009)
Devaraju Sahana	Audio Video Standard for Mobile (AVS-M) [Report] [Slides]
Swaminathan Sridhar	Audio Video coding Standard of AVS [Report] [Slides]
Pritesh Shah	Mixed Raster Content for Compound Image Compression [Report] [Slides]
Subramanya M V	Side Information generation in Wyner-Ziv decoder [Report] [Slides]
Harish Bhandiwad	Comparative Study Of Various Still Image Coding Techniques [Report] [Slides]
Projects (Summer 2008)
Vineeth S Kolkeri	Error Concealment Techniques in H.264/AVC for Wireless Video Transmission. [Proposal] [Report] [Slides]
Ann Vo	Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture. [Proposal] [Report] [Slides]
Radhika Veerla	Advanced Image Coding. [Proposal] [Report] [Slides]
Yothin Rakvongthai	Hidden Markov Tree Modeling of the Uniform Discrete Curvelet Transform. [Proposal][Report] [Slides]
Att Kraufak	A Study on structural similarity based interframe video coding. [Proposal] [Report] [Slides]
Jay Padia	H.264 to VP6 Transcoder. [Proposal] [Report] [Slides]
Projects (Spring 2008)
Khyati Mistry	Comparative study of Motion Estimation (ME) Algorithms. [Report] [Slides]
Priyanka Ankolekar	Study and Comparison of MPEG 2 and H.264 main profiles and available transcoding methods. [Report] [Slides]
Mohammed Koul	Error Resilience and Performance Evaluation of H.264/AVC video streams in a Lossy Wireless Environment [Report] [Slides]
Jennie Abraham	Sarnoff vision optimized encoder
Bishwa Sheth	Structural Similarity Index Method. [Report] [Slides]
Vidhya Murthy	Matching Pursuits. [Report] [Slides]

Project proposal (Spring 2007)
Ambica Valleru	Study on H.264 High Profile
Att Kruafak	Variable Blocksize Transform
Jayant CR	Multiple B-Frame Construction Using Dept Map and Segmentation
Jian Wang	Visual Discrimination Model with H.264
Kamaldeep Tumkur	Optimization of Intra / Inter Prediction in H.264
Nha Nguyen	Implementing H.261 Video Codec in H.323 VoIP Stack
Pooja Agawane	Residual Color Transform in H.264
Pravin Patil	Study and Analysis of Dirac Video Codec
Preyas Desai	Optimization of De-Blocking Filter in H.264

MATLAB Educational Sites :

http://faculty.ksu.edu.sa/hedjar/Documents/MATLAB_Educational_Sites.htm

MATLAB BOOKS

Matlab Tutorial (06/29/10)

UTA LIBRARY :

IEEE/IET papers and papers published in conference proceedings and journals (transactions) can be accessed and downloaded via UTA library.

IEEE/IET publications
go to IEEEXPLORE

Access to over 220 e-books on IEEE Xplore.

Free E-Books Worldwide sales of e-books are expected to jump from US $323 million in 2008 to nearly $9 billion in 2013, according to a forecast by the market research firm In-Stat. Aware of the popularity of digital books, IEEE is now offering members a collection of 220 IEEE e-books for free through the IEEE Xplore digital library.

For more information and to see a selection of these IEEE eBook Classics, visit http://bmsmail3.ieee.org:80/u/16474/128854

The e-book collection spans a number of today's technologies across nineteen different content areas, and includes:

practical handbooks,
introductory and advanced texts,
reference works, and
professional books.

-->Following content added on Feb-2-2012

IEEE Transactions on

Broadcasting

Circuits and Systems for Video Technology

Consumer Electronics

Image Processing

Industrial electronics

Medical Imaging

Multimedia

Pattern Analysis and Machine Recognition

Signal Processing

Audio, Speech and Language Processing

IEEE Multimedia Magazine

IEEE Circuits and Devices Magazine

IEEE Signal Processing Magazine

IEEE Signal Processing Letters

IEEE Journal of selected topics in signal processing

Proceedings of the IEEE

IEEE International workshop on multimedia signal processing

IEE (Institution of Electrical Engineers – UK) changed to IET (Institution of Engineering and Technology)

Electronics Letters

Journal on image processing

Journal on circuits, devices and systems

Pattern Recognition Letters

SMPTE Magazine SMPTE – Society of Motion Pictures and Television Engineering

Digital Signal processing (Elsevier) dsp@elesivier.com

CONFERENCE PROCEEDINGS

IEEE (ICASSP, ISCAS, MWSCAS, TENCON, IP, ICME, ICIP, DCC)

Picture Coding Symposium

IEEE International workshop on multimedia signal processing

--> End of content added on Feb-2-2012

Springer Publications http://www.springerlink.com/home/main.mpx, or access through UTA Library

Click on Library Databases A-Z -> S -> SpringerLink

Journal of Signal Processing Systems (very useful journal)
Journal of electrical engineering
Journal of circuits, systems and signal processing
Journal of multidimensional systems and signal processing

SPIE digital library http://spiedigitallibrary.aip.org , or access through UTA Library

The Proceedings of SPIE – v . 1200, 1990 – Current
Optical Engineering – v . 29, 1990 – Current
Journal of Electronic Imaging – v . 1, 1992 – Current
Journal of Biomedical Optics – v . 1, 1996 – Current
Journal of Microlithography, Microfabrication, and Microsystems – v . 1, 2002 – Current
Journal of Applied Remote Sensing – v . 1, 2007 – Current
Journal of Nanophotonics – v . 1, 2007 - Current

ELSEVIER Publications
	Visit http://library.uta.edu/ Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> J -> Journal of Visual Communication and Image Representation Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> S -> Signal Processing Click on Library Databases A-Z -> S -> ScienceDirect -> Engineering -> S -> Signal Processing: Image Communication

EURASIP Journals on signal and image processing and other areas.

http://www.eurasip.org/ With special papers etc in their "EURASIP Open Library."

List of (UTA) holdings of EURASIP journals. This link will work inside the UTA proxy-domain.

EURASIP journal on embedded systems [2006-][issn=1687-3955] http://pulse.uta.edu/vwebv/holdingsInfo?bibId=1356416
EURASIP journal on advances in signal processing [2001-][issn=1687-6172] http://pulse.uta.edu/vwebv/holdingsInfo?bibId=1456756
EURASIP journal on bioinformatics & systems biology [2006-][issn=1687-4145] http://pulse.uta.edu/vwebv/holdingsInfo?bibId=1356448
EURASIP journal on audio, speech, and music processing [2006-][issn=1687-4714] http://pulse.uta.edu/vwebv/holdingsInfo?bibId=1362303
EURASIP journal on image and video processing [2007-][issn=1687-5176] http://pulse.uta.edu/vwebv/holdingsInfo?bibId=1389215
EURASIP journal on information security [2007-][issn=1687-4161] http://pulse.uta.edu/vwebv/holdingsInfo?bibId=1447078
EURASIP journal on wireless communications and networking [2004-][issn=1687-1472] http://pulse.uta.edu/vwebv/holdingsInfo?bibId=1311864

Signal processing: the official pub. of the European Association for Signal Processing [1995-][issn=0165-1684]http://pulse.uta.edu/vwebv/holdingsInfo?bibId=573158

Also access from:

EURASIP Journal on Image and Video Processing http://www.hindawi.com/journals/ivp/contents.3.html

EURASIP journals now part of SpringerOpen!

Dear Researcher,

I am writing to let you know that the following open access journals, which are sponsored by the European Association for Signal Processing (EURASIP), are now published by Springer, in its SpringerOpen portfolio of fully open access journals:

EURASIP Journal on Advances in Signal Processing

EURASIP Journal on Audio, Speech, and Music Processing

EURASIP Journal on Bioinformatics and Systems Biology

EURASIP Journal on Embedded Systems

EURASIP Journal on Image and Video Processing

EURASIP Journal on Information Security

EURASIP Journal on Wireless Communications and Networking

Springer welcomes all new submissions to the SpringerOpen online submission system and I would like to encourage you to submit your next research article to one of the journals.

The journals also publish Special Issues on a regular basis. For the latest information on the forthcoming Special Issuesand to submit your article, visit the individual journal websites on SpringerOpen.com.

The journals’ older content is currently being transferred and will be available on the SpringerOpen website as of July 2011.

-Dr, Rao

IJWMIP Files

IJWMIP Vol: 09 Iss: 4 pp635 PERFORMANCE ANALYSIS AND COMPARISON OF THE DIRAC VIDEO CODEC WITH H.264/MPEG4 PART 10 AVC

Any books or papers not available (accessible) from UTA library can be requested via interlibrary loan, online.

UTA Library Resources