1. Image & Video Codecs :

• JBIG
  • JBIG-1, JBIG-2
    
    
• JPEG Family
  • JPEG Standard  : JPEG1, JPEG2
  • JPEG-LS             : http://www.hpl.hp.com/loco (HP's Software Implementation available)
  • JPEG-2000          : JPEG2000 JPEG2000EXT JPEG2000SLIDES JPEG2000STD
                                  JPEGCHARILIOS1, JPEGCHARILIOS2,JPEG2000EUSIPCO2000
  • JPEGXR              : JPEGXR JPEGXR1 
    
    Project Ideas:
  • W.D.Neve et al, "Improved BSDL - based content adaptation for JPEG 2000 HD photo and JPEG(XR)", SP:IC, vol.24, issue 6, pp. 452-467, July 2010.
    
    
• MPEG Family :
  • MPEG-1
  • MPEG-2
  • H.262
  • MPEG-4 part 2 (Visual)
  • MPEG-7
  • MPEG-21
    
    
• H.264 (MPEG-4 part 10)
  • H.264 slides, H.264 standard 2007, H.264 test, H.264 encode
  • H.264 / MPEG-4 part 10 (All levels and profiles) 4:4:4 profile, Multiview coding, Scalable coding, Residual color transform
  • Error resilience / concealment in H.264
  • Error concealment in H.264 video transmission over wireless networks Vineeth: Thesis, PPT, Vineeth Paper.
    • Apply these error concealment techniques to other video coding standards such as VC-1 (SMPTE), AVS China, Dirac (BBC) and VP-8 of On2 technologies. 

  Project Ideas:

  • Review the Description of the multiplexing method as defined in the standard of MPEG-2 TS (Transport Stream) and PS (Program Stream) multiplexer : its application for Audio-Video transmission in ATSC (Advanced Television Systems Committee) and DVB (Digital Video Broadcast).
    Try to suggest possible modifications, if any, to adopt H.264 as the video of the TS.
    
  • P. Carrillo, H. Kalva and T. Pin, " Low complexity H.264 video encoding", SPIE. vol.7443, paper # 74430A, Aug. 2010.,
    Applications of digital image processing. By applying machine learning to video coding, the authors are able to reduce the complexity of highly optimized encoder by about 63%. This is based on reducing the complexity in mode selection 16x16 to 4x4 block sizes for ME/MC  in inter frames which is computationally exhaustive.
    This may be very useful in mobile devices (SMBA project - Korea).
    Pl implement this algorithm (simulation)and verify the results obtained in this paper.
     
  • P. Carrillo, H. Kalva and T. Pin, " Low complexity H.264 video encoding", SPIE. vol.7443, paper # 74430A, Aug. 2010.,
    Apply this technique to VC-1 of SMPTE (WMV-9) for reducing implementation Complexity
     

    
    

• H.265*
  • H.265 Key Technical Areas(KTA) h.265 h.265a
    
• AVS
  • L.Yu, S.Chen, and J.Wang, "Overview of AVS-video coding standards", J.VCIP Articles in press. AVS-China 
  • Multiplexing AVS video and AVS audio coded bitstreams, demultiplexing the two coded bitstreams, decoding and achieving lip-sync
  • (Audio video coding reference software. ftp://159.226.42.57/public/avs_doc/avs_software ) 06/24/08
  •  AVS Part 1 by Cui Bin  doc, ppt 09/09/09*
  • AVS P7mobile 06/12/08
  • A Study on AVS-M Video Standard : Doc, ppt
  • AVS zengquiangprofile 06/12/08
  • avs_fcd1.0 06/12/08
  • avs_m_fcd_20050112 06/12/08
  • AVSjizhunprofile 06/12/08
  • AVSDRM  06/30/08
  • AVSH264  06/30/08
  • AVS2DVLC  06/30/08
  • AVSMC  06/30/08
  • AVS baseline codec
  • A Literature review on AVS Codec by Swaminathan ppt1, ppt2, ppt3
  • AVS References
     

   

• Fractal-Based Video Codec
  • Fractal-Based Video Codec,  fractalsref
    
    
• Wyner-Ziv Codec

  •  Wyner-ziv1, Wyner-ziv1 h263 transcoder, Wyner-ziv1 h.264 abstract, Wyner-ziv1 kim1 & kim2, Wyner ziv papers

• Dirac Codec
  • Dirac Video Codec (by BBC) (http://dirac.sourceforge.net/index.html)
  • (files: Dirac 1, Dirac 2, Dirac 3) Dirac References Aruna Ravi Thesis Thesis doc, pdf, ppt, Aruna Ravi - JVCIR Manuscrpit Draft
  • Dirac Pro (Dirac intraframe Coding only)
    
    
• On2's TrueMotion Codecs
  • VP6 from On2 06/24/08
            The On2 VP6 codec: how it works
  • VP7 from On2 06/24/08
            VP7 video codec and "golden frames"
  • VP8 from On2
            High compression+low complexity
    
    
    
  WMV/SMPTE - VC-1 Codec
  • VC-1 - A technical Overview
  • WMV-9 Microsoft (VC-1 of SMPTE) ,
  • WMV9 WMV9B  WMV9A WMV9B WMV9slides WMV9VC1slides
  • Dr Rao has these documents : SMPTEVC1, SMPTEVC1A
    
• AIC
  • AIC, AIC1, AIC2, AIC3 06/12/08 AIC4 AIC5 AIC6 AIC7 AICzhang
    
• RealVideo
  • RV10 (Real Video from real networks)
  • https://helixcommunity.org
    
    
• ATSC (Advanced Television Systems Committee)
  • ATSC website, ATSC Mobile DTV
  • ATSC DTV standard (G.A.Davidson et al, "ATSC video and audio coding", Proc. IEEE, vol. 94, pp. 60-74, Jan.2006
  • ATSC Mobile DTV Candidate Standard
                Implement and evaluate this.
    
• DICOM

  • DICOM Digital imaging and communications in medicine 

    ftp://medical.nema.org/medical/dicom 

     

    Project Ideas:

    Develop 3-D compression algorithms for medical images preserving the diagnostic capabilities  

    (see file dicom1)
    
    

• Transcoders
  • H.264 to H.263 Transcoder
  • H.264 to AVS China Transcoder
  • AVS China to VP6 transcoder, Swaminathan proposal
  • AVS to H.264 Transcoder 
    • (See the paper Z. Wang et al, "A fast intra mode decision algorithm for AVS to H.264 transcoding ", IEEE ICME pp. 61-64, July 2006) 06/24/08
  • H.264/AVC to MPEG-2 Transcoder
    • S.Moiron    et al, "Video transcoding from H.264/AVC to MPEG-2 with reduced complexity" (In Press) SPIC, online 21 June, 2010.
    • S.Moiron    et al, "Video transcoding from H.264/AVC to MPEG-2 with reduced computational complexity" (In Press) SP:IC, 10 June, 2010.
  • MPEG-2 to H.264/AVC Transcoder
  • Wyner - Ziv to H.264 Transcoder
  • VP8 to H.264 transcoder*
  • H.264 to VP8 transcoder*
  • VP6 to H.264 transcoder 
    • (white paper from On2 Technologies, Inc. on their latest product - VP7 (licensed by adobe) and VP6 which is currently the codec for Flash video.
    • The link to download the personal edition of VP7 from On2 website  -  http://www.on2.com/index.php?496 ) 06/24/08
    • Padia: H264 to VP6 Abstract
  • VC-1 to H.264 transcoder, 
    • See the paper J-B Lee and H.Kalva "An efficient algorithm for VC-1 to H.264 video transcoding in progressive compression ",IEEE ICME, pp.53-56, July 2006) 06/24/08
  • H.264 to VC1 transcoder 
                        proposal, ppt
  • Bit-stream re-writing, unlike transcoding
    • this allows for lossless conversion of an SVC ( scalable video coding ) bit stream into a single layer AVC bit stream
    • see A.Segall and J.Zhao, "Bit-stream rewriting for SVC -to-AVC conversion", IEEE ICIP 2008, pp.2776-2779, San Diego, CA, Oct. 2008.
      
      
• Foveated Image Coding
  • File Zhouwang 3.ppt ( Rate scalable foveated image and vide communications by Zhou Wang)
  • Foveated image quality assessment
  • Embedded Foveation image coding
  • Foveation SVC
    
    
• Performance Evaluation
  • A/53 ATSC DTV standard
                Implementation and evaluation
  • A/153 ATSC mobile DTV standard
                Implementation and evaluation
                also error concealment techniques (Note: H.264/AVC is adopted in this.)
  • VP8
                Implementation,  performance evaluation and comparison with H.264
  • Dirac and H.264 performance evaluation : Aruna Ravi Thesis doc, pdf, ppt, ArunaRavi_JVCIR

    
    
    Project Ideas:

    • See: S.-T. Hsiang, " A new subband/wavelet framework for AVC/H.264 intraframe coding and performance comparison with motion-JPEG 2000", SPIE/VCIP, vol.6822, pp. 68220P-1 through 12, Jan. 2008.
      Implement this new intraframe scalable coding.
    • See D. Marpe et al, "Performance evaluation of motion- JPEG 2000 in comparison with H.264/AVC operated in pure intra coding mode", proc. SPIE, vol.5266, pp.129-137, Feb.2004.
      Implement this performance comparison.
    • See R.G.de Oliveria and R.L.de Queiroz "Intra prediction versus wavelets and lapped transforms in an H.264/AVC coder", IEEE ICIP 2008, pp.137-140, San Antonio, TX, 2008.
      Implement lapped transforms/wavelets in H.264/AVC intra coding and compare the performance.
      
      
• Comparisons
  • Comparison of various still frame image coding techniques
  • Comparision of various standards 08/27/2010
  • Different Standards 08/27/2010
  • Comparison of all still frame image coding technique
    • H.264 I frame only and Dirac Pro I frame only.
    •  JPEG, JPEGLS, JPEG2000, JPEGXR,
  • Comparison of the main or baseline/simple profile of MPEG-2 and H.264:
    • Review the two standards in detail.
    • Compare in terms of complexity, video quality , bit rates, compression ratio, advantages and disadvantages.
    • Also, discuss various existing transcoding methods between the two standards.
  • Blockeffect -
    • Compare, evaluate and discuss various blocky distortion minimization techniques in block based (hybrid) DCT codecs at low bit rates and ways to minimize the blocky structure.
    • Also run the simulation using standard test images.
• Subjective Quality Measures
  • Structural Similarity Index (SSIM) SSIMH.264 SSIMProject1 SSIMZhou-Wang
  • JND/VDM of Sarnoff Corp.

• Other Topics
  • T-DMB - (Terrestrial digital multimedia broadcasting),
    • see S.Cho et al, "System and services of terrestrial digital multimedia broadcasting (T-DMB)", IEEE Trans. Broadcasting, vol.53, pp. 171-177, March 2007.
    • K.-Y.Kim et al, "Efficient generation of scalable transport stream for high quality service in T-DMB", ETRI Journal. vol.31, pp.65-67, Feb. 2010.

  • Compression of color filter array (CFA) HD video sequences.  

    • Develop efficient low complexity compression algorithms and compare with the existing algorithms  (see files cfa1 and cfa2  for references). 

  • Mixed Raster Content
    • MRC
    • R. de queiroz, R. Buckley and M. Xu, "Mixed Raster Content (MRC) model for compound image compression", photonics west, SPIE, vol. 3653, PP, 1106-1117, San Jose, CA, Jan.1999.
  • All zero block detection technique
    • All zero block detection(quantized DCT coefficients of prediction error block are zeros) can lead to early termination of motion estimation(ME) process in hybrid coding (inner frame prediction aided by motion estimation - motion compensated prediction error goes through transform - DCT - quantization and coding). All zero block detection technique is useful for fast ME.
    • See papers in files MEMC1, MEMC2, MEMC3, MEMC4 specially references 14-30.
    • Review, compare and develop fast ME techniques based on early termination ( all zero block detection).
  • "Modeling quantization matrices for perpetual image/video encoding",
    • see the paper by H.Zhang and G.Cote, SPIE vol. 6822, pp. 682210-1 through 682210-8, San Jose, CA, Jan., 2008.
  • Wavelets and lapped transforms in an H.264/AVC coder,
    • IEEE ICIP2008, pp137-140. R.G.de oliveira and R.L. de queiroz
  • Multiple description coding
  • Matching pursuits
  • An effective and robust fingerprint enhancement by adaptive filtering in the frequency domain,
    • see the paper A.M. Raičević and B.M. Popović, “An effective and robust fingerprint enhancement by adaptive filtering in frequency domain,” Series: Electronics and Energetics, Facta Universitatis (NIS), Serbia, pp. 91–104, April 2010.
      Available: http://factaee.elfak.ni.ac.rs/
    • Block diagram for the fingerprint enhancement is shown in Fig. 4. Note that this is an application of FFT. Figures 6 and 7 show directional filtered images and enhanced image respectively. Filtered images for directions (a) 22.5 degrees and (b) 90 degrees are shown in Fig. 6.

    • In Raičević and Popović (please access the paper) apply adaptive directional filtering in the frequency domain for fingerprint image enhancement and as well denoising.

    • Apply this algorithm to smudges and corrupted fingerprints (see Fig. 1) and obtain the enhanced images (similar to Fig. 7).

    • Obtain filtered images for other directions besides 22.5 degrees and 90 degrees.

    • Write a detailed project report based on your simulations. Review of the references listed at the end of this paper will be very helpful.
       

  • Integer Transforms   

    • See the paper J. Dong et al, " 2-D order integer transforms for HD video coding", IEEE Trans. CSVT, vol. 19, pp. 1462-1474, Oct. 2010 and the references  cited =>  Several research topics :

    •  implementing/evaluating AVS video enhanced profile (EP) and H.264 high profile (HP)  based on 2-D order 16 transforms  (both NICT and MICT)  are suggested. 

    • See Section V - Integration of the 2-D order-16 integer transforms into the standards - of this paper.

• Information on the Internet
  • This Appendix lists web sites maintained by standards bodies, fora, consortia, alliances, research institutes, private organizations, Universities, industry, professional / technical societies etc. The list is quite extensive and every effort is made to compile this list up to date. In view of the rapid changes, some sites may no longer exist and new ones may have been developed.
    The main objective is to provide the reader with the wealth of information available on the Internet.

2. Audio Codecs

• HE-AAC v2 Audio (ISO/IEC 14496-3)
  J.M. Boyce, " The US digital television broadcasting transition", IEEE Signal Processing magazine, Vol. 26, pp.112-110, May 2010
• ATSC M/H DTV Braodcasting (Advanced Televsion Systems Committee, Mobile/Handheld); supports handheld and in-car devices.
  This candidate standard is based on video (H.264) audio HE-AAC v2.
• MPEG-1 audio
• MPEG-2 audio
• AC3 AC3ref
• AAC MPEGAAC
• AAC + SBR (HE-AAC)
• MP3 + SBR (MP PRO)
• WMA (Windows Media Audio)-Microsoft MPEGAAC
• AVS-China Audio MPEGAAC
• AVS-China Audio (with SBR)MPEGAAC
• ISPACSKS3 audio 06/24/08
• SBR 06/24/08 SBR FILES
• SBRAACPLUS 06/24/08
• SBRSLIDES 06/24/08
• SMPTEVC1 06/24/08
• SMPTEVC1testmaterials 06/24/08
• Enhanced AC-3 standard of ATSC (see the paper cited in ATSC DTV standard)
• MPEG 1 Layer3 (MP3) , MPEG-2 AAC and HE-AAC. Discuss encoder decoder block diagrams, advantages and disadvantages.
• MPEG Surround audio coder, "ISO/IE C230003-1 Information Technology - MPEG audio technologies-Part 1, MPEG Surround, Feb. 2007.
• Scalable audio coding http://mpeg.chiariglione.org
• Spatial audio coding http://digital-media-project.org
• Joint speech and music coding
• ATSC audio codec (AC3EAC3) A9R628.pdf
• ATSC website

PREVIOUS PROJECTS :

MATLAB Educational Sites :

Any books or papers not available (accessible) from UTA library can be requested via interlibrary loan, online.

UTA Library Resources