Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding

ÖZBEK, Nükhet

Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding

Nükhet ÖZBEK (Yaşar Üniversitesi, Bilgisayar Mühendisliği Bölümü, İzmir, Türkiye)

Turkish Journal of Electrical Engineering and Computer Sciences

3 0

Yıl: 2012 Cilt: 20 Sayı: 4 Sayfa Aralığı: 557 - 567 Metin Dili: İngilizce İndeks Tarihi: 29-07-2022

Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding

Öz:

The concept of quality layers (QLs) has been adopted in the scalable video coding standard to enable optimal rate adaptation of precoded video in the rate-distortion sense. QLs were previously extended to stereo and multiple-view scalable video for efficient transport of 3DTV over the Internet. However, it is not possible to use the QL method in applications that require real-time encoding since the priority determination process assumes the availability of the whole video sequence. In this work, a trellis-based online rate adaptation is proposed for real-time scalable stereo video coding, with a delay of 1 group of pictures (GoP). The delay can be controlled by selection of the GoP size according to the application, such as 16 frames for live broadcast or 8 or 4 frames for videoconferencing. In addition, the joint optimization of layer extraction for scalable multiview coded stereo video is also proposed. It is assumed that the encoder/extractor is aware of the available dynamic network bandwidth in order to perform rate-distortion optimized medium-grain fidelity scalability layer selection for each GoP. Experimental results show that the performance of the proposed online method is very close to that of QLs that would require the whole video sequence.

Anahtar Kelime:

Konular: Mühendislik, Elektrik ve Elektronik

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık

[1] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG, ISO/IEC ITU-T Rec. H.264: Advanced Video Coding for Generic Audiovisual Services, 2003.
[2] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG, Text of ISO/IEC 14496-10:2005/FDAM 3 Scalable Video Coding, Lausanne, N9197, 2007.
[3] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG, Text of ISO/IEC 14496-10:2008/FDAM 1 Multiview Video Coding, 2008.
[4] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG, Text of ISO/IEC 14496-4:2001/PDAM 19 Reference Software for SVC, N9195, 2007.
[5] JSVM Software Manual, JSVM 9.17, 2009, available at cvs://garcon.ient.rwthi- aachen.de:/cvs./jvt.
[6] H. Kirchhoffer, D. Marpe, H. Schwarz, T. Wiegand, “A low-complexity approach for increasing the granularity of packet-based fidelity scalability in scalable video coding”, Picture Coding Symposium, Lisbon, 2007.
[7] I. Amonou, N. Cammas, S. Kervadec, S. Pateux, “Optimized rate-distortion extraction with quality layers in the scalable extension of H.264/AVC”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, pp. 1186-1193, 2007.
[8] P. Merkle, A. Smolic, K. M¨uller, T. Wiegand, “Efficient prediction structures for multi-view video coding”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, pp. 1461-1472, 2007.
[9] N. Ozbek, A.M. Tekalp, “Scalable multi-view video coding for interactive 3DTV”, IEEE International Conference on Multimedia & Expo, Toronto, pp. 213-216, 2006.
[10] N. Ozbek, A.M. Tekalp, “Unequal inter-view rate allocation using scalable stereo video coding and an objective stereo video quality measure”, IEEE International Conference on Multimedia & Expo, Hannover, pp. 1113-1116, 2008.
[11] N. Ozbek, A.M. Tekalp, “Rate-visual-distortion optimized extraction with quality layers for scalable coding of stereo videos”, IEEE International Conference on Image Processing, San Diego, pp. 2104-2107, 2008.
[12] N. Ozbek, A.M. Tekalp, “Quality layers in scalable multi-view video coding”, IEEE International Conference on Multimedia & Expo, New York, pp. 185-188, 2009.
[13] A. Ortega, K. Ramchandran, M. Vetterli, “Optimal trellis-based buffered compression and fast approximations”, IEEE Transactions on Image Processing, Vol. 3, pp. 26-40, 1994.
[14] G.M. Schuster, A.K. Katsaggelos, “A video compression scheme with optimal bit allocation among segmentation, motion, and residual error”, IEEE Transactions on Image Processing, Vol. 6, pp. 1487-1502, 1997.
[15] M. Luttrell, J. Wen, J.D. Villasenor, “Trellis-based R-D optimal quantization in H.263+”, IEEE Transactions on Image Processing, Vol. 9, pp. 1431-1434, 2000.
[16] Z. Li, G.M. Schuster, A. Katsaggelos, B. Gandhi, “MINMAX optimal video summarization”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 15, pp. 1245-1256, 2005.
[17] T.C. Thang, J.W. Kang, J.J. Yoo, Y.M. Ro, “Optimal multi-layer adaptation of SVC video over heterogeneous environments”, Advances in Multimedia 2008. doi: 10.1145/1280940.1281006.
[18] M. Handley, S. Floyd, J. Padhye, J. Widmer, “TCP friendly rate control (TFRC)”, Internet Engineering Task Force RFC 3448, 2003.
[19] G.D. Forney, “The Viterbi algorithm”, Proceedings of the IEEE, Vol. 61, pp. 268-278, 1973.
[20] K. Ramchandran, A. Ortega, M. Vetterli, “Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders”, IEEE Transactions on Image Processing, Vol. 3, pp. 533-545, 1994.
[21] ITU-T, “End-user multimedia QoS categories”, Recommendation G.1010, 2001.
[22] D.V. Meegan, L.B. Stelmach, W.J. Tam, “Unequal weighting of monocular inputs in binocular combination: implications for the compression of stereoscopic imagery”, Journal of Experimental Psychology: Applied, Vol. 7, pp. 143-153, 2001.
[23] L.M.J. Meesters, W.A. IJsselstejn, P.J.H. Seuntiens, “A survey of perceptual evaluations and requirements of threedimensional TV”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 14, pp. 381-391, 2004.

APA	ÖZBEK N (2012). Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. , 557 - 567.
Chicago	ÖZBEK Nükhet Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. (2012): 557 - 567.
MLA	ÖZBEK Nükhet Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. , 2012, ss.557 - 567.
AMA	ÖZBEK N Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. . 2012; 557 - 567.
Vancouver	ÖZBEK N Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. . 2012; 557 - 567.
IEEE	ÖZBEK N "Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding." , ss.557 - 567, 2012.
ISNAD	ÖZBEK, Nükhet. "Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding". (2012), 557-567.

APA	ÖZBEK N (2012). Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. Turkish Journal of Electrical Engineering and Computer Sciences, 20(4), 557 - 567.
Chicago	ÖZBEK Nükhet Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. Turkish Journal of Electrical Engineering and Computer Sciences 20, no.4 (2012): 557 - 567.
MLA	ÖZBEK Nükhet Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. Turkish Journal of Electrical Engineering and Computer Sciences, vol.20, no.4, 2012, ss.557 - 567.
AMA	ÖZBEK N Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. Turkish Journal of Electrical Engineering and Computer Sciences. 2012; 20(4): 557 - 567.
Vancouver	ÖZBEK N Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding. Turkish Journal of Electrical Engineering and Computer Sciences. 2012; 20(4): 557 - 567.
IEEE	ÖZBEK N "Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding." Turkish Journal of Electrical Engineering and Computer Sciences, 20, ss.557 - 567, 2012.
ISNAD	ÖZBEK, Nükhet. "Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding". Turkish Journal of Electrical Engineering and Computer Sciences 20/4 (2012), 557-567.