基于机器学习的HEVC快速帧内预测算法研究进展Advances in research of HEVC fast intra-frame prediction algorithm based on machine learning
艾达,卢雪磊,高阳,董久军
摘要(Abstract):
高效率视频编码(HEVC)存在帧内预测计算复杂度过高的情况,而机器学习方法在HEVC快速帧内预测算法的研究取得了一定的进展。对近年来常用的机器学习算法在帧内预测快速深度决策和模式决策两方面的应用进行详述,总结比较不同文献提出的机器学习方法在编码性能上的优劣,最后分析机器学习算法在帧内编码应用中存在的问题,为下一步研究提供参考性建议。
关键词(KeyWords): 高效视频编码;帧内预测;深度决策;模式决策;机器学习;计算复杂度
基金项目(Foundation): 国家自然科学基金资助项目(61202183);; 公安部科技强警专项资助项目(2016GABJC51)~~
作者(Author): 艾达,卢雪磊,高阳,董久军
DOI: 10.16652/j.issn.1004-373x.2018.18.042
参考文献(References):
- [1]SULLIVAN G J,OHM J R,HAN W J,et al.Overview of the high efficiency video coding(HEVC)standard[J].IEEE transactions on circuits and systems for video technology,2013,22(12):1649-1668.
- [2]KIM I K,MIN J,LEE T,et al.Block partitioning structure in the HEVC standard[J].IEEE transactions on circuits and systems for video technology,2012,22(12):1697-1706.
- [3]LAINEMA J,BOSSEN F,HAN W J,et al.Intra coding of the HEVC standard[J].IEEE transactions on circuits and systems for video technology,2012,22(12):1792-1801.
- [4]OHM J,SULLIVAN G J,SCHWARZ H,et al.Comparison of the coding efficiency of video coding standards:including high efficiency video coding(HEVC)[J].IEEE transactions on circuits and systems for video technology,2013,22(12):1669-1684.
- [5]BOSSEN F,BROSS B,SUHRING K,et al.HEVC complexity and implementation analysis[J].IEEE transactions on circuits and systems for video technology,2013,22(12):1685-1696.
- [6]CORREA G,ASSUNCAO P,AGOSTINI L,et al.Complexity control of HEVC through quadtree depth estimation[C]//Proceedings of EUROCON.Zagreb:IEEE,2013:81-86.
- [7]MERCAT A,ARRESTIER F,HAMIDOUCHE W,et al.Constrain the docile CTUs:an in-frame complexity allocator for HEVC intra encoders[C]//Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing.New Orleans:IEEE,2017:1163-1167.
- [8]颜松远.机器学习理论及应用[J].计算机工程与科学,2012,34(9):201.YAN Songyuan.Theory and application of machine learning[J].Computer engineering and science,2012,34(9):201.
- [9]CHERKASSKY V.The nature of statistical learning theory[J].IEEE transactions on neural networks,1997,8(6):1564.
- [10]ZHANG Y,KWONG S,WANG X,et al.Machine learningbased coding unit depth decisions for flexible complexity allocation in high efficiency video coding[J].IEEE transactions on image processing,2015,24(7):2225-2238.
- [11]张峻,董兰芳,余家奎.高效率视频编码快速帧内预测算法[J].计算机应用,2015,35(8):2327-2331.ZHANG Jun,DONG Lanfang,YU Jiakui.Fast intra prediction algorithm for high efficiency video coding[J].Journal of computer applications,2015,35(8):2327-2331.
- [12]SHEN X,YU L.CU splitting early termination based on weighted SVM[J].EURASIP journal on image&video processing,2013(1):1-11.
- [13]LIU D,LIU X,LI Y.Fast CU size decisions for HEVC intra frame coding based on support vector machines[C]//Proceedings of International Conference on Dependable,Autonomic and Secure Computing.Auckland:IEEE,2016:594-597.
- [14]SHAN Y,YANG E H.Fast HEVC intra coding algorithm based on machine learning and Laplacian transparent composite model[C]//Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing.New Orleans:IEEE,2017:2642-2646.
- [15]RUIZ-COLL D,ADZIC V,FERNáNDEZ-ESCRIBANO G,et al.Fast partitioning algorithm for HEVC intra frame coding using machine learning[C]//Proceedings of IEEE International Conference on Image Processing.Paris:IEEE,2015:4112-4116.
- [16]ZHENG X,ZHAO Y,BAI H,et al.Fast algorithm for intra prediction of HEVC using adaptive decision trees[J].KSII transactions on internet and information systems,2016,10(7):3286-3300.
- [17]DU B,SIU W C,YANG X.Fast CU partition strategy for HEVC intra-frame coding using learning approach via random forests[C]//Proceedings of Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.Hong Kong:IEEE,2016:1085-1090.
- [18]MOMCILOVIC S,ROMA N,SOUSA L,et al.Run-time machine learning for HEVC/H.265 fast partitioning decision[C]//Proceedings of IEEE International Symposium on Multimedia.Miami:IEEE,2016:347-350.
- [19]SETIONO R,HUI L C K.Use of a quasi-Newton method in a feedforward neural network construction algorithm[J].IEEE transactions on neural networks,1995,6(1):273-277.
- [20]CUI W,ZHANG T,ZHANG S,et al.Convolutional neural networks based intra prediction for HEVC[C]//Proceedings of Data Compression Conference.Snowbird:IEEE,2017:436.
- [21]祝世平,张春燕.基于机器学习的HEVC帧内模式快速决策算法[J].光电子·激光,2016,27(11):1199-1207.ZHU Shiping,ZHANG Chunyan.A fast HEVC intra mode decision algorithm based on machine learning[J].Journal of optoelectronics·laser,2016,27(11):1199-1207.
- [22]HU Q,SHI Z,ZHANG X,et al.Fast HEVC intra mode decision based on logistic regression classification[C]//Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.Nara:IEEE,2016:1-4.
- [23]LIU Z,YU X,CHEN S,et al.CNN oriented fast HEVC intra CU mode decision[C]//Proceedings of IEEE International Symposium on Circuits and Systems.Montreal:IEEE,2016:2270-2273.
- [24]YU X,LIU Z,LIU J,et al.VLSI friendly fast CU/PU mode decision for HEVC intra encoding:leveraging convolution neural network[C]//Proceedings of IEEE International Conference on Image Processing.Quebec:IEEE,2015:1285-1289.
- [25]LAUDE T,OSTERMANN J.Deep learning-based intra prediction mode decision for HEVC[C]//Proceedings of Picture Coding Symposium.Nuremberg:IEEE,2017:1-5.
- [26]LIU Z,YU X,GAO Y,et al.CU partition mode decision for HEVC hardwired intra encoder using convolution neural network[J].IEEE transactions on image processing,2016,25(11):5088-5103.