Keyframe Extraction Techniques: A Review

Authors

  • Bashir Olaniyi Sadiq
  • Bilyamin Muhammad Kaduna Federal Polytechnic, Kaduna State
  • Muhammad Nasir Abdullahi
  • Gabriel Onuh
  • Ali Abdulhakeem Muhammed
  • Adeogun Emmanuel Babatunde

DOI:

https://doi.org/10.11113/elektrika.v19n3.221

Abstract

Video is an audiovisual data that comprises of large number of frames.  Analyzing and processing such large amount of data is difficult to many applications.  Therefore, there is need for an effective video management scheme to manage these huge volume of video frames in order to provide easy access to the video content in lesser time.  Keyframe extraction is the first step for video browsing, indexing and retrieval.  Many techniques exist for the extraction of keyframes.  However, some of the present techniques come with one or more limitations.  In this paper, a brief review on the existing techniques is presented.  Also, the merits and demerits of each technique is also stated.  

Author Biography

Bilyamin Muhammad, Kaduna Federal Polytechnic, Kaduna State

Department of Computer Engineering

References

C. Sujatha and U. Mudenagudi, "A study on keyframe extraction methods for video summary," in 2011 International Conference on Computational Intelligence and Communication Networks, 2011, pp. 73-77: IEEE.

J. Li, Y. Ding, Y. Shi, and W. Li, "A Divide And Rule Scheme For Shot Boundary Detection Based on SIFT," International Journal of Digital Content Technology and its Applications, vol. 4, pp. 202-214, 2010.

J. H. Yuan, H. Y. Wang, and B. Zhang, “A formal study of shot boundary detectionâ€, Journal of Transactions on Circuits and Systems for Video Technology, vol. 17, no. 2, pp. 168-186, February 2007

G. Kumar, Naveen, V. Reddy, and S. S. Kumar, "Video shot boundary detection and key frame extraction for video retrieval," in Proceedings of the Second International Conference on Computational Intelligence and Informatics, 2018, pp. 557-567: Springer.

S. Santini, "Who needs video summarization anyway?," in International Conference on Semantic Computing (ICSC 2007), 2007, pp. 177-184: IEEE.

A. Paul, K. Milan, J. Kavitha, J. Rani, and P. Arockia, "Key-Frame Extraction Techniques: A Review," Recent Patents on Computer Science, vol. 11, no. 1, pp. 3-16, 2018.

H. Gharbi, S. Bahroun, and E. Zagrouba, "A Novel Key Frame Extraction Approach for Video Summarization," in VISIGRAPP (3: VISAPP), 2016, pp. 148-155.

S. H. Abdulhussain, A. R. Ramli, M. I. Saripan, B. M. Mahmmod, S. A. R. Al-Haddad, and W. A. Jassim, "Methods and challenges in shot boundary detection: a review," Entropy, vol. 20, no. 4, p. 214, 2018.

M. Furini, F. Geraci, M. Montangero, M. Pellegrini, and Applications, "STIMO: STIll and MOving video storyboard for the web scenario," Multimedia Tools Applications, vol. 46, no. 1, p. 47, 2010.

C. Liu, D. Wang, J. Zhu, and B. Zhang, "Learning a contextual multi-thread model for movie/tv scene segmentation," IEEE transactions on multimedia, vol. 15, no. 4, pp. 884-897, 2013.

O. Küçüktunç, U. Güdükbay, Ö. Ulusoy, and I. Understanding, "Fuzzy color histogram-based video segmentation," Computer Vision Image Understanding, vol. 114, no. 1, pp. 125-134, 2010.

I. A. Zedan, K. M. Elsayed, and E. Emary, "News Videos Segmentation Using Dominant Colors Representation," in Advances in Soft Computing and Machine Learning in Image Processing: Springer, 2018, pp. 89-109.

X. Ling, O. Yuanxin, L. Huan, and X. Zhang, "A method for fast shot boundary detection based on SVM," in 2008 Congress on Image and Signal Processing, 2008, vol. 2, pp. 445-449: IEEE.

X. Jiang, T. Sun, J. Liu, J. Chao, and W. Zhang, "An adaptive video shot segmentation scheme based on dual-detection model," Neurocomputing, vol. 116, pp. 102-111, 2013.

K. ChoroÅ›, "Reduction of faulty detected shot cuts and cross dissolve effects in video segmentation process of different categories of digital videos," in Transactions on computational collective intelligence V: Springer, 2011, pp. 124-139.

Z. Cernekova, I. Pitas, and C. Nikou, "Information theory-based shot cut/fade detection and video summarization," IEEE Transactions on circuits systems for video technology, vol. 16, no. 1, pp. 82-91, 2005.

Y. Kawai, H. Sumiyoshi, and N. Yagi, "Shot Boundary Detection at TRECVID 2007," in TRECVID, 2007: Citeseer.

J. Yuan et al., "A formal study of shot boundary detection," IEEE transactions on circuits systems for video technology, vol. 17, no. 2, pp. 168-186, 2007.

L. Xue, C. Li, H. Li, and Z. Xiong, “A general method for shot boundary detectionâ€, In

Proceedings of the International Conference on Multimedia and Ubiquitous Engineering, pp. 394-397, 2008.

K. Wu, "Simple Implementations of Video Segmentation, Key Frame Extraction and Browsing," 2011.

H. H. YU, and W. WOLF, “A hierarchical multiresolution video shot Transition detection

schemeâ€, Journal of Computer Vision and Image Understanding, vol. 75, no. 1/2, pp. 196-213, 1999.

M.-S. Lee, Y.-M. Yang, and S.-W. Lee, "Automatic video parsing using shot boundary detection and camera operation analysis," Pattern Recognition, vol. 34, no. 3, pp. 711-719, 2001.

C. Vora, B. K. Yadav, and S. Sengupta, "Comprehensive Survey on Shot Boundary Detection Techniques," International Journal of Computer Applications, vol. 140, pp. 24-30, 2016.

Kathiriya, Dhaval S. Pipalia, Gaurav B. Vasani, Alpesh J. Thesiya, and D. J. Varanva, "Χ2 (Chi-Square) Based Shot Boundary Detection and Key Frame Extraction for Video," International Journal of Engineering and Science, vol. 2, no. 2, pp. 17-21, 2013.

A. Dailianas, R. B. Allen, and P. England, "Comparison of automatic video segmentation algorithms," in Integration Issues in Large Commercial Media Delivery Systems, 1996, vol. 2615, pp. 2-16: International Society for Optics and Photonics.

S. Bhardwaj and A. Mittal, "A survey on various edge detector techniques," Procedia Technology, vol. 4, pp. 220-226, 2012.

Nishani, E.; Çiço, B. Computer vision approaches based on deep learning and neural networks: Deep neural networks for video analysis of human pose estimation. In Proceedings of the 2017 6th Mediterranean Conference on Embedded Computing (MECO), Bar, Montenegro, 11–15 June 2017; pp. 1–4.

N. J. Janwe and K. K. Bhoyar, "Video key-frame extraction using unsupervised clustering and mutual comparison," International Journal of Image Processing,vol. 10, no. 2, pp. 73-84, 2016.

C. G. Chávez, F. Precioso, M. Cord, S. Phillip-Foliguet, and A. d. A. Araújo, "Shot Boundary Detection by a Hierarchical Supervised Approach," pp. 197-200, 2007.

J. Bi, X. Liu, and B. Lang, "A Novel Shot Boundary Detection Based on Information Theory using SVM," International Congress on Image and Signal Processing, pp. 512-516, 2011.

W. Tong, L. Song, X. Yang, H. Qu, and R. Xie, "CNN-based shot boundary detection and video annotation," in 2015 IEEE international symposium on broadband multimedia systems and broadcasting, 2015, pp. 1-5: IEEE.

C. V. Sheena and N. Narayanan, "Key-frame extraction by analysis of histograms of video frames using statistical methods," Procedia Computer Science, vol. 70, pp. 36-40, 2015.

M. Asim, N. Almaadeed, S. Al-Máadeed, A. Bouridane, and A. Beghdadi, "A key frame based video summarization using color features," in 2018 Colour and Visual Computing Symposium (CVCS), 2018, pp. 1-6: IEEE.

S. Jadon and M. Jasim, "Video Summarization," EasyChair2516-2314, 2019.

S. M. Tirupathamma, "Key frame based video summarization using frame difference," International Journal of Innovative Computer Science & Engineering, vol. 4, no. 03, pp. 160-165, 2017.

P. Kaur and R. Kumar, "Analysis of Video Summarization Techniques," International Journal for Research in Applied Science & Engineering Technology (IJRASET), vol. 6, no. 01, 2018.

X. Li, B. Zhao, and X. Lu, "Key frame extraction in the summary space," IEEE transactions on cybernetics, vol. 48, no. 6, pp. 1923-1934, 2017.

C. Huang and H. Wang, "A Novel Key-frames Selection Framework for Comprehensive Video Summarization," IEEE Transactions on Circuits and Systems for Video Technology, 2018.

J. Yuan, W. Wang, W. Yang, and M. Zhang, "Keyframe extraction using AdaBoost," in Proceedings 2014 IEEE International Conference on Security, Pattern Analysis, and Cybernetics (SPAC), 2014, pp. 91-94: IEEE.

V. Benni, R. Dinesh, P. Punitha, and V. Rao, "Keyframe extraction and shot boundary detection using eigen values," International Journal of Information Electronics Engineering, vol. 5, no. 1, p. 40, 2015.

P. Jadhava and D. Jadhav, "Video summarization using higher order color moments," in Proceedings of the International Conference on Advanced Computing Technologies and Applications (ICACTA), 2015, vol. 45, pp. 275-281.

B. Rashmi and H. Nagendraswamy, "Shot-based keyframe extraction using bitwise-XOR dissimilarity approach," in International Conference on Recent Trends in Image Processing and Pattern Recognition, 2016, pp. 305-316: Springer.

A. S. Murugan, K. S. Devi, A. Sivaranjani, and P. Srinivasan, "A study on various methods used for video summarization and moving object detection for video surveillance applications," Multimedia Tools Applications, vol. 77, no. 18, pp. 23273-23290, 2018.

Downloads

Published

2020-12-25

How to Cite

Sadiq, B. O., Muhammad, B., Abdullahi, M. N., Onuh, G., Muhammed, A. A., & Babatunde, A. E. (2020). Keyframe Extraction Techniques: A Review. ELEKTRIKA- Journal of Electrical Engineering, 19(3), 54–60. https://doi.org/10.11113/elektrika.v19n3.221

Issue

Vol. 19 No. 3 (2020): December

Section

Articles

License

Copyright of articles that appear in Elektrika belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.