A Deep Learning Model for Splicing Image Detection

Hoang Linh Nguyen, Kha Tu Huynh

Abstract


With the advancement of digital technology, manipulating images has become relatively easy through many photo editing techniques. One of the techniques is the splicing image method, which crops parts of images and puts them into another image creating a new composite image. The image splicing detection system is soon regarded as an exciting topic for many researchers to solve the problems of forgery images on the Internet, especially in social networks. ResNet-50 and VGG-16 are powerful architectures of convolutional neural networks, but they reveal many weaknesses when operating on low-end computers. The ultimate goal of this research is to create a model for image splicing detection working well in limited memory machines. The study proposes the model, which is the improvement of VGG-16 applying residual network (ResNet). As a result, the proposed model achieves a test accuracy of 92.5% while the ResNet-50 gives an accuracy of 85.6% after 20 epochs of training 9,319 images from the CASIA v2.0 dataset, which are used for forgery classification. The result proves the efficiency of the proposed model for image splicing detection, especially when working on low-end computers.


Full Text:

PDF

References


REFERENCES

Shi, Y.Q., Chen, C., Chen, W.: A natural image model approach to splicing detection. Proceedings of the 9th Workshop on Multimedia and Security, pp. 51-62 (2007).

He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition (2015). cite. arXiv preprint arxiv:1512.03385.

Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. 2014 Sep 4.

Rezende E, Ruppert G, Carvalho T, Ramos F, De Geus P. Malicious software classification using transfer learning of resnet-50 deep neural network. In2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA) 2017 Dec 18 (pp. 1011-1014). IEEE.

He, Z.; Lu, W.; Sun, W.; Huang, J. Digital image splicing detection based on Markov features in DCT and DWT domain. Pattern Recognit. 2012, 45, 4292–4299.

Su, B.; Yuan, Q.; Wang, S.; Zhao, C.; Li, S. Enhanced state selection Markov model for image splicing detection. EURASIP J. Wirel. Commun. Netw. 2014, 2014, 7.

Moghaddasi, Z.; Jalab, H.A.; Noor, R.M.; Aghabozorgi, S. Improving RLRN Image Splicing Detection with the Use of PCA and Kernel PCA. Sci. World J. 2014, 2014, 606570.

Moghaddasi, Z.; Jalab, H.A.; Noor, R. Image splicing forgery detection based on low-dimensional singular value decomposition of discrete cosine transform coefficients. Neural Comput. Appl. 2018, 31, 7867–7877.

Zhang, Y.; Shi, T. Image Splicing Detection Scheme Based on Error Level Analysis and Local Binary Pattern. Netw. Intell. 2021, 6, 303–312.

Nath, S.; Naskar, R. Automated image splicing detection using deep CNN-learned features and ANN-based classifier. Signal Image Video Process. 2021, 15, 1601–1608.

A. Jaiswal and R. Srivastava, “Image splicing detection using deep residual network.” 2nd International Conference on Advanced Computing and Software Engineering (ICACSE), 2019.

Hosny, K.M.; Mortda, A.M.; Lashin, N.A.; Fouda, M.M. A New Method to Detect Splicing Image Forgery Using Convolutional Neural Network. Appl. Sci. 2023, 13, 1272.

Ioffe S, Szegedy C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. InInternational conference on machine learning 2015 Jun 1 (pp. 448-456). PMLR.

Wu Y, Johnson J. Rethinking" batch" in batchnorm. arXiv preprint arXiv:2105.07576. 2021 May 17.

Yao Z, Cao Y, Zheng S, Huang G, Lin S. Cross-iteration batch normalization. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2021 (pp. 12331-12340).

Tan HH, Lim KH. Vanishing gradient mitigation with deep learning neural network optimization. In2019 7th international conference on smart computing & communications (ICSCC) 2019 Jun 28 (pp. 1-4). IEEE.

Sudiatmika, Ida & Rahman, Fathur & Trisno, Trisno & Suyoto, Suyoto. (2018). Image forgery detection using error level analysis and deep learning. TELKOMNIKA (Telecommunication Computing Electronics and Control). 17. 653. 10.12928/telkomnika.v17i2.8976.

Sheldon, R. (2022, July 12). What is image compression and how does it work? WhatIs.com. Retrieved March 23, 2023, from https://www.techtarget.com/whatis/definition/image-compression.

GeeksforGeeks. (2022, March 18). What is padding in neural network? GeeksforGeeks. Retrieved March 23, 2023, from https://www.geeksforgeeks.org/what-is-padding-in-neural-network.

Papers with Code - Max Pooling Explained. (n.d.). Retrieved March 23, 2023, from https://paperswithcode.com/method/max-pooling.

Dong, J.; Wang, W.; Tan, T. CASIA image tampering detection evaluation database. In Proceedings of the 2013 IEEE China Summit and International Conference on Signal and Information Processing, Beijing, China, 6–10 July 2013; pp. 422–426.




DOI: http://dx.doi.org/10.21553/rev-jec.335

Copyright (c) 2023 REV Journal on Electronics and Communications


ISSN: 1859-378X

Copyright © 2011-2024
Radio and Electronics Association of Vietnam
All rights reserved