UDC 621.317+681.849
|
|
2 National Academy of Internal Affairs, Kyiv, Ukraine
|
3 Kyiv Scientific-Research Expert-Forensic Center of the Ministry of the Interior Affairs of Ukraine, Kyiv, Ukraine
 fonoscopia@ukr.net
|
4 Odesa Scientific-Research Institute of Forensic Expertise of the Ministry of Justice of Ukraine, Odesa, Ukraine
alik.shablya@gmail.com
|
5 Kyiv Scientific-Research Expert-Forensic Center of the Ministry of the Interior Affairs of Ukraine, Kyiv, Ukraine
e.tymko@kndise.gov.ua
|
|
A METHOD FOR CONSTRUCTING A SYSTEM FOR DETECTING
AND LOCALIZING THE PLACES FOR EDITING DIGITAL VIDEOGRAMS
Abstract. The basic approach and method for creating a system for detecting montage in digital videograms are considered and proposed. The proposed approach is based on the identification studies of digital image recording equipment by its own noise recorded on digital media. It has been established that the method for detecting traces and localizing edit points in videograms should be based on the use of the functions of the dynamics of errors in the identification of adjacent frames and the dynamics of the change in the function of the modulus of the difference in the levels of chrominance signals of two frames of the videogram being checked. To obtain these functions, it is proposed to apply signal decomposition using the Haar wavelet. It is shown that the implementation of the system should be carried out on deep learning neural networks, which will ensure high reliability of the examination.
Keywords: digital image recording equipment, wavelets, videogram, signal decomposition, identification, matrix, deep learning neural networks, intrinsic noise, forensics.
full text
REFERENCES
- Rybalskiy O.V. On the possibility of creating a method for verifying the authenticity of still images recorded on digital media. Special equipment for law enforcement activities. Materials of the 3rd International Conference of KNUVS (25–26 June 2007, Kiev, Ukraine). Kyiv, 2007. P. 13–14.
- Rybalskiy O.V., Solovyov V.I. On the development of the theory, methods and means of conducting examination of digital photo, video and sound recording materials. Suchasna spetsialʹna tekhnika. 2012. N 3 (30). P. 119–121.
- Rybalskiy O.V., Soloviev V.I., Belozerov E.V. Program for identifying digital photo and video equipment and checking the originality of digital images. Collection of scientific works of the Military Institute of Taras Shevchenko Kyiv National University. 2013. Iss. 41. P. 77–80.
- Rybalskiy O.V., Solovyov V.I., Belozyorov E.V. Methodology for the development of methods and programs for conducting identification analysiss of digital image recording equipment. Suchasna spetsialʹna tekhnika. 2013. N 2 (33). P. 3–7.
- Solovyov V.I., Rybalskiy O.V., Zhuravel V.V., Semenova N.V. Analyzing the models of speech recognition on the basis of neural networks of deep learning for examination of digital phonograms. Cybernetics and Systems Analysis. 2021. Vol. 57. N 1. P. 133–138. https://doi.org/10.1007/s10559-021-00336-y .
- Zhang K., Zuo W., Chen Y., Meng D., Zhang L. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing. 2017. Vol. 26, N 7. P. 3142–3155.
- Cozzolino D., Verdoliva L. Noiseprint: A CNN-based camera model fingerprint. IEEE Trans. Inf. Forensics Secur. 2020. Vol. 15. P. 144–159.
- Li Y., Lyu S. Exposing deepfake videos by detecting face warping artifacts. Proc. IEEE 14 Conference on Computer Vision and Pattern Recognition Workshops. 2019. P. 46–52. URL: https://arxiv.org/pdf/1811.00656.pdf .
- Li L., Bao J., Zhang T., Yang H., Chen D., Wen F., Guo B. Face X-ray for more general face forgery detection. Proc. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (13–19 June 2020, Seattle, USA). Seattle, 2020. P. 5000–5009.
- Lee G., Kim M. Deepfake detection using the rate of change between frames based on computer vision. Sensors. 2021. Vol. 21, Iss. 21. 7367. https://doi.org/10.30534/ijatcse/2020/62922020.
- Li Y., Chang M.-C., Lyu S. Inictu oculi: exposing AI created fake videos by detecting eye blinking. Proc. 2018 IEEE International Workshop on Information Forensics and Security (WIFS) (11–13 December 2018, Hong Kong, China). Hong Kong, 2018. P. 1–7. URL: https://arxiv.org/pdf/1806.02877.pdf .
- Koopman M., Rodriguez A.M., Geradts Z. Detection of deepfake video manipulation. Proc. Irish Machine Vision and Image Processing Conference 2018 (IMVIP 2018) (29–31 August 2018, Belfast, Northern Ireland). Belfast, 2018. P. 133–136.
- Zhu W., Ma Y., Zhou Y., Benton M., Romagnoli J. Deep learning based soft sensor and its application on a pyrolysis reactor for compositions predictions of gas phase components. In: Computer Aided Chemical Engineering. Eden M.R., Ierapetritou M.G., Towler G.P. (Eds.). Elsevier, 2018. Vol. 44. P. 2245–2250.
- Shcherbyna Y., Kazakova N., Fraze-Frazenko O., Parchuts L., Schneider S. Analysis of attacks in modern cyberphysical systems. Proc. 1st International Conference on Intellectual Systems and Information Technologies (ISIT 2019) (19–24 August 2019 Odesa, Ukraine). Odesa, 2019. CEUR Workshop Proceedings. 2019. Vol. 2683. P. 12–14.
- Schisterman E.F., Perkins N.J., Liu A., Bondell H. Optimal cut-point and its corresponding Youden Index to discriminate individuals using pooled blood samples. Epidemiology. 2005. Vol. 16, Iss. 1. P. 73–81. https://doi.org/10.1097/01.ede.0000147512.81966.ba .
- Dudykevich V.B., Mykytyn G.V., Ruda H.S. Application of deep learning to detect Deepfakes of biometric image modifications. Suchasna spetsialʹna tekhnika. 2022. N 1 (68). P. 13–32.
- Dyakonov V.P., Malla S. Wavelets in signal processing [Russian translation]. Moscow: Mir, 2005. 670 p.
- Solovyov V.I., Rybalskiy O.V., Zhuravel V.V., Shablya O.M., Tymko E.V. Ability to identify digital video recording equipment and digital cameras. Kibernetyka ta systemnyi analiz. 2022. Vol. 58, N 6. P. 31–37.
