TY - GEN
T1 - TRANSFORMER AND NODE-COMPRESSED DNN BASED DUAL-PATH SYSTEM FOR MANIPULATED FACE DETECTION
AU - Luo, Zhengbo
AU - Kamata, Sei Ichiro
AU - Sun, Zitang
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Deep neural networks (DNNs) have extensively promoted data generation development; the quality of these generated content has achieved an impressive new level. Therefore, manipulated content, especially facial manipulation, is a growing concern for online information legitimacy. Most current deep learning-based methods depend on local features sampled by convolutional kernels and lack knowledge globally. To address the problem, we propose a dual-path pipeline using Neural Ordinary Differential Equations (NODE) based neural network and facial-feature biased transformer to deal with the visual content from a different view. The transformer path could link these landmarks in a long-range, moreover, we adopt an attention guided augmentation based self-ensemble for more robust performance. Extensive experiments show that our system could surpass several commonly used approaches in terms of video-level accuracy and AUC with better interpretability.
AB - Deep neural networks (DNNs) have extensively promoted data generation development; the quality of these generated content has achieved an impressive new level. Therefore, manipulated content, especially facial manipulation, is a growing concern for online information legitimacy. Most current deep learning-based methods depend on local features sampled by convolutional kernels and lack knowledge globally. To address the problem, we propose a dual-path pipeline using Neural Ordinary Differential Equations (NODE) based neural network and facial-feature biased transformer to deal with the visual content from a different view. The transformer path could link these landmarks in a long-range, moreover, we adopt an attention guided augmentation based self-ensemble for more robust performance. Extensive experiments show that our system could surpass several commonly used approaches in terms of video-level accuracy and AUC with better interpretability.
KW - DeepFake detection
KW - Face manipulation
KW - Image forensics
KW - Neural network
UR - http://www.scopus.com/inward/record.url?scp=85125596078&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85125596078&partnerID=8YFLogxK
U2 - 10.1109/ICIP42928.2021.9506222
DO - 10.1109/ICIP42928.2021.9506222
M3 - Conference contribution
AN - SCOPUS:85125596078
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 3882
EP - 3886
BT - 2021 IEEE International Conference on Image Processing, ICIP 2021 - Proceedings
PB - IEEE Computer Society
T2 - 2021 IEEE International Conference on Image Processing, ICIP 2021
Y2 - 19 September 2021 through 22 September 2021
ER -