Gan Pei * . Jiangning Zhang * . Menghan Hu . Zhenyu Zhang . Chengjie Wang . Yunsheng Wu.
Guangtao Zhai . Jian Yang . Chunhua Shen . Dacheng Tao
This work focuses on the aspect of facial manipulation in Deepfake, encompassing Face Swapping, Face Reenactment, Talking Face Generation, Face Attribute Editing and Forgery Detection. We believe this will be the most comprehensive survey to date on facial manipulation and detection technologies. Please stay tuned!😉😉😉
✨You are welcome to provide us your work with a topic related to deepfake generation or detection!!!
If you discover any missing work or have any suggestions, please feel free to submit a pull request or contact us. We will promptly add the missing papers to this repository.
[1] A comprehensive survey for visual Deepfake, including Deepfake generation/detection.
[2] It also contains several related domains, including Heas Swapping, Face Super-resolution, Face Reconstruction, Face Inpainting, Body Animation, Portrait Style Transfer, Makeup Transfer and Adversarial Sample Detection.
[3] We list detailed results for the most representative works.
This work presents a detailed survey on generation and detection tasks about face-related generation, including Face Swapping, Face Reenactment, Talking Face Generation, and Face Attribute Editing. In addition, we also introduce several related fields such as Head Swap, Face Super-resolution, Face Reconstruction, Face Inpainting, etc., and select some of them to expand.
Year | Venue | Paper Title | Code |
---|---|---|---|
2024 | arXiv | Large Motion Model for Unified Multi-Modal Motion Generation | Code |
2024 | arXiv | Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance | Code |
2024 | arXiv | Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance | Code |
2024 | AAAI | PTUS: Photo-Realistic Talking Upper-Body Synthesis via 3D-Aware Motion Decomposition Warping | Code |
2024 | CVPR | Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion | Code |
2024 | CVPR | DISCO: Disentangled Control for Realistic Human Dance Generation | Code |
2024 | CVPR | MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model | Code |
2024 | CVPR | GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians | Code |
2023 | arXiv | TADA! Text to Animatable Digital Avatars | Code |
2023 | WACV | Physically Plausible Animation of Human Upper Body From a Single Image | - |
2023 | ICCV | Towards Multi-Layered 3D Garments Animation | Code |
2023 | ICCV | Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation | Code |
2023 | CVPR | Learning anchor transformations for 3d garment animation | - |
2022 | IJCAI | Text/Speech-Driven Full-Body Animation | Code |
2022 | SIGGRAPH | Capturing and Animation of Body and Clothing from Monocular Video | - |
2022 | NeurIPS | CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and Animation | Code |
Year | Venue | Paper Title | Code |
---|---|---|---|
2024 | arXiv | Gorgeous: Create Your Desired Character Facial Makeup from Any Ideas | Code |
2024 | arXiv | Toward Tiny and High-quality Facial Makeup with Data Amplify Learning | Code |
2024 | arXiv | Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model | - |
2024 | CVPR | Makeup Prior Models for 3D Facial Makeup Estimation and Applications | Code |
2024 | ESWA | ISFB-GAN: Interpretable semantic face beautification with generative adversarial network | - |
2024 | TVCG | MuNeRF: Robust Makeup Transfer in Neural Radiance Fields | - |
2024 | ICASSP | Skin tone disentanglement in 2D makeup transfer with graph neural networks | - |
2024 | WACV | LipAT: Beyond Style Transfer for Controllable Neural Simulation of Lipstick Using Cosmetic Attributes | - |
2023 | arXiv | SARA: Controllable Makeup Transfer with Spatial Alignment and Region-Adaptive Normalization | - |
2023 | TNNLS | SSAT++: A Semantic-Aware and Versatile Makeup Transfer Network With Local Color Consistency Constraint | Code |
2023 | CVPR | BeautyREC: Robust, Efficient, and Component-Specific Makeup Transfer | Code |
2023 | TCSVT | Hybrid Transformers with Attention-guided Spatial Embeddings for Makeup Transfer and Removal | - |
2022 | ICCV | EleGANt: Exquisite and Locally Editable GAN for Makeup Transfer | Code |
2022 | AAAI | SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal | Code |
2022 | Knowledge-Based Systems | TSEV-GAN: Generative Adversarial Networks with Target-aware Style Encoding and Verification for facial makeup transfer | - |
2022 | Knowledge-Based Systems | CUMTGAN: An instance-level controllable U-Net GAN for facial makeup transfer | - |
2021 | CVPR | Lipstick ain’t enough: beyond color matching for in-the-wild makeup | Code |
2021 | T-PAMI | Psgan++: Robust detail-preserving makeup transfer and removal | Code |
2020 | CVPR | PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer | Code |
2019 | CVPR | Beautyglow : On-demand makeup transfer framework with reversible generative network | Code |
2019 | ICCV | Ladn: Local adversarial disentangling network for facial makeup and de-makeup | Code |
2018 | ACM MM | BeautyGAN: Instance-level Facial Makeup Transfer with Deep Generative Adversarial Network | Code |
2018 | CVPR | Pairedcyclegan: Asymmetric style transfer for applying and removing makeup | - |
2017 | AAAI | Examples-rules guided deep neural network for makeup recommendation | - |
If you find our survey and repository useful for your research project, please consider citing our paper:
@article{pei2024deepfake,
title={Deepfake Generation and Detection: A Benchmark and Survey},
author={Pei, Gan and Zhang, Jiangning and Hu, Menghan and Zhang, Zhenyu and Wang, Chengjie and Wu, Yunsheng and Zhai, Guangtao and Yang, Jian and Shen, Chunhua and Tao, Dacheng},
journal={arXiv preprint arXiv:2403.17881},
year={2024}
}
51265904018@stu.ecnu.edu.cn
186368@zju.edu.cn