Deepfake Survey Summary
2020/7/2
Works using deepfake
Famous Deepfake Creator
Audio関連Deepfake
以下全てOSS
Mouse Reenactment, 音声入力を元に口(顔)のアニメーション生成
Many ids to one id
3D Parametric
Different Approach
Many ids to Many ids
Improvements in Lip-sync
overall facial expressions
Body Reenactment, 体全体の生成(音声入力ではないが,パフォーマンスが関わるので選定)
few shot
以下Deepfakeという枠から少し外れるかもしれないが,Audio関連で人を模倣するもの
text2speech
Audio style transfer
music-generation
Deepfake(faceswap) tools
以下全てOSS
GUI Tool
most pupular
similar to DeepFaceLab, but uses a denoising autoencoder with a self-attention mechanisms fewshot tool
Other References
Reddit
The Creation and Detection of Deepfakes: A Survey