🦊SCAIL-2

👉 |

Wan2.1ベースのHuman motion transfer

モデルのダウンロード

clip_vision

https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/blob/main/split_files/clip_vision/clip_vision_h.safetensorsclip_vision_h.safetensors

diffusion_models

https://huggingface.co/Comfy-Org/SCAIL-2/blob/main/diffusion_models/wan2.1_14B_SCAIL_2_fp8_scaled.safetensorswan2.1_14B_SCAIL_2_fp8_scaled.safetensors

loras

https://huggingface.co/lightx2v/Wan2.1-I2V-14B-480P-StepDistill-CfgDistill-Lightx2v/blob/main/loras/Wan21_I2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensorsWan21_I2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensors

text encoders

https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/text_encodersumt5_xxl (fp16 or fp8).safetensors

vae

https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/blob/main/split_files/vae/wan_2.1_vae.safetensorswan_2.1_vae.safetensors

code:models

📂ComfyUI/

└── 📂models/

├── 📂clip_vision/

│ └── clip_vision_h.safetensors

├── 📂diffusion_models/

│ └── wan2.1_14B_SCAIL_2_fp8_scaled.safetensors

├── 📂loras/

│ └── Wan21_I2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensors

├── 📂text_encoders/

│ └── umt5_xxl (fp16 or fp8).safetensors

└── 📂vae/

└── wan_2.1_vae.safetensors

Animationモード

ref画像をpose動画で動かす

https://gyazo.com/a7c76588147896b9357481a741f1b071

SCAIL-2_Animation.json

基本は参照画像とモーション用の動画をWanSCAILToVideoに接続するだけ

SAM3.1でマスクを作るが、領域を指定するというより、どの人物とどのモーションが紐付けられるのか見ているだけ

https://gyazo.com/ce9827f452cdc3cf7d47de8b12996f28https://gyazo.com/f14aef04ac197a4b92680e05c4fbd178https://gyazo.com/d87b2644f8f71218ebe678736479959e

ref / pose / output

Replacementモード

pose動画の人物をref画像の人物に置き換える

https://gyazo.com/0996965c611a4b4ad46f3490b27ad1d6

SCAIL-2_Replacement.json

基本 Create SCAIL-2 Colored Mask と WanSCAILToVideo のreplacement_modeを true にするだけ

https://gyazo.com/65599272e59ffa6edd7571f1b87db822

output

Animationモード複数人

https://gyazo.com/86b498dff06f09754116fc3cce4d3dbd

SCAIL-2_Animation_multi-char.json

https://gyazo.com/567acaf722ca9e839ec7cb834c1ed344https://gyazo.com/53461ca17746349fbd11e69798460ea6https://gyazo.com/913ff446dd39fa33f56ba9ed07ce6e16