ControlNetモデル
SD1.x
https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/mainControlNet 1.1
https://civitai.com/models/16409/pototype-controlnet-models-based-on-mediapipePototype ControlNet models based on MediaPipe
openposeの代わりにMediaPipeを使って学習させたモデル
https://huggingface.co/CrucibleAI/ControlNetMediaPipeFaceControlNetMediaPipeFace
https://huggingface.co/ioclab/control_v1u_sd15_illumination_webuicontrol_v1u_sd15_illumination_webui【WIP】
ライティング
https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monsterControlnet QR Code Monster v2 For SD-1.5
https://civitai.com/models/232042/loosecontrol-use-the-box-depth-map-to-control-the-protagonist-positionLooseControl--Use the box depth map to control the protagonist position
SD2.x
https://huggingface.co/thibaud/controlnet-sd21 thibaud
Ade20k/canny/color/depth/hed lineart/Normal Bae/openpose/openposev2/scribble/ZoeDepth
SDXL 1.0
https://huggingface.co/lllyasviel/sd_control_collectionsd_control_collection
https://civitai.com/models/330313/tplanetsdxlcontrolnettilerealisticv1TPLanet_SDXL_Controlnet_Tile_Realistic_V1
https://huggingface.co/xinsir/controlnet-union-sdxl-1.0xinsir/controlnet-union-sdxl-1.0
https://huggingface.co/xinsir/controlnet-scribble-sdxl-1.0xinsir/controlnet-scribble-sdxl-1.0
https://huggingface.co/xinsir/controlnet-tile-sdxl-1.0xinsir/controlnet-tile-sdxl-1.0
https://huggingface.co/xinsir/controlnet-openpose-sdxl-1.0xinsir/controlnet-openpose-sdxl-1.0
https://huggingface.co/xinsir/controlnet-canny-sdxl-1.0xinsir/controlnet-canny-sdxl-1.0
Flux
by InstantX & Shakker-Labs
https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-ProShakker-Labs/FLUX.1-dev-ControlNet-Union-Pro
https://huggingface.co/InstantX/FLUX.1-dev-Controlnet-UnionInstantX/FLUX.1-dev-Controlnet-Union
https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-DepthShakker-Labs/FLUX.1-dev-ControlNet-Depth
by XLabs AI
https://huggingface.co/XLabs-AI/flux-controlnet-collectionsXLabs-AI/flux-controlnet-collections
https://huggingface.co/alimama-creative/FLUX.1-dev-Controlnet-Inpainting-Alphaalimama-creative/FLUX.1-dev-Controlnet-Inpainting-Alpha
by jasperai
https://huggingface.co/jasperai/Flux.1-dev-Controlnet-UpscalerFlux.1-dev-Controlnet-Upscaler
https://huggingface.co/jasperai/Flux.1-dev-Controlnet-DepthFlux.1-dev-Controlnet-Depth
https://huggingface.co/jasperai/Flux.1-dev-Controlnet-Surface-NormalsFlux.1-dev-Controlnet-Surface-Normals
Stable Diffusion 3.5
https://huggingface.co/stabilityai/stable-diffusion-3.5-controlnetsstabilityai/stable-diffusion-3.5-controlnets
blur / canny / depth
以下ControlNet 1.0 (旧)
SD1.x
https://huggingface.co/lllyasviel/ControlNet/tree/main/modelsPretrained Models
https://huggingface.co/webui/ControlNet-modules-safetensors/tree/main軽量版
SD2.x
SD2.x系で動かすにはまた別途学習する必要がある
要出典
SD2.x系はテキストエンコーダーの出力形状が違うので同じControlNetは使えない。
この辺りはLoRAも同じで何がどこまで互換性を持っているかしっかり調べたいnomadoor.icon
学習にトライしている人が何人かいらっしゃる
salt(waifu diffusion開発チーム)
https://huggingface.co/alfredplpl/ControlNetForSD2 by alfredplpl
ControlNet for Stable Diffusion 2.1 768を公開しました。現段階では、限りなく機能は限られていて、Picasso Diffusion をOpenPoseでちょっと制御できるかなぐらいです。完全にPoCなので、あ、一応、動くもんなんだな、程度に思ってください。
https://t.co/mNoS8KQDpm あるふ
WDでもかすかに使える
らしい
https://huggingface.co/furusu/ControlNet by furusu
まさかのWaifu Diffusion 1.5向けのControlNetモデルが出てしまった
https://gyazo.com/54b4b5e9bd88f77292bca59481bcc17e
Updated
https://huggingface.co/thibaud/controlnet-canny-sd21 by thibaud
canny、depth、hed、openpose
color、ZoeDepth
Normal Map (BAE) 🎨
Segmentation (ADE20K) 🧩
LineArt 🖼️
Openpose with hands 🖐️ and face 🙂
https://huggingface.co/p1atdev/extracted-thibaud-controlnet-sd21/tree/main
SD2.1を抜いて小さくしたもの
https://huggingface.co/thibaud/controlnet-sd21-openpose-diffusers by thibaud
openpose
[] by YouJ
https://huggingface.co/CrucibleAI/ControlNetMediaPipeFaceControlNetMediaPipeFace
diffusers系
https://huggingface.co/thepowefuldeez/sd21-controlnet-canny
SDXL 1.0
https://huggingface.co/lllyasviel/sd_control_collectionsd_control_collection
https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-small/ diffusers_xl_canny_small
https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-mid/ diffusers_xl_canny_mid
https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0/ diffusers_xl_canny_full
https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-small/ diffusers_xl_depth_small
https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-mid/ diffusers_xl_depth_mid
https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0/ diffusers_xl_depth_full
https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/ thibaud_xl_openpose
https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/ thibaud_xl_openpose_256lora
https://huggingface.co/SargeZT/controlnet-sd-xl-1.0-depth-faid-vidit/ sargezt_xl_depth_faid_vidit
https://huggingface.co/SargeZT/controlnet-sd-xl-1.0-depth-zeed/ sargezt_xl_depth_zeed
https://huggingface.co/SargeZT/controlnet-v1e-sdxl-depth/ sargezt_xl_depth
https://huggingface.co/SargeZT/controlnet-sd-xl-1.0-softedge-dexined/ sargezt_xl_softedge
https://huggingface.co/stabilityai/control-lora/ sai_xl_canny_128lora
https://huggingface.co/stabilityai/control-lora/ sai_xl_canny_256lora
https://huggingface.co/stabilityai/control-lora/ sai_xl_depth_128lora
https://huggingface.co/stabilityai/control-lora/ sai_xl_depth_256lora
https://huggingface.co/stabilityai/control-lora/ sai_xl_sketch_128lora
https://huggingface.co/stabilityai/control-lora/ sai_xl_sketch_256lora
https://huggingface.co/stabilityai/control-lora/ sai_xl_recolor_128lora
https://huggingface.co/stabilityai/control-lora/ sai_xl_recolor_256lora
https://huggingface.co/ioclab/control_v1p_sd15_brightness/ ioclab_sd15_recolor
https://huggingface.co/TencentARC/T2I-Adapter/ t2i-adapter_xl_canny
https://huggingface.co/TencentARC/T2I-Adapter/ t2i-adapter_xl_openpose
https://huggingface.co/TencentARC/T2I-Adapter/ t2i-adapter_xl_sketch
https://huggingface.co/h94/IP-Adapter/ ip-adapter_sd15_plus
https://huggingface.co/h94/IP-Adapter/ ip-adapter_sd15
https://huggingface.co/h94/IP-Adapter/ ip-adapter_xl
https://huggingface.co/kohya-ss/controlnet-lllite/ kohya_controllllite_xl_depth_anime
https://huggingface.co/kohya-ss/controlnet-lllite/ kohya_controllllite_xl_canny_anime
https://huggingface.co/kohya-ss/controlnet-lllite/ kohya_controllllite_xl_scribble_anime
https://huggingface.co/kohya-ss/controlnet-lllite/ kohya_controllllite_xl_openpose_anime
https://huggingface.co/kohya-ss/controlnet-lllite/ kohya_controllllite_xl_openpose_anime_v2
https://huggingface.co/monster-labs/control_v1p_sdxl_qrcode_monsterControlnet QR Code Monster v1 For SDXL