SDXL Inpainting + PowerPaint V2 in ComfyUI
Added 2024-05-12 17:02:01 +0000 UTCInpainting can be fun, and thanks to some of the latest BrushNet SDXL and PowerPaint V2 models, you can can use any typical SD1.5 or SDXL model for inpainting - no special inpainting version required!
You'll find all the example workflows I used in my latest video as attachments to this post, and for the downloads see the links below.
Enjoy!
Links:
ComfyUI custom node: https://github.com/nullquant/ComfyUI-BrushNet
BrushNet Models: https://drive.google.com/drive/folders/1fqmS1CEOvXCxNWFrsSYd_jHYXxrydh1n
PowerPaint Models: https://huggingface.co/JunhaoZhuang/PowerPaint_v2
Clip model for PowerPaint: https://huggingface.co/runwayml/stable-diffusion-v1-5/tree/main/text_encoder
Other info:
https://github.com/TencentARC/BrushNet
Comments
Extra options - batch count is what I typically use!
Nerdy Rodent
2024-08-12 18:32:16 +0000 UTCHi Nerdy, I have a question here, do you how to generate 4 images at the same time using the brushnet workflow? (rather than click "Queue" button 4 times) Which node can I use to achieve that? Thanks!
Jjjjc
2024-08-12 08:37:04 +0000 UTCupdate your powerpaint due to a new commit: https://github.com/nullquant/ComfyUI-BrushNet/issues/130#issuecomment-2262640728
KING LIFER
2024-08-01 12:45:26 +0000 UTCcurious anyone got this error: Error occurred when executing PowerPaint: EmbeddingLayerWithFixes.forward() got an unexpected keyword argument 'out_dtype' for the PPV2-Example2 workflow?
KING LIFER
2024-08-01 12:27:22 +0000 UTCThanks Nerdy. Advice was spot on...... This is a great set of workflows. Yili - Rodent Nest ππ
Yiluwidi Dreaming
2024-05-18 05:33:01 +0000 UTCIt is possible to get discolouration when trying to dramatically change an image. The key things are the mask itself, along with the model and prompts used. The blending node will help when the whole image changes colour and becomes lighter, for example.
Nerdy Rodent
2024-05-16 11:37:22 +0000 UTCohkay...getting funny discolouration with most of these wrkflws along with impacting the whole image with inpaint effect and not just the mask area....care to enlighten Nerdy?
Yiluwidi Dreaming
2024-05-15 09:13:28 +0000 UTC
