SamuKata
NerdyRodent

NerdyRodent

patreon


NerdyRodent posts

ComfyUI's New Look

Updated ComfyUI recently? Notice anything... different? Want to make it even more different? Open Settings via the little cog...

... and you should see the [Beta] Use new menu and workflow management:

2024-08-17 11:29:46 +0000 UTC View Post

Train Your Own Flux.1 LoRA

Train Your Own Flux.1 LoRA

Video - https://youtu.be/7AhQcdqnwfs

Flux is a great model with loads of potential, but when it comes to generating images with almost any art style it can struggle a bit. You may also wish to add your own face, a pet or indeed anything you hav...

View Post

Flux.1 + Lora + Controlnet!

Even more Flux.1 updates - workflow attached as usual :)

If you've not updated ComfyUI in the last 16 hours, then you won't yet have the new ControlNet support, so be sure to update now :)

Loads of other updates top the workflows:

  • Op...

    View Post

Bonus: Flux "Negative Prompt" at CFG 1.0

Bonus: Flux "Negative Prompt" at CFG 1.0

Many of us have become used to using a negative prompt when generating images using Stable Diffusion, so going back to CFG 1.0 and not using a negative prompt can feel a bit like losing a favourite tool of some sort

There is a newer version out which I haven't actually tried as yet, but hopefully it (or others) can do much the same thing!<...

View Post

AI Enhanced Flux

Flux Updates!

Things are moving along nicely in the Flux.1 world and soon we'll have things like controlnets, loras! But, for now at least, we've got image-to-image and LLM assistants. These ComfyUI workflows are similar to the previous ones, b...

View Post

Flux is awesome! :)

AuraFlow 0.2, AuraSR v2 and Flux? So many new things!

Flux is most certainly worth a try, but both models will benefit from fairly beefy systems with at least 24GB VRAM and 32GB RAM, so beware to go slow if you don't meet the specs.

4 steps...

View Post

Bonus: AuraFlow 0.2 testing :)

As with the previous AuraFlow 0.1, the latest release is very good at following prompts! This time around the image quality is also better, and there are some limited styles in there too. The main thing seems to be fairly decent text, so long as it's s...

View Post

LivePortrait - Image, Video & Webcam

Now you can ditch InsightFace and go fully open source with LivePortrait in ComfyUI! We've got a few model options available for the face cropper to provide image animation, video-to-video animation, and even live via your webcam :)

When recordin...

View Post

Bonus: Pixart 900M "Mixture of Experts" Edition!

Even more PixArt! Things seem to be dropping every day, and now we've got a 2-stage pixart. While you can use each model individually, it's better to go with the "refiner" style workflow and let the first stage do it's job with composition and colours,...

View Post

ControlNet Union ProMax and More!

So many new things, so little time!

PixArt Sigma 900M, more playing with the new samplers & schedulers, a better version of rembg and of course the new ControlNet Union ProMax model!

As you've probably seen in the previous bonus workflo...

View Post

Bonus: Aura + SD3 Refiner

Bonus: Aura + SD3 Refiner

Just for giggles, here is a quick workflow I'm playing with at the moment using SD3 as the refiner for Aura Flow. Now you can do complex prompts AND have the image quality come out a little better. Shame it can't do people well, but hey!

On the b...

View Post

AuraFlow - A Truly Open Source Diffusion Model!

https://huggingface.co/fal/AuraFlow

Could an unseen benefit of Stability Ai's license gaff be that we finally get a deluge of truly open source models? Let's hope so, as ...

View Post

SD3 Licence / Refiner / HiRes Fix

Looks like we can finally use SD3 for commercial purposes - subject to various limitations. Full details available at https://stability.ai/news/license-update

The wo...

View Post

Bonus ComfyUI Workflow: Refacer - Weird Edition

Given all the new samplers and stuff, I figured why not see how well they do with highres fix as well. Not too bad, it turns out!

Anyway, this Pixart Sigma + SDXL workflow is designed to put your selected face where it sees fit in your generation. It starts of with Pixart and then refines using SDXL. I'm also doing some upscaling too, so i...

View Post

New Samplers in ComfyUI!

There are loads of new samplers in ComfyUI, so I figured I'd try them all - along with the new GITS scheduler as well!

To cut a long story short, I like DEIS and both of the CFG++ ones, but there is loads of scope to play with all of them!

...

View Post

Lumina Vs Hunyuan 1.1 Vs Pixart Sigma

It's the battle of models with reasonable licenses - Lumina Vs Hunyuan Vs Pixart!

Video link - https://youtu.be/aV_Feh8768M

Which follows prompts best whilst also having a...

View Post

Prompt Showdown! Ideal for SD3 ;)

It can be difficult deciding which model is best for your task, so I've created a set prompt to test your model's creativity! Using a wide variety of subjects and styles, you'll soon be able to tell what your model can and can't handle. Try giving thes...

View Post

HunYuan-DiT - Better Than SD3?

Main repo

https://github.com/Tencent/HunyuanDiT/tree/main/comfyui-hydit

This is their official set of custom nodes for ComfyUI, and whil...

View Post

Your Image is Omost There!

https://youtu.be/RKxrXkVpPoE

https://github.com/lllyasviel/Omost

Want an LLM to generate prompt...

View Post

Khoj - Your Second Brain

Video notes

Khoj is touted as being your "AI second brain". Get answers to your questions, whether they be from online sources or your own notes. Use hosted or local LLMs. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

Overall...

View Post

ComfyUI Refacer - 18th May Edition

While various things keep coming out which use the research-only "insightface" models, I figured why not combine two insightface-free options together? On top of that, maybe see how quickly I can make that cartoon or painted face into a more realistic one? We've had a load of new nodes come out recently, so now is as good a time as any to...

View Post

SDXL Inpainting + PowerPaint V2 in ComfyUI

Inpainting can be fun, and thanks to some of the latest BrushNet SDXL and PowerPaint V2 models, you can can use any typical SD1.5 or SDXL model for inpainting - no special inpainting version required!

You'll find all the example workflows I used in my latest video as attachments to this post, and for the downloads see the links below.

<...

View Post

GlaDOS - Your Personal, Unhinged AI Assistant

https://github.com/dnhkng/GlaDOS

"This is the Personality Core for GLaDOS, the first steps towards a real-life implementation of the AI from the Portal series by Valve."

The main thing about this one, is how fast it can generate responses :) You can actually hav...

View Post

Hyper-SD in ComfyUI!

Model options

You get 3 options, basically:

1. Their 1-step SDXL UNET

2. Any SD1.5 model, but with their LORA

3. Any SDXL model, but with their LORA

Install

https://huggingface.co/ByteDance/Hyper-SD

1. Download C...

View Post

Pixart Sigma 2k!

https://huggingface.co/PixArt-alpha/PixArt-Sigma/blob/main/PixArt-Sigma-XL-2-2K-MS.pth

There's a NEW Pixart Sigma model...

View Post

Pixart Sigma - ComfyUI

Pixart Sigma - https://pixart-alpha.github.io/PixArt-sigma-project/

We're seeing more T5 conditioning over CLIP, often with much better prompt adherence....

View Post

Instant Mesh - ComfyUI

Just a quick Text-to-3d image workflow for you, in case you've not seen Instant Mesh as yet!

This one attaches my previous "Layer Diffuse" workflow to create suitable images, which instant mesh then turns into textured OBJ files :)

Workflow Instr...

View Post

SDXL Reposer Basic (Apr 24 update)

SDXL Reposer Basic (Apr 24 update)

So many workflows, so many IP adapter nodes to change ;) Old IP Adapter Apply now IP Adapter Advanced!

View Post

Creative Interpolation + Sparse RGB (Apr 2024)

Just a quick update to the previous Batch Image Animation workflow as various nodes have changed.

Enjoy! :)

View Post

ELLA - Making prompts better!

"The horizon shimmered with a kaleidoscope of hues, a huge towering, iridescent crystal structure erupts from the ground, their facets refracting the vibrant pink and indigo sky. Amidst this otherworldly landscape, a lone figure with his back to us stands we...

View Post