ComfyUI

For runtime, I use ComfyUi [0] which is node based and therefore a bit hard to learn. But you can just look at the examples on their github. Foocus [1] also seems to be popular and a bit more conventional perhaps, though I didn't try it. For models, Flux [2] is pretty good and quite straightforward to use. (In general, you will have a runtime and then you have to get the model weights seperately). Which Flux variant depends on your graphics card, the Flux.1 schnell should work for most decently modern ones. (And the website, civitai.com is a repository for models and other associated tools.) [0] https://github.com/comfyanonymous/ComfyUI [1] https://github.com/lllyasviel/Fooocus [2] https://civitai.com/models/618692?modelVersionId=699279

Didn't believe that anyone would be bridge-burning-happy enough to put this in their official docs, but you're not kidding: https://github.com/comfyanonymous/ComfyUI/wiki/Which-GPU-sho... In retrospect, the fact that Intel and AMD's stock prices both closed slightly up when Microsoft announced the Snapdragon X on Windows 11 was a dead giveaway that the major players knew behind the scenes that it was being released seriously under baked.

I bet you could get this working in https://github.com/comfyanonymous/ComfyUI I have done some other LLava stuff in it

The non standard licensing puts me off in contributing or using this. It is frustrating how the phrase opensource has been diluted in the AI/ML community. ComfyUI has a GPL license [1] while this project uses this [2]. I honestly don't know where I stand since this is a legal document using non-standard phrasing to describe how the rights around the source code. This is a project that uses a custom license with less rights provided than the ComfyUI project it self-describes as improving. Am not sure the title is reflective of the project. [1] - https://github.com/comfyanonymous/ComfyUI/blob/master/LICENS... [2] - https://github.com/6174/comflowyspace/blob/main/LICENSE

Thank you for the support and the valuable feedback! Sorry about the response time, I haven't expected the incoming volume of requests. * For changing prompt in the middle - I'll take a crack at it this week. It's on top of my post launch list. * Feedback button: Thanks for reporting this. The button was supposed to open default email client to email feedback@recurse.chat * LLaVA model: I'll add more documentation. You are right Llava could not generate images. It can only describe images (similar to GPT-4v). For image generation, it's not supported in the app. While I don't have immediate plans for image generation, check out these projects for local image generation. - https://diffusionbee.com/ - https://github.com/comfyanonymous/ComfyUI - https://github.com/AUTOMATIC1111/stable-diffusion-webui

ComfyUI is adding lots of other models. And it's open source and much further along. https://github.com/comfyanonymous/ComfyUI

Check out ComfyUI for a much more advanced and open source version of this. https://github.com/comfyanonymous/ComfyUI

I use Stable Diffusion family models for innovative art products. On a small scale, you have to professionalize ComfyUI’s development. My PR to make it installable and to make a plugin ecosystem that makes sense should not be sitting unmerged (https://github.com/comfyanonymous/ComfyUI/pull/298). On a medium scale, CLIP is holding you back. I would eagerly buy a 48GB card to accommodate a batch size 1, gradient checkpointed LoRA-trainable model with T5 for conditioning. I want PixArt-a or DeepFloyd/IF with the SDXL dataset and training. I get I can achieve so much with SDXL on 24GB, including just barely a fine tuning, I understand the engineering decisions here, but it’s too weak on prompts. On a large scale, I’m willing to spend a little money up front. In those conditions you can be far more innovative, you don’t have to make everything

It's litegraph.js [1] and seems to be the only lib they include in /web [2] : [1] https://github.com/jagenjo/litegraph.js [2] https://github.com/comfyanonymous/ComfyUI/tree/master/web/li...