u/ActionInUganda

Hello, I have programmed a middleware program that sits between ComfyUI and various front ends through plugins (the image retoucher and editor GIMP, Darktable and others).

I have just finished the first version of the Da Vinci Resolve plugin. Fair warning! It is probably quite buggy but it promises in time to allow users to inject VFX into their footage, create completely unique transitions, retouch select frames and create new reference shots for colour grading (thanks to seamless linkage between GIMP and DaVinci Resolve), and other new creative options.

For image generation, the GIMP plugin is already quite robust and capable. Yes I know, KritaAI also exists and is great. But my approach is a bit different in that Spellcaster is first and foremost a middleware system, which is why it is more modular and has a Silly Tavern plugin for instance, to auto-generated graphics for roleplay. Thanks to a lightweight server, the app allows for cross-app functions (e.g., from GIMP to Resolve or from Wizard Guild to GIMP, etc)

Speaking for myself, the GIMP plugin is now all I use to generate and edit with AI. It has proven to be a far superior interface than Comfy because the layer management system, along with SAM3 segmentation, allows for quicker retouching and easier deletion of imperfect generations.

If you are already using ComfyUI, Spellcaster will deploy your current models and workflows and there is an in-app editor and importer if you wish to use specific ones you have already built.

Check it out if you are interested - I work on it and improve it regularly. The app self-updates automatically so you always get the latest and least buggy version:

https://github.com/laboratoiresonore/spellcaster

Importantly, if you do use use it, please report all bugs and suggestions:

https://www.reddit.com/r/t5\_hbldqt/s/q6reI9eeGA

The app is 100% free and open source. No prior experience with AI is required

I know some of you anti-AI hypocrites are going to download my free plugin just for this massive time-saving feature. https://github.com/laboratoiresonore/spellcaster/blob/main/README.md - I ain't even mad. Enjoy. The model under the hood is a beast.

Report bugs and suggestions: https://www.reddit.com/r/Spellcaster\_Studio/

The GIMP plugin is good shit.

I'm very proud to say that the debug marathon went great. By now, Spellcaster has become what I use to operate ComfyUI over 90% of the time. Generating layers (including transparent layers) over an image within GIMP is by far the most efficient and effective way to alter any image through AI. Blending generations is a walk in the part (right click add alpha channel, then delete at whatever opacity that suits your purposes).

Based on my testing, which could be misleading, Spellcaster now has a very robust, single-source-of-truth for all generative methods, making it far more modular and easier to modify moving forward. The single source of truth is located within a custom node of ComfyUI, which makes perfect sense.

Spellcaster now comes with a stand-alone interface called the Wizard Guild. Although it needs more work and debugging, and will never have the precision of advanced and fine image editing tools that GIMP possesses, it remains a very exciting, fun, beginners-oriented, chat-based interface for Spellcaster. This also makes Spellcaster natively equipped to work with chatbot applications, like Silly Tavern.

I'm working on an entirely chat-based and fully scaffolded installation and management of Spellcaster for a couple of reasons:

1. very small LLMs can now be loaded and unloaded between generations, providing novice users with guidance as they use generative AI for the first time;

2. properly scaffolded, the LLM will be able to guide the user through the installation process step-by-step, from pressing install to generating their first images, and initiate them to far more complex generative methods - for instance, the LLM will offer to produce multi-model generative workflows with guided LoRA setup and calibration, where each workflow is embodied by a Wizard, automatically named and populated with its own scaffolded and robust generative methods.

3. through natural speech or through a highly simplified LLM scaffold editor that doubles as a workflow manager (check it out in a submenu of Wizard Guild called the travelling Wizard) the user will be able to build highly refined generative workflows;

4. Spellcaster's own core Wizards / chatbot characters oversee the installation of Spellcaster, either during initial installation or later-on upon request. In order to avoid frustration and dysfunctional setups, the Wizards both populare and strip Spellcaster (and all of its associated front ends, like the GIMP or Darktable plugins, or the Silly Tavern enhancing characters) from non-working generative methods. If it is initiated through Spellcaster, it either works or the user won't see it.

5. Wizard Guild also comes with a Signal bridge, allowing users to communicate with their local ComfyUI server remotely, through the Signal app

As always, thanks for your feedback and bug reports. Please report all bugs here or directly in the GitHub repos. If you want to lend a hand and help me out with dev, LMK

https://github.com/laboratoiresonore/spellcaster

https://github.com/laboratoiresonore/ComfyUI-Spellcaster