Part 01
The negative nobody read
I build my images in ComfyUI, a program where you connect modules. One module holds the text of what I want (the positive). Another holds the text of what I don't want (the negative). The model asks for both, so I filled in both. Then I looked at how it works inside. I always use a fast setting called CFG 1, and with it the negative is never read. Nothing I wrote there ever did anything.
Krea 2 · CFG 1 · NAG strength 4 · negative: hair clip, hair accessory · seed 9040317043 attempts
I asked for no pink hair
First I tried the easy way: writing the “no” inside the positive, like “no text” or “not a photo”. It got worse. The model reads the word “text” and adds text. What did work was describing the opposite: “plain, unmarked panels” instead of “no text”. Then I installed NAG, an extra module that makes the negative work, and gave it a hard test. My positive asks for pink hair. I put “pink hair” in the negative.
- A1Starting point
The starting point. No negative at all.
Krea 2 · CFG 1 · seed 904031704 · 65 s - A2It didn't work
Still pink. But the pose, the framing and the suit all changed, and a “01” appeared on her chest.
NAG strength 4 · negative: pink hair · 105 s - A3It didn't work
Twice the strength. Still pink, a little lighter. Now her arms are mechanical, which I never asked for.
NAG strength 8 · negative: pink hair · 108 s
3 attempts
A teapot, a clip and the shine
Any negative moves the whole image, so comparing against “no negative” tells me nothing. I needed a fairer starting point: a negative that has nothing to do with the image. I used “a teapot, a bicycle”. Then I changed only the negative, twice. Once for something small I never asked for, a hair clip. Once for something my positive does ask for, the shine of the suit.
- B1Starting point
The fair starting point. A negative about nothing, so I can see what a negative does just by being there.
NAG strength 4 · negative: a teapot, a bicycle · 107 s - B2It worked
It worked. The clip that kept showing up is gone, and the rest of the image barely moved.
NAG strength 4 · negative: hair clip, hair accessory - B3It didn't work
It didn't work. The suit is just as shiny, because my positive asks for it. And the clip is back.
NAG strength 4 · negative: glossy latex shine, reflections
What I learned
First I describe what I want to see. That is what gives the most control, and it costs nothing.
Attempts: A1
I never write the name of the thing I want to avoid. The model reads the word and adds it.
Attempts: A2
A negative removes a small object I didn't ask for. It does not beat something my positive asks for, not even at double strength.
Any negative moves the whole image. To know if one worked, I compare it against an unrelated negative, not against the image with none.
It is slower. Each image went from about 65 seconds to about 105.
The next experiment
Flat vector neon
Can a diffusion model give me a flat vector look, and not just something that resembles one?
OpenFollow the lab
Every experiment goes up as it happens: the picked images, the clips in motion and the batches that didn't work.
Write to me on Instagram
