
Let me show you two examples of what ControlNet can do: Controlling image generation with (1) edge detection and (2) human pose detection. The extra conditioning can take many forms in ControlNet. It uses text prompts as the conditioning to steer image generation so that you generate images that match the text prompt.ĬontrolNet adds one more conditioning in addition to the text prompt. The most basic form of using Stable Diffusion models is text-to-image.

You can use ControlNet along with any Stable Diffusion models. Difference between the Stable Diffusion depth model and ControlNetĬontrolNet is a neural network model for controlling Stable Diffusion models.Install ControlNet extension (Windows/Mac).


