Mar 5, 2023 · This document presents the colors associated with the 182 classes of objects recognized by the T2i Semantic Segmentation model. This version (v21) is complete and all data has been cross-checked ag...

Feb 28, 2023 · In the catalog used to train the model we use there are 150 different colors for 150 different classes of objects. The color chart at the top of this post is the compact version of the catalog of semantic segmentation - semantic because we attach some sense, some definition, to each color segment.

ControlNet is a neural network structure to control diffusion models by adding extra conditions. It copys the weights of neural network blocks into a "locked" copy and a "trainable" copy. The "trainable" one learns your condition. The "locked" one preserves your model.

ControlNet is a neural network structure to control diffusion models by adding extra conditions. This checkpoint corresponds to the ControlNet conditioned on Image Segmentation. It can be used in combination with Stable Diffusion.

We report that large diffusion models like Stable Diffusion can be augmented with ControlNets to enable conditional inputs like edge maps, segmentation maps, keypoints, etc. This may enrich the methods to control large diffusion models and further facilitate related applications.

Mar 1, 2023 · EDIT: if you want to learn more about how to use semantic segmentation maps with ControlNet (and not necessarily with Cinema4d) there is a tutorial I posted over here that might help you: https://www.reddit.com/r/StableDiffusion/comments/11e4vxl/paint_by_color_numbers_with_controlnet/

Feb 25, 2023 · You can find the post with the Cinema4d scene, a prerendered color chart showing what's in the c4d scene, and everything else over here: Mikubill/sd-webui-controlnet#445

Jul 7, 2024 · Segmentation. Segmentation preprocessors label what kind of objects are in the reference image. Below is a segmentation processor in action. The buildings, sky, trees, people, and sidewalks are labeled with different and predefined colors. You can find the object categories and colors in the color map here for ufade20k and ofade20k.

These are controlnet weights trained on stabilityai/stable-diffusion-xl-base-1.0 with new type of conditioning.

Mar 2, 2023 · The color chart at the top of this post is the compact version of the catalog of semantic segmentation - semantic because we attach some sense, some definition, to each color segment. These colors are available in many formats in many places.