Under the Hood

What Generative AI technologies is SketchUp Diffusion based on?

As its name suggests, SketchUp Diffusion is based on Stable Diffusion and ControlNet. SketchUp Diffusion is a latent text-to-image diffusion model capable of generating photo-realistic images given any text input. 

ControlNet is a neural network structure designed to control diffusion models by adding extra conditions that bring unprecedented levels of control to Stable Diffusion. 

Whereas previously there was simply no efficient way to tell an AI model which parts of an input image to keep, ControlNet changed this by introducing a method to enable Stable Diffusion models to use additional input conditions that tell the model exactly what to do.

What was the Stable Diffusion model trained on?

The underlying dataset for Stable Diffusion was the 2b English language label subset of LAION 5b https://laion.ai/blog/laion-5b/, a general crawl of the internet created by the German charity LAION.

What is the copyright for using Stable Diffusion-generated images?

The area of AI-generated images and copyright is complex and will vary from jurisdiction to jurisdiction.