CoRR, 2012, 2020.

10

Figure 4: Controlling Stable Diffusion with Canny edges. The “automatic prompts” are generated by BLIP based on the default result images
without using user prompts. See also the Appendix for source images for canny edge detection.

11

Input (Canny Edge)DefaultAutomatic PromptUser Prompt“a man in a suit and tie”“a man in a white suit and tie”“a man with beard sitting with two children”“mother and two boys in a room, masterpiece, artwork”“a cat with blue eyes in a room”“a cute cat in a garden, masterpiece, detailed wallpaper”“ a man standing on top of a cliff”“man on hill watching a meteor, cartoon artwork”“a robot head with gears”“robot, cybernetic, cyberpunk, science fiction”Figure 5: Controlling Stable Diffusion with Hough lines (M-LSD). The “automatic prompts” are generated by BLIP based on the default
result images without using user prompts. See also the Appendix for source images for line detection.

12
Adding Conditional Control to Text-to-Image Diffusion Models