Answers.Body: <p>DALL-E 2 and other image generators are well known for this specific effect on text. It has even been shown that the choices of &quot;words&quot; that DALL-E uses are subject-specific, with the same kinds of <a href="https://twitter.com/giannis_daras/status/1531693093040230402" rel="noreferrer">mis-spellings appearing again and again</a>.</p>
  <p>This is a specific type of failure of coherence of the model. It's not really that different from the generator mangling hands, positioning limbs incorrectly etc. There isn't really anything special about text to (this kind of) AI in this regard.</p>
  <p>Some versions of Midjourney (version 3, there have been a few versions since, but version 3 is still available and the default for a few weeks yet) have a better, but still not reliable, response to generating text. You may have some luck there.</p>
  <p>Other than that, it's a waiting game. There are state-of-the-art models that can reliably create text, even text with artistic effects, more reliably. This seems to relate to the power of the model. <a href="https://parti.research.google/" rel="noreferrer">Google's research project Parti published an article</a> to demonstrate this effect of adding more parameters to the model. Their best model generates very good-looking text. Google's other model Imagen does too. The main problem for you being that these models are not available to the public. At least not yet.</p>
  <p>My advice: Generate your artsy background in the image generator, where the specific locations of components matter less. Then use an image editor to add titles in a style of your choosing. Fighting with the generator to get working text will take far more effort than that.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-11-15T15:07:08.043Z
Answers.Text: and if you want that AI effect you may try running the output image (with your text on it) through an AI process *again*, but only for a few iterations
Answers.UserDisplayName: Criticize SE actions means ban
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-11-10T20:35:52.997Z
Answers.LastActivityDate: 2022-11-10T20:48:33.157Z
Answers.LastEditDate: 2022-11-10T20:48:33.157Z
Answers.UserDisplayName: Neil Slater
Body: <p>I want to create a splash screen that includes the name of my project.  <a href="https://en.wikipedia.org/wiki/DALL-E" rel="nofollow noreferrer">DALL-E</a> 2 changed some of the letters in the name, even when I tried putting the name of my project in double-quotes (<code>&quot;</code>).</p>
  <p><a href="https://twitter.com/dandv/status/1603480097683410944/photo/1" rel="nofollow noreferrer">Other prompts</a> to create images with short verbatim text, resulted in text that was not in the prompt:</p>
  <p><a href="https://i.sstatic.net/6KJkV.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/6KJkV.jpg" alt="DALL-E2 prompt with verbatim text failed" /></a></p>
  <p>However, the OpenAI blog post announcement for DALL-E (1) shows an example of the text &quot;OpenAI&quot; being output correctly:</p>
  <p><a href="https://i.sstatic.net/7wKtf.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/7wKtf.png" alt="OpenAI verbatim text" /></a></p>
  <p>What is the mechanism that causes DALL-E 2 to be unable to output the text as expected?</p>
  
Tags: <transformer><image-generation>
Title: Why can't AI image generators output verbatim text when prompted to do so?
UserDisplayName: Silver Sagely
ThreadText: # Why can't AI image generators output verbatim text when prompted to do so?
  
  (Asked by: username_0 on 2022-11-10)
  
  I want to create a splash screen that includes the name of my project. [DALL-E](https://en.wikipedia.org/wiki/DALL-E) 2 changed some of the letters in the name, even when I tried putting the name of my project in double-quotes (`"`).
  
  [Other prompts](https://twitter.com/dandv/status/1603480097683410944/photo/1) to create images with short verbatim text, resulted in text that was not in the prompt:
  
  [![DALL-E2 prompt with verbatim text failed](https://i.sstatic.net/6KJkV.jpg)](https://i.sstatic.net/6KJkV.jpg)
  
  However, the OpenAI blog post announcement for DALL-E (1) shows an example of the text "OpenAI" being output correctly:
  
  [![OpenAI verbatim text](https://i.sstatic.net/7wKtf.png)](https://i.sstatic.net/7wKtf.png)
  
  What is the mechanism that causes DALL-E 2 to be unable to output the text as expected?
  
  **Tags:** transformer, image-generation
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2022-11-10. Score: 5 | Accepted answer
  
  DALL-E 2 and other image generators are well known for this specific effect on text. It has even been shown that the choices of "words" that DALL-E uses are subject-specific, with the same kinds of [mis-spellings appearing again and again](https://twitter.com/giannis_daras/status/1531693093040230402).
  
  This is a specific type of failure of coherence of the model. It's not really that different from the generator mangling hands, positioning limbs incorrectly etc. There isn't really anything special about text to (this kind of) AI in this regard.
  
  Some versions of Midjourney (version 3, there have been a few versions since, but version 3 is still available and the default for a few weeks yet) have a better, but still not reliable, response to generating text. You may have some luck there.
  
  Other than that, it's a waiting game. There are state-of-the-art models that can reliably create text, even text with artistic effects, more reliably. This seems to relate to the power of the model. [Google's research project Parti published an article](https://parti.research.google/) to demonstrate this effect of adding more parameters to the model. Their best model generates very good-looking text. Google's other model Imagen does too. The main problem for you being that these models are not available to the public. At least not yet.
  
  My advice: Generate your artsy background in the image generator, where the specific locations of components matter less. Then use an image editor to add titles in a style of your choosing. Fighting with the generator to get working text will take far more effort than that.
  
  > **Comments:**
  > **username_2**: and if you want that AI effect you may try running the output image (with your text on it) through an AI process *again*, but only for a few iterations  
  
  ---
  
  