## Lost in Translation: Latent Concept Misalignment in Text-to-Image Diffusion Models

Juntu Zhao 1 , Junyu Deng 3 * , Yixin Ye 1 * , Chongxuan Li 4 , Zhijie Deng 1 † , and Dequan Wang 1 2 , †

1 Shanghai Jiao Tong University 2 Shanghai Artificial Intelligence Laboratory 3 Fudan University 4 Renmin University of China

Abstract. Advancements in text-to-image diffusion models have broadened extensive downstream practical applications, but such models often encounter misalignment issues between text and image. Taking the generation of a combination of two disentangled concepts as an example, say given the prompt 'a tea cup of iced coke', existing models usually generate a glass cup of iced coke because the iced coke usually co-occurs with the glass cup instead of the tea one during model training. The root of such misalignment is attributed to the confusion in the latent semantic space of text-to-image diffusion models, and hence we refer to the 'a tea cup of iced coke' phenomenon as Latent Concept Misalignment (LC-Mis). We leverage large language models (LLMs) to thoroughly investigate the scope of LC-Mis, and develop an automated pipeline for aligning the latent semantics of diffusion models to text prompts. Empirical assessments confirm the effectiveness of our approach, substantially reducing LC-Mis errors and enhancing the robustness and versatility of text-to-image diffusion models. Our code and dataset have been available online for reference.

Keywords: Text-to-image diffusion models · Misalignment · Large Language Models

## 1 Introduction

Text-to-image synthesis [7,15,18,21,25-28,30,33,36,38-40] via diffusion models has made remarkable progress, where high-quality images are generated given text prompts [24, 28]. However, a significant limitation of existing models is that they can easily face visual-textual misalignment in practice, where certain elements in the input text are overlooked in generated images. As shown in Figure 1, none of Midjourney [20], Dall·E 3 [23], and SDXL [24] can craft an image containing 'a tea cup of iced coke'. Instead, these models exhibit a preference for generating a glass cup due to inherent biases in concept combination during the training process of the models.

⋆ Equal contribution. † Corresponding authors.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-f2dc0f88-5c8d-4202-86f1-812ef7cbc610.jpg)

Midjourney [20]

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-30a630bf-d4a4-4e1a-ad00-cdb91844fbe8.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-f1ea850c-45a4-4296-b5a0-c30c8e451264.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-4db69261-e9f5-4ae8-a93b-1ff62f6dcf70.jpg)

Dall·E 3 [23]

SDXL [24]

MoCE (ours)

Fig. 1: Teaser figures, from three models and our approach MoCE, showcase a classic example of Latent Concept Misalignment (LC-Mis) in this study: a tea cup of iced coke. Here, a glass cup, an unfamiliar object, substitutes the anticipated tea cup. We denote the iced coke as Concept A , the tea cup as Concept B , and introduce a latent Concept C -the glass. This combination of A B , , and C forms our investigative focus.

Referring to the two main concepts (e.g., 'iced coke' and 'tea cup') as A and B , and a latent concept that inherently correlates with A or B as C (e.g., 'glass cup'), by our experience, it is non-trivial to address the misalignment problem based on naive prompt engineering. We refer to such an inherent issue as Latent Concept Misalignment (LC-Mis). Unlike basic works that only focus on the mutual encroachment of A and B [3, 9, 16, 17, 35], our problem involves a latent concept C that has never been mentioned in the text prompt. The emergence of this phenomenon can lead to the absence of the expected concept B ('tea cup') in the generated output.

We devise an efficient pipeline with the aid of Large Language Models [1,2,22] (LLMs) to discover an extensive set of LC-Mis examples. Specifically, human researchers first patiently guide the LLM to gradually understand and delve into the logic behind LC-Mis. The LLM is then leveraged to generate additional LCMis concept pairs according to its own understanding. After acquiring a substantial number of LC-Mis concept pairs, state-of-the-art diffusion models, including Midjourney [20] and SDXL [24], are employed to synthesize high-quality image samples for evaluation. Subsequently, expert human researchers meticulously evaluate the generated images to identify and select concept pairs that accurately manifest LC-Mis. This rigorous evaluation process culminates in the formation of our dataset.

We introduce Mixture of Concept Experts (MoCE) to enhance the alignment between images and text in text-to-image diffusion models and hence mitigate the LC-Mis issue. Specifically, inspired by the sequential rule of human drawing when faced with a concept pair ( A B , ), we divide the entire sampling process of diffusion models into two phases based on the drawing advice given by an LLM, where only one of A and B is provided in the first phase and then the complete text prompt is used in the second phase. Once the image synthesis is complete, a quantitative metric based on proven benchmarks, such as Clipscore [11] and Image-Reward [37], is employed to measure the alignment between

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-d4a1b943-dab9-4d36-8815-cde1da661dce.jpg)

A tea cup of iced coke

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-36f505d5-17df-41a3-a53f-e2c093e1107a.jpg)

Green tea in red solo cup

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-1912c536-9e8a-4d95-bd80-a7b281b4941e.jpg)

Pancakes in a cup

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-908e3431-b523-4737-98db-1b387900794e.jpg)

Astone lion at Pairs

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-67c5c0ee-fd65-432b-abe6-e1bc67be5767.jpg)

Red wine in Airline cockpit

Crocodile in front of Neuschwanstein

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-9269a69a-4aeb-4d1d-8aa6-5bbd7faf7406.jpg)

A tea cup of iced coke

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-86945618-4ee3-4d17-b935-40b8a37c8a24.jpg)

Green tea in red solo cup

Pancakes in a cup

Astone lion at Pairs

Red wine in Airline cockpit

Fig. 2: We display the issue of Latent Concept Misalignment (LC-Mis). In the first row of the images, even the most advanced text-to-image models (SDXL) fail to faithfully generate the specified concepts. We have developed an autonomous pipeline to explore this issue and proposed a hotfix, MoCE, to simply fix it.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-3da8825a-624c-4934-aa21-31be10688b9c.jpg)

Crocodile in front of Neuschwanstein

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-4b450aa2-6d40-4871-9dc7-82391d4f611f.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-110827ba-06b9-40a4-91d9-63b4978f2b4f.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-2c5e487d-98f9-493f-9c03-2788eb10fcb9.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-f15a0bee-9d16-4d05-80d2-7a4f8d0752d5.jpg)

the generated images and the text prompt. This measurement is then used to iteratively adjust the lengths of the two phases mentioned above, employing a binary search method, until the generated images meet the expectation. Empirical case studies, grounded in thorough human evaluation, provide confirmation that our approach significantly mitigates the LC-Mis issue. Furthermore, it also enhances both the applicability and flexibility of text-to-image diffusion techniques across diverse fields. This improvement is clearly demonstrated in Figure 2. The models we used in this paper are those available online as of October 1, 2023 . See Section 6.2 for the discussion on the latest models.

## Here, we summarize our contributions in the following 2 aspects:

- -We investigate the neglected Latent Concept Misalignment (LC-Mis) issue within existing text-to-image diffusion models, introduce an LLM-based pipeline to collect our LC-Mis dataset.
- -We propose to split the concepts in text prompt and input them into different phases of the diffusion model generation process, effectively mitigating the LC-Mis issue.

## 2 Related Work

Diffusion Models Diffusion models [13] predict noise in noisy images and produce high-quality outputs after training. Having gained considerable attention, they are now considered the state-of-the-art in image generation. These models find applications in various domains, such as label-to-image synthesis [6,28], text-to-image generation [24,25,28], image editing [5,14,19], and video generation [12]. Specifically, text-to-image generation is of practical importance. Open-

source and commercial solutions like Stable Diffusion [24, 28], Midjourney [20] and Dall·E 3 [23] have achieved success, bolstered by advancements in neural networks [29,34] and large datasets of image-text pairs [31,32]. Nevertheless, the question of whether these models truly innovate or merely generate combinations encountered in their training data remains unresolved. In this study, we investigate this issue by examining text-to-image diffusion models in the context of unconventional concept pairings, namely LC-Mis.

Misalignment Issues While state-of-the-art generative models frequently produce high-quality, realistic images, they struggle with certain concept combinations. Such models usually mimic combinations seen in training data. Prior work has emphasized spatial conflicts where multiple entities coexist in close proximity [3, 9, 16, 17, 35]. Distinct from these investigations, our focus lies on Latent Concept Misalignment, illustrated by phrases such as 'a tea cup of iced coke.' Through rigorous experimentation, we investigate this challenge and introduce a benchmark alongside a hotfix solution.

## 3 Benchmark: Collecting Data on Latent Concept Misalignment (LC-Mis)

In this section, we detail the process of collecting our LC-Mis dataset. In our dataset, each pair features Concept A and Concept B , which cannot be simultaneously generated by text-to-image models due to the existance of the latent concept, C . The advantages of our collection system are as follows:

- -Given that extensive human knowledge is required to generate data with LC-Mis issue, we utilize LLMs (e.g., GPT-3.5 in this paper) to develop an efficient guidance system, inspired by LLMs Reasoning [8].
- -These concept pairs often defy common human understanding, making them challenging to mine. We meticulously craft a generation loop containing 4 phases, allowing the iterative amplification of a small dataset into a substantially larger one. The process overview is shown in Figure 3, and the detailed prompts to guide GPT-3.5 can be found in our Appendix Section A.
- -Finally, concept pairs discovered by GPT-3.5 require comprehensive evaluation. However, advanced tools such as Clipscore [11] or Image Reward [37] may exhibit ineffectiveness in LC-Mis problem (Section 5.3). Therefore, the evaluation of human experts is an important part of our system.

## 3.1 Phase 1 - Identifying Initial Concept Pairs as Seeds

In Phase 1, human experts identify a small number of concept pairs and extract patterns from them. These patterns serve as seeds for subsequent dataset expansion. Human researchers begin with analyzing various visual scenes in renowned

Fig. 3: A single loop of our interactive LLMs (i.e., GPT-3.5) guidance system, comprising 4 phases. Human researchers provide instruction for GPT-3.5, then GPT-3.5 create new LC-Mis concept pairs and patterns for evaluation. We can iterate the phase 2 - 4 to rapidly expand our LC-Mis dataset.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-6df9cd46-d9e6-4a71-bf2a-778143dad218.jpg)

text-to-image datasets, such as Laion2B-en ‡ and MJ User Prompts &amp; Images Dataset , to detect concept pairs prone to LC-Mis. They select 50 concept pairs, § like 'iced coke' and 'tea cup', which produce inaccurate output images.

Upon analysis, we categorize these concept pairs into 8 distinct patterns. Among them, 4 patterns belong to the scope of LC-Mis (detailed LC-Mis patterns are shown in Appendix Table 1), mainly including the categories of 'foreground and background', as well as 'objects and containers'. These patterns serve as an effective starting point for identifying additional concept pairs by means of GPT-3.5.

## 3.2 Phase 2 - Generating and Verifying Additional Concept Pairs with GPT-3.5

In this phase, human researchers employ GPT-3.5 to generate additional concept pairs corresponding to each pattern from Section 3.1, using the initial 50 concept pairs for few-shot learning. Using this method, GPT-3.5 generates 499 valid concept pairs. None of these pairs can be generated correctly by text-toimage models with the simple prompt 'concept A , concept B ' and they undergo rigorous verification, with most of them proving to be of high quality.

Then a further verification is meticulously designed to comprehensively assess the accuracy of the generated concept pairs. Specifically, GPT-3.5 generates 5 prompts for each pair, varying in length and richness. Subsequently, text-toimage models generate 4 images per prompt. After human verification of all 20 images, the concept pairs are scored on 5 levels: zero correct images correspond to Level 5, 1 ∼ 5 correct images to Level 4, 6 ∼ 10 to Level 3, 11 ∼ 15 to Level 2, and 16 ∼ 20 to Level 1.

‡ https://huggingface.co/datasets/laion/laion2B-en

§ https://huggingface.co/datasets/succinctly/midjourney-prompts

In total, 2,495 sentence-based text prompts are fed into text-to-image models, which in turn produce 9,980 images. After rigorous screening, 272 concept pairs (55%) attain a Level 5 rating, representing the pinnacle of quality. Among them, 173 concept pairs belong to the scope of LC-Mis and will be used as the main data for our subsequent experiments. Utilizing GPT-3.5's generalizing ability and reasoning skills, our initial dataset of 50 pairs is expanded quickly, maintaining high quality and diversity. This phase can be repeated on the basis of Phases 3 and 4 to generate more and concept pairs.

## 3.3 Phase 3 - Discovering New Patterns for Concept Pair Generation

In this phase, we leverage GPT-3.5 to identify 9 new patterns and apply the same methodology in Section 3.2 to these patterns.

During previous process, we observe that GPT-3.5 produces duplicates when tasked with generating additional concept pairs, suggesting that it may have reached the limits of its knowledge within current patterns. Consequently, GPT3.5 is encouraged to autonomously identify new patterns to enhance the semantic scope of LC-Mis. Building upon the 8 meticulously categorized patterns, human researchers instruct GPT-3.5 to identify 9 additional patterns. Subsequently, we replicate the procedures from Section 3.2, achieving a Level 5 accuracy rate of 70%, markedly exceeding the capabilities of human experts.

## 3.4 Phase 4 - Creating Novel Concept Pairs by Merging Patterns

In this phase, we merge concepts from different patterns to form new patterns and concept pairs, which will serve as seeds for the subsequent iteration.

Specifically, human researchers instruct GPT-3.5 to combine concepts from one pattern with ones from another pattern. For example, patterns labeled 'Beverage and Incorrect Container' and 'Jewelry and Inadequate Storage' are merged to create new patterns: 'Beverage and Jewelry Storage' and 'Jewelry and Beverage Container'. Following the process in Section 3.3, we observe that each newly created pattern achieves a Level 5 accuracy rate of at least 60%, demonstrating GPT-3.5's capability in synthesizing orthogonal patterns into more patterns.

In summary , we collect our dataset leveraging the collaboration between LLMs (i.e., GPT-3.5) and text-to-image models. Based on our proposed system, we can further expand our dataset iteratively in the future.

## 4 Method: Mixture of Concept Experts (MoCE)

Motivation of MoCE Humans always follow a certain order when painting. Inspired by human painting nature and motivated by dynamic models [10], we integrate LLMs (e.g., GPT-3.5 in this paper) into our method, Mixture of Concept Experts (MoCE) to alleviate the LC-Mis issues. As shown in Figure 4, we

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-99c04a66-c3d9-4303-b524-95ae7a2b0f6d.jpg)

I want to draw a picture, 'a tea cup of iced coke'. Please tell me which concept in this scene should be drawn first.

In this scene, I think we should first draw the concept ' tea cup ', and then draw the concept 'iced coke'.

Fig. 4: Overview of our method, MoCE. GPT-3.5 determines the drawing sequence of concepts. The initial concept is sampled for N steps in diffusion models before inputting the full text prompt. We use binary search to find the optimal N , refer to Section 4 Paragraph 'Dynamic Binary Optimization' and Appendix Figure 12 and 13 for details.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-4dafab7d-c881-4b13-aa90-1f339e23521d.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-5576e191-28ba-4076-893b-f18df5647b2d.jpg)

first input the easily overlooked concept to focus on the attention mechanism during the early diffusion stages, enhancing their representation in the final image. We base MoCE on SDXL [24], one of the foremost reliable open-source diffusion models. The system includes components listed as follows:

Sequential Concept Introduction Gaining insight from human artistic processes, concepts are introduced to diffusion models sequentially rather than simultaneously to prevent the LC-Mis entanglement. As a result, we need to find a reasonable and logical sequence of them. LLMs are naturally suitable for this task. Therefore, we employ GPT-3.5 to ascertain the most logical sequence for two concepts based on its comprehension of human behavior. We provide interaction details with GPT-3.5 in our Appendix Section A.

Denoising Process Partition In the denoising process of diffusion models across time steps, t T , t T -1 , ..., t 1 , t 0 , the process is split into 2 phases:

- -First Phase ( t T , t T -1 , ..., t N ): We only input the easily lost concept into diffusion models, and save images at each time step as a preparatory list.
- -Second Phase ( t N -1 , t N -2 , ..., t 0 ): t x will be selected from the preparatory list. Starting from time step t x , we provide the completed text prompt to diffusion models to synthesize the final image.

However, which image t x to take from the preparatory list reaches the optimal output remains unknown, motivating us to formulate a strategy for autonomously determining the optimal allocation of time steps.

Automated Feedback Mechanism We iteratively select the most suitable t x based on the fidelity of the final image. In this case, Clipscore , S c , is used to assess the fidelity of the generated image M to the desired concept, e.g., A :

$$\mathcal { S } _ { c } ( M, \ \mathcal { A } ) = C l i p S c o r e ( M, \ \mathcal { A } )$$

As the issue of misalignment persists, naively employing Clipscore wouldn't truly show the correlation between entity A and the final image M since it may be not distinguishable (see Section 5.3). Therefore, we calculate the Clipscore between images and both the concept itself and its corresponding description generated by GPT-3.5. Some details are not prominent in M , yet they might be further elaborated in the information further provided by the descriptions. This possibly uplifts the Clipscore of the entity and lowers the influence of misalignment to some certain extent. The the score function in MoCE, Description-Concept Coordination Score, is as follow:

$$\mathcal { S } ( M, \, \mathcal { A } ) = M a x ( \mathcal { S } _ { c } ( M, \, \mathcal { A } ), \, \mathcal { S } _ { c } ( M, \, \mathcal { A } _ { D e s c r i p t i o n } ) ) \, \quad \quad ( 2 )$$

We also devise a new metric named Multi-Concept Disparity, denoted as D :

$$\mathcal { D } = \mathcal { S } ( M, \mathcal { A } ) - \mathcal { S } ( M, \mathcal { B } )$$

D denotes the difference in the scores of an image between two concepts. The larger the size of |D| , the higher the likelihood that at least one concept within it will become blurred.

Dynamic Binary Optimization When allocating a larger number of time steps in the first stage, the more dominant features of A possibly overshadows those of B , then the greater the absolute value of D is, and vice versa. Therefore, there exists a positive correlation between the time steps allocated in the first phase and the image quality, making the binary search method highly suitable for this scenario. When the score of concept A is significantly higher than B , we choose a larger t x as the boundary point for two phases, and vice versa. If the difference of their scores is below the threshold, the final image will be output. Specific implementation details can be found in our Appendix Section C.

In summary , our methodology presents a robust solution for addressing entity misalignment in text-to-image diffusion models. It combines intuitive reasoning, automatic fine-tuning, and efficiency optimizations to produce more precise and contextually apt image outputs.

## 5 Experiments

We conduct extensive experiments centered around MoCE, revealing its ability to alleviate the LC-Mis issue in text-to-image diffusion models.

SDXL

MoCE

(c) Iced coffee, shot glass

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-25ef6ed3-8ed9-49d7-9136-da826719c880.jpg)

Fig. 5: Visualizations of images at Level 5 generated by SDXL (baseline) and MoCE. Here, we present representative examples of the 'Item and Container' pattern.

## 5.1 Setup

Dataset In Section 3.2, we obtain 272 concept pairs for Level 5. From this pool, human experts carefully select 173 concept pairs as LC-Mis cases for experiments, while the remaining concept pairs fall into the realm of traditional misalignment issues, extensively discussed in Section 2.

Model Our remediation, MoCE, is implemented using SDXL [24] due to its open-source nature and widespread use. We omit Midjourney and Dall·E 3 from consideration because of their internal black-box architectures. Our baseline, represented by these 173 LC-Mis concept pairs in Section 3, demonstrates that all of them receive a rating of Level 5, indicating that none of the images generated in 20 attempts faithfully represented the expected concepts. We also incorporate 3 additional baseline models: Attend-and-Excite (AAE) [3], Dall·E 3 [23],

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-6ab1fd8b-1af2-41f0-ac41-8f301a754ce5.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-3ef0348c-9070-4642-a3e2-7e2352c47a65.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-9a0a333c-9424-495f-bab3-8068eed15984.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-923e0739-459d-47a2-97d9-e64003f8ed3d.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-13517010-755b-42b2-aed1-7b4b6b08326d.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-8813e1a4-e425-474f-bf63-aaa2c0a60faa.jpg)

SDXL

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-df5d5818-61f7-4188-a3a9-6b40262e3a2b.jpg)

MoCE

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-8bde05fc-cbcb-409a-9fda-7705eaf69c66.jpg)

(a) Snubnosed monkey, San Fransisco

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-2b13e889-a9b7-4420-ba2e-4ea0d2174d90.jpg)

(b) Black necked crane, London

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-fe5eae94-6add-4ff8-af2d-12ee2224684f.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-cf834240-0c89-46ea-9ce2-b0e09ebaebec.jpg)

(c) Watermelon, lemon tree

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-6eb1d9c9-2e52-4efe-927d-b8b48458f42f.jpg)

Fig. 6: Visualizations of images at Level 5 generated by SDXL (baseline) and MoCE. Here, we present representative examples of the 'Foreground and Background' pattern.

and Anole [4]. AAE aims to mitigate traditional misalignment issues via the attention map layer, and Dall·E 3 through fine-grained annotation. And Anole is a novel model that employs autoregressive methods for interleaved image-text generation, offering fresh insights into resolving misalignment issues.

Our experiments use a single NVIDIA A100 GPU for image generation via SDXL, and a RTX 4090 GPU is also sufficient.

Evaluation Metric Considering the instability of quantitative score evaluation, as well as the use of Clipscore and Image-Reward in our method, MoCE,we primarily utilize human evaluation in our experiments. We engage human experts for a more impartial evaluation. Additionally, the results of quantitative score evaluation are also included in our Appendix Section D for reference.

Fig. 7: Human Evaluation for our MoCE. Human experts rate the 173 LC-Mis concept pairs on SDXL, AAE, Anole, Dalle·E 3 and our MoCE. The brown color represents the proportion of Level 5 ratings among 173 pairs. A lower Level 5 proportion indicates the model better alleviates the LC-Mis issue. Compared to baseline models, our MoCE exhibits a clear advantage when faced with LC-Mis issues, and it has even surpassed Dalle·E 3, which requires expensive training costs.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-6803eff2-fa09-4acf-a7af-36c8fb2eef2f.jpg)

## 5.2 Result

Our method, MoCE, utilizes the 173 Level 5 LC-Mis concept pairs, providing their corresponding text prompts as input to the model. The second phase of MoCE is repeated up to three times to ensure the Multi-Concept Disparity D coverage below 0.6. After obtaining 20 images for each concept pair, human experts re-evaluate these images based on the criteria discussed in Section 3. We report the counts of concept pairs at each level after undergoing improvement by our MoCE and compare them to the baseline results in Figure 7. Meanwhile, we also present several visualized images in Figure 5 and 6.

In the original Level 5 LC-Mis concept pairs, the baseline model fails to produce any correct image, as we mentioned in Section 3. Even when sophisticated engineering strategies, e.g., AAE and Anole, are used, which may be effective for traditional misalignment problems, there is little improvement for Level 5 concept pairs when applied to LC-Mis problems. However, following the enhancement made by our MoCE, over half of the concept pairs are now correctly generated, and there are even several concept pairs rated as Level 1. Additionally, Dall·E 3, with its expensive and fine-tuned data annotations, indeed helps with the LC-Mis problem, achieving improvements for Level 5 concept pairs comparable to MoCE. However, it is important to note that training Dall·E 3 requires additional data preprocessing, which can be a costly process, suggesting

(c) Pattern: Mismatched outfits, a total of 27 pairs

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-ed293ade-f6ad-4f92-ba65-dea5522ed038.jpg)

(d) Pattern: Animal and incorrect habitat, a total of 36 pairs

Fig. 8: Human Evaluation for Dall·E 3 (baseline) and our MoCE on different patterns mentioned in Section 3. The brown color represents the proportion of Level 5 ratings among 173 pairs. A lower Level 5 proportion indicates the model better alleviates the LC-Mis issue. In Patterns (a), (b), and (c), MoCE outperforms Dall·E 3, as its output includes more concept pairs belonging to Level 1 and 2. And in Pattern (d), Dall·E 3's performance is superior to MoCE.

that our MoCE produces more correct images in an economical manner. We also include a comparison of the scores of images generated by MoCE and baselines in Appendix Table 4, demonstrating that our method is statistically meaningful.

In addition, we also present the human evaluation results under the segmented patterns. As introduced in Section 3, we have divided these 173 LC-Mis concept pairs into 4 patterns, and we have presented the results of human evaluation in Figure 8. In Patterns (a), (b) and (c), MoCE outperforms Dall·E 3, as its output includes more concept pairs belonging to Level 1 and 2. And in Pattern (d), Dall·E 3's performance is superior to MoCE.

## 5.3 Analysis

We are deeply concerned about the impact of LC-Mis issues on the existing textto-image model landscape, for the most representative and challenging example, 'a tea cup of iced coke', we present visual restoration results in Figure 9. Both Clipscore and Image-Reward effectively adjust the time step in our MoCE model with the help of Description-Concept Coordination Score, while unfortunately the existing evaluation metrics may sometimes be proven to be not absolutely

(b) Generated by the baseline model, SDXL.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-0ea8a3f6-513d-4cdd-b91b-50da60b5006f.jpg)

Fig. 9: Visualization of images of 'a tea cup of iced coke' generated by both our MoCE and baseline model. We also report Clipscore (Clip-S, ↑ ) and Image-Reward Score (IR, ↑ ) between images and the concept, 'iced coke', to demonstrate the minor pitfalls of the existing evaluation metrics: even MoCE correctly generates 'iced coke' (a), the result score is still significantly lower.

accurate enough. Figure 9 displays both Clipscore and Image-Reward scores between images and the concept 'iced coke'. We meticulously choose transparent glasses generated by baseline models, which resemble tea cups, to analyze the error in the scoring mechanism. The occurrence of 'iced coke' in both subfigures within Figure 9 is evident to human experts. However, both Clipscore and Image-Reward scores are markedly lower for images of 'a tea cup of iced coke' attributed to the material of the cup. This highlights the limitations of current evaluation metrics in addressing misalignment issues and emphasizes the necessity for developing new metrics based on existing methods, which will become one of the key research directions for our future work.

## 6 Conclusions

## 6.1 Summary

In this paper, we introduce a new text-to-image misalignment issue called LCMis, involving a significant latent concept. We present a novel framework to explore the LC-Mis examples, making it one of the earliest works of using LLMs in developing image generation systems. Our method, MoCE, innovatively splits the text prompts and inputs them into diffusion models, alleviating the LC-Mis problem. Human evaluation confirms MoCE's effectiveness. we also highlight the impact of the LC-Mis on existing text-to-image systems, discuss flaws in current evaluation metrics, and call for community attention to this matter.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-9b04aecc-f5c0-4c1b-b7a0-e612d97102ee.jpg)

(a) Dall·E 3 without GPT-4

(b) Dall·E 3 with GPT-4

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-a3e95a54-6f70-4c2a-8da9-5c4a46fd0f85.jpg)

(c) Midjourney

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-bc529628-1e88-4e2a-a8ff-bf6b2ecc23b5.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-5ac05129-a89f-4cf0-b868-50789d87fa59.jpg)

(d) Stable Diffusion 3

Fig. 10: The results of the example 'a tea cup of iced coke' using the latest Dall·E 3 (a), Dall·E 3 with complex prompt engineering from GPT-4 (b), Midjourney(c) and Stable Diffusion 3 (d). The latest Dall·E 3 with GPT-4 has indeed alleviated the LCMis issue to some degree, with the help of significant annotation costs.

## 6.2 Recent Advances in the Field

Until releasing our paper, text-to-image models have further evolved. We present results from the latest (available online as of July 7, 2024) Dall·E 3, Midjourney, and Stable Diffusion 3 in Figure 10. In the example 'a tea cup of iced coke', Without complex prompt engineering, models still perform poorly on the LCMis issue, as shown in Figure 10a, 10c and 10d. Complex prompt engineering from GPT-4 (Figure 10b) does help alleviate the issue. However, it's important to note that this comes with significant annotation costs during Dall·E 3's training, and is also accompanied by a certain degree of instability, highlighting the issue's significance.

## 6.3 Future Work

In our future work, we will focus on exploring more complex LC-Mis scenarios and developing learnable search algorithms to reduce the iterations in our method. Additionally, we will expand the range of model types, model versions and sampler types used in our dataset and continuously iterate our dataset collection algorithms to enhance and enlarge the dataset.

## Acknowledgement

This work was supported by Key R&amp;D Program of Shandong Province, China (2023CXGC010112).

## References

- 1. Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al.: Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023)
- 3. Chefer, H., Alaluf, Y., Vinker, Y., Wolf, L., Cohen-Or, D.: Attend-and-excite: Attention-based semantic guidance for text-to-image diffusion models. ACM Transactions on Graphics (TOG) 42 (4), 1-10 (2023)
- 2. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. In: NeurIPS (2020)
- 4. Chern, E., Su, J., Ma, Y., Liu, P.: Anole: An open, autoregressive and native multimodal models for interleaved image-text generation. GitHub repository (2024), https://github.com/GAIR-NLP/anole
- 5. Couairon, G., Verbeek, J., Schwenk, H., Cord, M.: Diffedit: Diffusion-based semantic image editing with mask guidance. arXiv preprint arXiv:2210.11427 (2022)
- 7. Ding, M., Yang, Z., Hong, W., Zheng, W., Zhou, C., Yin, D., Lin, J., Zou, X., Shao, Z., Yang, H., et al.: Cogview: Mastering text-to-image generation via transformers. In: NeurIPS (2021)
- 6. Dhariwal, P., Nichol, A.: Diffusion models beat gans on image synthesis. In: NeurIPS (2021)
- 8. Dong, Q., Dong, L., Xu, K., Zhou, G., Hao, Y., Sui, Z., Wei, F.: Large language model for science: A study on p vs. np. arXiv preprint arXiv:2309.05689 (2023)
- 10. Han, Y., Huang, G., Song, S., Yang, L., Wang, H., Wang, Y.: Dynamic neural networks: A survey. TPAMI (2021)
- 9. Du, Y., Durkan, C., Strudel, R., Tenenbaum, J.B., Dieleman, S., Fergus, R., SohlDickstein, J., Doucet, A., Grathwohl, W.S.: Reduce, reuse, recycle: Compositional generation with energy-based diffusion models and mcmc. In: ICML (2023)
- 11. Hessel, J., Holtzman, A., Forbes, M., Bras, R.L., Choi, Y.: Clipscore: A referencefree evaluation metric for image captioning. arXiv preprint arXiv:2104.08718 (2021)

Poole,

12.

Ho, J., Chan, W., Saharia, C., Whang, J., Gao, R., Gritsenko, A., Kingma, D.P., generation with diffusion models. arXiv preprint arXiv:2210.02303 (2022)

B.,

Norouzi,

M., Fleet,

D.J., et

al.:

Imagen video: High definition video

- 13. Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. In: NeurIPS (2020)
- 15. Li, B., Qi, X., Lukasiewicz, T., Torr, P.: Controllable text-to-image generation. In: NeurIPS (2019)
- 14. Kawar, B., Zada, S., Lang, O., Tov, O., Chang, H., Dekel, T., Mosseri, I., Irani, M.: Imagic: Text-based real image editing with diffusion models. In: CVPR (2023)
- 16. Li, Y., Liu, H., Wu, Q., Mu, F., Yang, J., Gao, J., Li, C., Lee, Y.J.: Gligen: Open-set grounded text-to-image generation. In: CVPR (2023)
- 17. Liu, N., Li, S., Du, Y., Torralba, A., Tenenbaum, J.B.: Compositional visual generation with composable diffusion models. In: ECCV (2022)

- 18. Mansimov, E., Parisotto, E., Ba, J.L., Salakhutdinov, R.: Generating images from captions with attention. arXiv preprint arXiv:1511.02793 (2015)
- 20. Midjourney: Midjourney (V5.2) [Text-to-Image Model]. https : / / www . midjourney.com (2023)
- 19. Meng, C., He, Y., Song, Y., Song, J., Wu, J., Zhu, J.Y., Ermon, S.: Sdedit: Guided image synthesis and editing with stochastic differential equations. arXiv preprint arXiv:2108.01073 (2021)
- 21. Nichol, A., Dhariwal, P., Ramesh, A., Shyam, P., Mishkin, P., McGrew, B., Sutskever, I., Chen, M.: Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741 (2021)
- 23. OpenAI: Dall·e 3 system card. OpenAI technical report (2023)
- 22. OpenAI: ChatGPT (Aug 3 Version) [Large Language Model]. https://chat. openai.com (2023)
- 24. Podell, D., English, Z., Lacey, K., Blattmann, A., Dockhorn, T., Müller, J., Penna, J., Rombach, R.: Sdxl: Improving latent diffusion models for high-resolution image synthesis. arXiv preprint arXiv:2307.01952 (2023)
- 26. Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., Sutskever, I.: Zero-shot text-to-image generation. In: ICML (2021)
- 25. Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., Chen, M.: Hierarchical textconditional image generation with clip latents. arXiv preprint arXiv:2204.06125 (2022)
- 27. Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., Lee, H.: Generative adversarial text to image synthesis. In: ICML (2016)
- 29. Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: MICCAI (2015)
- 28. Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: CVPR (2022)
- 30. Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E.L., Ghasemipour, K., Gontijo Lopes, R., Karagol Ayan, B., Salimans, T., et al.: Photorealistic textto-image diffusion models with deep language understanding. In: NeurIPS (2022)
- 32. Sharma, P., Ding, N., Goodman, S., Soricut, R.: Conceptual captions: A cleaned, hypernymed, image alt-text dataset for automatic image captioning. In: ACL (2018)
- 31. Schuhmann, C., Beaumont, R., Vencu, R., Gordon, C., Wightman, R., Cherti, M., Coombes, T., Katta, A., Mullis, C., Wortsman, M., et al.: Laion-5b: An open large-scale dataset for training next generation image-text models. In: NeurIPS (2022)
- 33. Song, Y., Dhariwal, P., Chen, M., Sutskever, I.: Consistency models. arXiv preprint arXiv:2303.01469 (2023)
- 35. Wang, R., Chen, Z., Chen, C., Ma, J., Lu, H., Lin, X.: Compositional text-toimage synthesis with attention map control of diffusion models. arXiv preprint arXiv:2305.13921 (2023)
- 34. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. In: NeurIPS (2017)
- 36. Wu, C., Liang, J., Hu, X., Gan, Z., Wang, J., Wang, L., Liu, Z., Fang, Y., Duan, N.: Nuwa-infinity: Autoregressive over autoregressive generation for infinite visual synthesis. arXiv preprint arXiv:2207.09814 (2022)
- 37. Xu, J., Liu, X., Wu, Y., Tong, Y., Li, Q., Ding, M., Tang, J., Dong, Y.: Imagereward: Learning and evaluating human preferences for text-to-image generation. arXiv preprint arXiv:2304.05977 (2023)

- 38. Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X., He, X.: Attngan: Fine-grained text to image generation with attentional generative adversarial networks. arxiv. arXiv preprint arXiv:1711.10485 (2017)
- 40. Zhang, H., Xu, T., Li, H., Zhang, S., Wang, X., Huang, X., Metaxas, D.N.: Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks. In: ICCV (2017)
- 39. Yu, J., Xu, Y., Koh, J.Y., Luong, T., Baid, G., Wang, Z., Vasudevan, V., Ku, A., Yang, Y., Ayan, B.K., et al.: Scaling autoregressive models for content-rich text-to-image generation. arXiv preprint arXiv:2206.10789 (2022)

## Appendix

## A Interaction Details in Interactive LLMs Guidance System

In this section, we describe the detailed process of interaction between human researchers and GPT-3.5 within our workflow. Utilizing block diagrams for clarity, we model the engagement between human experts and GPT-3.5. To illustrate the variation in data volume within the Interactive LLMs Guidance System, we present several diagrams, in Figure 11. In these diagrams, pairs of spheres along the same axis denote concept pairs associated with a particular pattern, distinguishable by their color.

Fig. 11: Schematic diagrams of different rounds of Socratic Reasoning. The complete procedure contains coming up with concept pairs (Figure a), guiding GPT-3.5 to extend concept pairs (Figure b), guiding GPT-3.5 to create new patterns (Figure c) and guiding GPT-3.5 to blend exsiting patterns (Figure d).

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-02abadca-5bc5-4a71-8085-c7d45f71d057.jpg)

Phase 1: Identifying Initial Concept Pairs as Seeds After developing an initial set of 50 concept pairs and categorizing them into 8 unique patterns (among them, 4 patterns match our LC-Mis issue), human researchers direct GPT-3.5 to generate additional concept pairs. We specify both the researcherprovided prompt and the GPT-3.5 response. The format of the patterns deducting concept pairs are depicted in Table 1.

Midjourney text-to-image generation, in conjunction with human researcher validation, then confirms a total of 50 concept pairs. Throughout the evaluation conducted by human experts, 5 impartial human experts are tasked to identify the generated images. If minor differences, a majority opinion will be adopted. Otherwise, a senior expert will come to re-identify the image. Human expert evaluation prove to be accurate under certain circumstances as discussed in Section 5.3 of our paper.

Latent Concept Misalignment in Text-to-Image Diffusion Models

Table 1: Patterns summarized manually by human researchers.

## Pattern

Beverage and erroneous container

Mismatched outfits

Local cuisine and non-native location Animal and incorrect habitat

...

Prompt: I want you to act as an AI creative assistant helping users generate pairs of nouns on cue: pairs of Beverage and erroneous container (e.g. iced coke, tea cup). Each pair occupies one line, in 1 ˜ 3 words, separated by commas.

Answer: Certainly, I can help you generate pairs of nouns as requested. Here are some pairs of beverages and wrong containers:

- 1. Coffee, Champagne Flute
- 3. Hot Chocolate, Martini Glass
- 2. Orange Juice, Coffee Mug
- 4. Iced Tea, Shot Glass

......

- 5. Lemonade, Beer Stein

These pairs should provide some creative and humorous combinations of beverages and the erroneous containers for your use. If you need more pairs or have any specific preferences, feel free to let me know!

We leverage GPT-3.5 to generate 5 detailed prompts for each concept pair:

Prompt: I want you to act as an AI creative assistant helping users generate images using Midjourney. Your job is to generate a prompt for text-to-image generation model. You are good at text-image concept grounding, visual concept understanding, text-to-image diffusion models' prompt engineering. Don't be verbose in your answers, only provide the proposed prompt itself and avoid including explanations. I've provided you with a pair of visual concepts, and I want you to provide me with detailed prompts to feed into Midjourney that one given concept would show up with the other one in the corresponding generated image. It will be your job to come up with five prompts that closely integrate two concepts visually, yet each remains a distinct entity. Remember there is NO extra object or human in the prompt, NOR any explanatory sentences, according to the user's specifications.

Now, the given two visual concepts are: Iced coke, tea cup

## Answer:

- 1. Ice coke bubbling in a tea cup.
- 3. Ice coke poured into a tea cup.
- 2. A tea cup of ice coke.
- 4. Iced coke in a tea cup.
- 5. Tea cups filled with iced coke, cold fogging up.

Phase 2 - Generating and Verifying Additional Concept Pairs On the basis of known patterns, we encourage GPT-3.5 to explore more concept pairs. Our instructions for GPT-3.5 are as follows:

Prompt: I want you to act as a concept pair generator for text-to-image generation model, midjourney. You are good at text-image concept grounding, visual concept understanding, text-to-image diffusion models' prompt engineering. Don't be verbose in your answers, but do provide details and examples where it might help the explanation. I've provided you with a bunch of existing positive and negative noun-concept pairs. The existing positive pairs comprise a common beverage and an unconventional common container that is not typically used to hold or serve that beverage, making them positive pairs. Specifically, given noun-concept pair like "iced coke" and "tea cup", they are both common in the real world. However, the resultant text-to-image synthesis unexpectedly refers to "a glass cup containing iced coke", with the concept of "tea cup" ignored. It will be your job to come up with 30 such new positive noun-concept pairs following the given pairs. You need to remember that nouns cannot be repeated between different concept pairs.

[positive] Coffee, Champagne Flute

[positive] Orange Juice, Coffee Mug

[positive] Iced Tea, Shot Glass

[positive] Milkshake, Whiskey Tumbler

[positive] Coca-Cola, Water Bottle

[positive] Green Tea, Red Solo Cup

[positive] Hot Coffee, Cocktail Shaker

[positive] Iced Coffee, Shot Glass

[positive] Pina Colada, Beer Stein

[positive] Iced Latte, Soda Can

[positive] Espresso, Water Bottle

[positive] Hot Tea, Coffee Mug

[positive] Apple Cider, Cocktail Shaker

[positive] Hot Chocolate, Red Solo Cup

[positive] Pumpkin Latte, Water Bottle

[positive] Mojito, Highball glass

[negative] Smoothie, Tea cup

[negative] Iced Cola, Glass

[negative] Orange Juice, Juice Glass

[negative] Hot Coffee, Coffee Mug

[negative] Beer, Beer Mug

[negative] Lemonade, Pitcher

[negative] Water, Water Bottle

[negative] Wine, Wine Glass

[negative] Iced Mocha, Soda Can

[negative] Cold Brew, Wine Glass

[negative] Mojito, Pint Glass

[negative] Cider, Champagne Flute

[negative] Iced Milk Latte, Pint Glass

Answer: Sure! Based on the examples you provided, I will generate 30 new positive noun-concept pairs (beverage, uncommon vessel). I will ensure that the nouns are not repeated. Here are the pairs:

1. [positive] Ginger Ale, Martini Glass

2. [positive] Root Beer, Teapot

3. [positive] Soda, Whiskey Flask

4. [positive] Chocolate Milk, Wine Carafe

5. [positive] Matcha Latte, Beer Boot

6. [positive] Bloody Mary, Coffee Carafe

7. [positive] Seltzer, Whiskey Decanter

8. [positive] Lemonade, Margarita Glass

9. [positive] Sprite, Tea cup

10. [positive] Lassi, Martini Shaker

11. [positive] Fruit Punch, Whiskey Flask

12. [positive] White Wine, Shot Glass

13. [positive] Champagne, Milk Jug

14. [positive] Red Wine, Milkshake Glass

15. [positive] Diet Coke, Teapot

16. [positive] Pepsi, Champagne Bucket

17. [positive] Mountain Dew, Wine Decanter

18. [positive] Black Tea, Margarita Glass

19. [positive] Mint Julep, Coffee Carafe

20. [positive] Rum, Tea Kettle

21. [positive] Whiskey, Juice Box

22. [positive] Vodka, Soup Bowl

23. [positive] Gin and Tonic, Coffee Thermos

24. [positive] Sprite, Wine Bucket

25. [positive] Protein Shake, Wine Carafe

26. [positive] Kombucha, Martini Glass

27. [positive] Grey Tea, Champagne Bucket

28. [positive] Cappuccino, Margarita Glass

29. [positive] Fanta, Coffee Pot

30. [positive] Tonic Water, Teapot

Phase 3 - Discovering New Patterns for Concept Pair Generation The proliferation of repetitive concept pairs has prompted researchers to investigate innovative approaches. Engaging with GPT-3.5, scholars aim to automate the discovery of new patterns. Our instructions for GPT-3.5 are as follows:

Prompt: I want you to act as a bot summarizing the pattern rule and generating more patterns. You are good at text-image concept grounding, visual concept understanding, text-to-image diffusion models' prompt engineering. Don't be verbose in your answer, but do provide details and examples that might help the explanation.

In the provided positive and negative patterns, the noun pairs in the positive pattern are combinations that almost never appear in the text-to-image training dataset, such as beverage and erroneous container (e.g., iced cola and tea cup) or local cuisine and non-native location (e.g., sushi and New York City). Specifically, for a positive noun pair "A" and "B", there will usually be a hidden concept "C". "A" always appears with "C" in the text-to-image training dataset, "B" and "C" belong to the same category or are of the same kind but their visual effect is very different. Therefore, because of the strong association between "A" and "C," it leads to "B" being obscured or occupied in the generated image with prompts "A" and "B". For example, in the positive pattern "Beverage and erroneous container", "A" (iced coke) and "B" (tea cup) are a good example pair. Because "A" (iced coke) is strongly bound to the latent concept "C" (glass), telling the model to generate "a tea cup of iced coke" will generate a glass of iced coke instead of a tea cup of iced coke.

I have provided you with a series of existing positive and negative patterns, where "pattern" refers to a generalization of certain noun pairs, A and B. Where A and B are very common concepts, such as coke and tea cup. Moreover, these noun pairs are closely related to visual imagery, rather than being two independent objects, such as the wrapper and the wrapped item, background and foreground, etc.

Conversely, the noun pairs in the negative pattern are combinations that frequently appear in the text-to-image training dataset, such as animal and their corresponding external covering or jackets and their appropriate inner garments. Your task is to come up with some new positive patterns based on the given positive and negative patterns:

(see next page)

[positive] Beverage and erroneous container

[positive] Animal and incorrect external covering

[positive] Mismatched outfits

[positive] Endangered species and historical sites

[positive] Local cuisine and non-native location

[negative] Food and its appropriate container

[negative] Furniture and its corresponding setting

[negative] Endangered animals and their habitats.

Answer: Certainly, here are some new positive patterns based on the provided guidelines:

- 1. [positive] Musical Instrument and Inappropriate venue
- -Explanation: Visualize a violin being in a football stadium, creating a striking visual contrast between the delicate instrument and the sports arena.
- - Example: Violin and Football stadium
- 2. [positive] Fruit and Unrelated seasoning
- -Explanation: Imagine an orange paired with a salt shaker, where the seasoning doesn't match the typical use for the fruit.
- - Example: Orange and Salt shaker
- 3. [positive] Spacecraft and Terrestrial landscape
- -Explanation: Picture a rocket placed in a desert landscape, highlighting the visual discord between space technology and earthly terrain.
- -Example: Rocket and Desert landscape
- 4. [positive] Jewelry and Improper storage
- - Explanation: Visualize a valuable diamond necklace stored in a toolbox, emphasizing the incongruity between luxury jewelry and a utilitarian container.
- -Example: Diamond necklace and Toolbox
- 5. [positive] Sports Gear and Wrong sport
- - Explanation: Picture a baseball bat in an ice hockey rink, where the sporting equipment is out of place for the chosen location.
- -Example: Baseball bat and Ice hockey rink
- ...... These patterns create visual contradictions by juxtaposing related concepts

in unexpected ways, following the same principles as the given positive patterns.

Due to the lack of guidance from information that has been validated in visual space, the new concept pairs answered by GPT-3.5 don't achieve the expected effect. So human researchers propose a shift toward necessitating concepts within the linguistic domain rather than demanding concept pairs specifically. In this way, human researchers only need to select suitable conflicting concepts from two sets of concepts and combine them for verification, drawing from their accumulated experience with text-image interactions. This avoids both unguided exploration and excessive guidance, see the instruction prompt in the next page.

Prompt: What storage is the most unlikely to put jewelry like a pearl ring necklace in? Help me list some of the most unlikely.

Answer: When considering containers that are highly unlikely choices for storing a precious item like a pearl ring necklace, we can think creatively. Here are some of the most unlikely containers:

- 1. Bird's Nest: Placing a delicate pearl ring necklace in a bird's nest would be highly impractical and unexpected.
- 3. Toilet Bowl: Using a toilet bowl as a storage place for jewelry is not only unhygienic but also absurd.
- 2. Fish Tank: The underwater environment of a fish tank would be detrimental to a pearl ring necklace.
- 4. Compost Bin: Pearls and organic waste do not mix, making a compost bin a truly improbable choice.
- 6. Fireplace Ashes: The ashes from a fireplace are the last place one would think of storing a delicate necklace.
- 5. Dog's Food Bowl: Storing jewelry alongside pet food is both unclean and unusual.
- 7. Shoe Sole: Tucking a pearl necklace into the sole of a shoe is an unexpected and risky choice.
- 9. Hollowed-Out Watermelon: Hiding jewelry inside a watermelon would be a whimsical and impractical choice.
- 8. Fishing Tackle Box: A tackle box designed for fishing equipment is far from suitable for jewelry storage.
- 10. Tool Shed Toolbox: Storing jewelry in a toolbox designed for tools is unconventional and risky.

These containers not only provide an answer to your question but also illustrate the unusual and impractical nature of storing a precious item like a pearl ring necklace in them.

We have also present the new patterns given by GPT-3.5 in Tabel 2 as follows:

Table 2: New patterns created by GPT-3.5 and the levels of their concept pairs.

| Category   | New Pattern                                | Num of Pairs Rated at Level 5   |
|------------|--------------------------------------------|---------------------------------|
| LC-Mis     | Jewelry and improper storage               | 11 / 15                         |
| LC-Mis     | Flower and unconventional vase             | 10 / 15                         |
| LC-Mis     | Sport and unconventional equipment         | 13 / 15                         |
| LC-Mis     | Musical instrument and inappropriate venue | 11 / 15                         |
| LC-Mis     | Sports equipment and mismatched locations  | 10 / 15                         |
| LC-Mis     | Household appliances and incorrect room    | 8 / 15                          |

Phase 4 - Creating Novel Concept Pairs by Merging Patterns Two straight lines determine a plane. Once the points on the two lines are defined, it's available to guide GPT-3.5 to expand the new plane. This means GPT-3.5 can blend newly generated patterns with previous patterns, thereby generating more LC-Mis concept pairs. Our instructions for GPT-3.5 are as follows:

Prompt: I found that the text-to-image model cannot draw some images specified by patterns. For example, the pattern "Beverage and wrong beverage container" ("A and B") and the pattern "Jewelry and Impre storage" ("C and D").

And another pattern "Jewelry and improper storage" also includes many concept pairs, such as "Diamond necklace in toolbox", "Ruby earings in bird nest", "Silver anklet in toilet bowl", and so on.

The pattern "Beverage and erroneous container" includes many concept pairs, such as "iced coke in a tea cup", "green tea in a red solo cup", "Orange juice in a coffee mug", and so on.

I hope to come up with more patterns that cannot be drawn based on these two patterns. Can you help me come up with a few more patterns based on these two patterns. In other words, I mean you to generate new patterns by recombining the items in the two patterns I provided to you, rather than providing new concept pairs in the patterns I gave. You need to use only the two patterns I've provided and regroup things.

Answer: Certainly, I can help you generate two new patterns "A and D" and "B and C" based on your provided patterns "Jewelry and improper storage" and "Beverage and erroneous container" These new patterns will involve combinations that are less likely to occur together, and the model may have difficulty drawing corresponding images.

In the current case, "A" refers to beverage, "B" refers to beverage containers, "C" refers to Jewelry, and "D" refers to storage. Give me the appropriate 2 patterns "A and D" and "B and C". Where "A" and "D" almost never occur together, and "B" and "C" never occur together. For each new pattern, please give me detailed concept pairs belonging to this pattern that the model may fail to draw such an image.

Pattern 1: "A and D" - Beverage and Imperial Storage

- 1. Champagne in a treasure chest

In this pattern, we combine "Beverage" (A) with "Imperial storage" (D). These two elements are quite different, and the challenge here would be to depict beverages in an imperial storage setting.

- 2. Coffee in a fish tank
- 4. Tea in an ornate jewelry box
- 3. Soda in a bird nest
- 5. Red wine in a toolbox

(see next page)

......

## Pattern 2: "B and C" - Beverage Container and Jewelry

- These elements typically have no connection, so the challenge would be to depict jewelry inside beverage containers.

This pattern

combines "Beverage container"

(B)

with

- 1. Diamond ring in a soda can
- 3. Pearl bracelet in a beer mug
- 2. Gold necklace in a coffee thermos
- 4. Sapphire earrings in a wine bottle

......

- 5. Ruby brooch in a cocktail shaker

These new patterns should provide a creative challenge for the text-toimage model by combining elements that are not usually associated with each other.

Human researchers then repeat the verification process used in Phase 1 to verify these concept pairs. After thorough verification, we report the number of concept pairs rated as Level 5 for each blended pattern in Table 3. It's quite surprising to discover that the validation results closely align with the expectations of human researchers, indicating that GPT-3.5 successfully integrates two mutually orthogonal patterns.

Table 3: Blended patterns created by GPT-3.5 and the levels of their concept pairs.

| Category   | Blended Pattern                                     | Num of Pairs Rated at Level 5   |
|------------|-----------------------------------------------------|---------------------------------|
| LC-Mis     | Jewelry and beverage container                      | 12 / 15                         |
| LC-Mis     | Beverage and jewelry storage                        | 10 / 15                         |
| LC-Mis     | Flower and beverage container                       | 10 / 15                         |
| LC-Mis     | Beverage and flower vase                            | 11 / 15                         |
| LC-Mis     | Sport and wrong beverage container                  | 15 / 15                         |
| LC-Mis     | Unconventional equipment and beverage               | 12 / 15                         |
| LC-Mis     | Musical instrument and historical sites             | 10 / 15                         |
| LC-Mis     | Endangered species and musical scenes               | 9 / 15                          |
| LC-Mis     | Sports equipment in the wrong type of room          | 10 / 15                         |
| LC-Mis     | Locations with misplaced household appliances       | 12 / 15                         |
| LC-Mis     | Household appliances and location outside of origin | 11 / 15                         |
| LC-Mis     | Incorrect room and local food                       | 12 / 15                         |

"Jewelry"

(C).

## B Interaction in Sequential Concept Introduction

Here, we present the detailed interaction to guide GPT-3.5 to provide the most logical sequence of two concepts and the description of them.

Prompt: I want you to act as an AI creative assistant. I have two concepts A and B, and a sentence combining these two concepts together. I want you to help me generate a brief visual description of each concept. Namely, a concise description of what a given noun itself looks like, such as color, shape, or other visual features. As short as possible. No background. No other objects.

Now, the concept A is "a tea cup", B is "iced coke", and the sentence is "A tea cup filled with iced coke". Please answer me with the descriptions of A and B, and tell me which one to draw first.

In addition, if I tend to draw a picture using the sentence, please tell me which concept I should draw first. For example, if a concept is a type of container, we should draw such a container first. If a concept is a type of background, we should draw such background first.

Answer: Certainly, I can help you.

Concept B: Iced Coke - Dark, fizzy liquid with translucent ice cubes floating within.

Concept A: Tea cup - A small, usually white or pastel-colored cup, often with a handle, designed to hold hot beverages.

To draw the sentence "A tea cup filled with iced coke":

- 2. Then, fill the tea cup with the iced coke (Concept B).
- 1. Draw the tea cup first (Concept A), as it acts as the container.

## C Comprehensive Explanation of MoCE

The whole process of MoCE actually contains two phases. For the first phase, as depicted in Figure 12, Diffusion Models was asked to generate the image for the selected substance to form a preparatory list including images of different timestamps t T . From there, the second phase of MoCE, as shown in Figure 13 gets in effect, which takes an image of specific timestamp t n from the preparatory list as the input for the Diffusion Models in the second stage where the whole sentence containing both substances was taken as the prompt. The selection of the specific candidate from the preparatory list was determined by our scoring model introduced in paper Section 4.

## D Score Evaluation

By convention, evaluation metrics such as Clipscore and Image-Reward are usually used to gauge the correspondence between the generations and the input entities quantitatively. These metrics utilize the cosine similarity between embeddings produced by Deep Neural Networks (DNNs). Nonetheless, they often

Fig. 12: First phase of MoCE. Provided with a prompt, GPT-3.5 determines drawing order. SDXL generates latent images at each step, storing them in a preparatory list.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-ead70402-ae08-49cd-b74b-c5dd7cd9e27b.jpg)

Fig. 13: Second phase of MoCE. The second stage model takes an image from the preparatory list and performs denoising. A specific selection process, utilizing the MultiConcept Disparity and binary search, was used to select a better image from the list.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-0b58d1fa-ff45-4af4-8a6a-98bd46408bca.jpg)

fail to discern numerical values, transparent objects, and other crucial elements readily identifiable by humans. In our paper Section 4, our proposed MoCE uses the Multi-Concept Disparity ( D ) between the scores of 64 images ( M ) with respect to 2 concepts ( A and B ) as the basis for performing a binary search:

$$\mathcal { D } = \mathcal { S } ( M, \mathcal { A } ) - \mathcal { S } ( M, \mathcal { B } )$$

We use this metric to assist the demonstration our MoCE performance. Specifically, we assess the generation performance of both the baseline model (SDXL) and our MoCE using the metric, D , in Equation 4, where D is calculated using Clipscore or Image-Reward, denoted as D -Clipscore ¶ and D -Image-Reward respectively. Experiments are conducted on both the set of concept pairs at Level 5 and Level 1 to 4. We report the experimental results in Table 4. In comparison to the baseline model, D - Clipscore of images generated by our MoCE is reduced by more than half, and the D -Image-Reward is reduced by more than 1 3 , in

¶ To facilitate easier observation by human experts, we demonstrate the established D -Clipscore at a magnification of 10 × .

either set of levels. It demonstrates MoCE's ability to effectively restore the lost concepts in images.

Table 4: Score Evaluation for our MoCE using both D - Clipscore ( ↓ ) and D - ImageReward ( ). We use concept pairs originally rated as Level 5 and Level 1 - 4. ↓

| Original Level   | Method D -   |   Clipscore ( ↓ ) |   D - Image-Reward ( ↓ ) |
|------------------|--------------|-------------------|--------------------------|
| Level 1 - 4      | Baseline     |              0.91 |                     1.1  |
| Level 1 - 4      | MoCE         |              0.45 |                     0.75 |
| Level 5          | Baseline     |              1.09 |                     1.21 |
| Level 5          | MoCE         |              0.55 |                     0.79 |

## E Ablation Demo

Here, we first demonstrate the ablation test on computational time. Figure 14 shows that the prompt switching time can be set between 20% and 40% of the steps to optimize the time-performance tradeoff, thus optimizing the cost to 1 × or 2 × at the same time.

Moreover, ablation test on dataset size is also conducted. Here we compare 3 models from datasets of varying sizes, as shown in Figure 15. Since DALL·E 3 is not open-sourced, we cannot apply MoCE to it. DALL·E 3 does perform well. However, its detailed labeling process is labor-intensive,while at the same time, our MoCE can be easily integrated into current models.

Fig. 14: Analysis for different prompt switching times on 'a tea cup of iced coke."

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-aef5e912-69f7-417b-b19f-1620e0a4675e.jpg)

Fig. 15: Comparison between baseline models and MoCE on various datasets with different sizes.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-48772917-5944-4839-aaad-d525d4d4e7c9.jpg)

## F Restoration Visualizations of Level 5

Here, we demonstrate more visualizations of images of Level 5 restored using our MoCE. In spite of the given additional rich information, Midjourney fails to correctly generate these images. While using the same text prompts, our MoCE successfully retrieves the lost concepts as presented in Figure 16 and 17. We also propose that in Figure 16 and 17, human experts judge 'Hot Tea' based on the transparency of the liquid and 'Shanghai' based on landmarks such as the Oriental Pearl TV Tower. These judgments are based on verified model tendencies.

## G Restoration Visualizations of Level 1 - 4

For images restored by baseline models by adding rich information, our MoCE can also easily retrieve the lost concepts and increase the frequency of correct generation, as presented in Figure 18 and 19.

Fig. 16: Visualizations of images at Level 5 generated by baseline models and our MoCE.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-b6b376bd-1258-445e-83b9-5ea44841a34c.jpg)

Fig. 17: Visualizations of images at Level 5 generated by baseline models and our MoCE.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-fc759393-0238-4e12-ba7f-22c5862d40ad.jpg)

Baseline Models MoCE

(e) Pancakes, Tea cup

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-d9b7c1df-19bf-45e9-b688-19c485eb907e.jpg)

Fig. 18: Visualizations of images at Level 1 4 generated by baseline models and our MoCE. With additional information, baseline models can indeed generate a small number of correct images, and our MoCE is able to increase the frequency of correct generation.

Baseline Models Baseline Models with Additional Info

MoCE

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-22be1f45-5c23-48f5-9fc5-48e8c04eb8d9.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-3fc87a37-cbda-4403-bfd2-6a093c031bd0.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-58248d91-90dd-400b-8464-060a8b1a47b4.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-e50c4c37-393f-465b-860d-0d3d851e4144.jpg)

(f) California Condor, Petra

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-6cc6ac43-9436-43ac-b6f9-4386ab6dfdde.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-2464b4a8-b1f8-4ba1-928e-efb4b7f28a60.jpg)

(g) Javan Rhino, Stonehenge

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-075b06ec-71a1-4121-ac8a-36b87b5b253e.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-302d7572-3a67-494e-8104-859a411518a6.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-fd09e2df-dd98-44dd-94c3-23ea780be360.jpg)

(h) Javan Halk-Eagle, Sydney Opera House

(i) Asian Elephant, Angkor Wat

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-1fb51761-971b-4371-b634-a939e72c47b7.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-9f33223a-b7dd-428f-aac1-243e7a156ba6.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-6b258b47-3860-49ab-894b-53435d2ef29d.jpg)

(j) Indus River Dolphin, Mount Fuji

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-67d66c29-a668-4285-adaa-3368d9e5f539.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-f63140ea-658c-4666-b611-9c9d9ca48ea0.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00230v2-figure-9f63fbce-bc6a-4a43-b874-7c664776fd4b.jpg)

Fig. 19: Visualizations of images at Level 1 4 generated by baseline models and our MoCE. With additional information, baseline models can indeed generate a small number of correct images, and our MoCE is able to increase the frequency of correct generation.
Juntu Zhao Junyu Deng Yixin Ye Chongxuan Li Zhijie Deng Dequan Wang
Lost in Translation: Latent Concept Misalignment in Text-to-Image Diffusion Models
Advancements in text-to-image diffusion models have broadened extensive
downstream practical applications, but such models often encounter misalignment
issues between text and image. Taking the generation of a combination of two
disentangled concepts as an example, say given the prompt "a tea cup of iced
coke", existing models usually generate a glass cup of iced coke because the
iced coke usually co-occurs with the glass cup instead of the tea one during
model training. The root of such misalignment is attributed to the confusion in
the latent semantic space of text-to-image diffusion models, and hence we refer
to the "a tea cup of iced coke" phenomenon as Latent Concept Misalignment
(LC-Mis). We leverage large language models (LLMs) to thoroughly investigate
the scope of LC-Mis, and develop an automated pipeline for aligning the latent
semantics of diffusion models to text prompts. Empirical assessments confirm
the effectiveness of our approach, substantially reducing LC-Mis errors and
enhancing the robustness and versatility of text-to-image diffusion models. The
code and dataset are here: https://github.com/RossoneriZhao/iced_coke.