<p>You better use diffusion, not GAN. Style transfer isn't enough. You need to re-render the entire landscape to animate like TikTok. Use img2img from this repo.</p>
<pre><code>https://github.com/AUTOMATIC1111/stable-diffusion-webui
</code></pre>
<p>If you want a light-weighted model, use this. But you have to manually fine-tune the model into the anime style. I do not recommend using this unless you have a solid ML background</p>
<pre><code>https://huggingface.co/OFA-Sys/small-stable-diffusion-v0
</code></pre>
<p>For the dataset, use the Danbooru dataset.
Either from here or a small version is available in Hugging Face or use Grabber</p>
<pre><code>https://gwern.net/danbooru2021#danbooru2020
https://huggingface.co/datasets/tensorcat/Danbooru-2020-Small
https://github.com/Bionus/imgbrd-grabber
</code></pre>

CC BY-SA 4.0
2023-03-08T03:13:22.307Z
2024-03-04T05:28:05.417Z
2024-03-04T05:28:05.417Z
Jang
<p>I have a task to build the Tiktok Manga/Anime AI model or the Anime AI model like Snap Edit application.</p>
<p>I have researched and collected several models on Github, but they still are not good enough, like Tiktok or SnapEdit.
These are some models on GitHub:</p>
<ul>
<li><a href="https://github.com/TalkUHulk/realworld-stylegan2-encoder" rel="nofollow noreferrer">https://github.com/TalkUHulk/realworld-stylegan2-encoder</a></li>
<li><a href="https://github.com/williamyang1991/DualStyleGAN" rel="nofollow noreferrer">https://github.com/williamyang1991/DualStyleGAN</a></li>
</ul>
<p>These models focus on only the face without a background which does not cartoonize the whole image like SnapEdit.
This is an example:</p>
<p><a href="https://i.sstatic.net/4oY1b.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/4oY1b.jpg" alt="enter image description here" /></a>
<a href="https://i.sstatic.net/HJOUl.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/HJOUl.jpg" alt="enter image description here" /></a></p>
<p>So could you give me some direction to start with this task?</p>
<p><strong>My idea</strong>: I have plan to do following steps, but I belive that it is so tough and take time.</p>
<ul>
<li>Detect each object on the images.</li>
<li>Replace each object with a similar anime/manga style image -&gt; Need to compare all images.</li>
<li>Put anime objects back into the image and make them fit with the image.</li>
<li>Find a similar anime background and replace it too.</li>
</ul>
<p>It would lead to a problem about how to build the database with anime style? How to find a similar anime/cartoon image? How to get objects and replace them without blur or weird images?</p>
<p>Thank you for helping!</p>

<ai-design><image-generation>
Rebuild Tiktok Manga/Anime AI model
Truong Hoang
# Rebuild Tiktok Manga/Anime AI model

(Asked by: username_0 on 2023-01-09)

I have a task to build the Tiktok Manga/Anime AI model or the Anime AI model like Snap Edit application.

I have researched and collected several models on Github, but they still are not good enough, like Tiktok or SnapEdit.
These are some models on GitHub:

* <https://github.com/TalkUHulk/realworld-stylegan2-encoder>
* <https://github.com/williamyang1991/DualStyleGAN>

These models focus on only the face without a background which does not cartoonize the whole image like SnapEdit.
This is an example:

[![enter image description here](https://i.sstatic.net/4oY1b.jpg)](https://i.sstatic.net/4oY1b.jpg)
[![enter image description here](https://i.sstatic.net/HJOUl.jpg)](https://i.sstatic.net/HJOUl.jpg)

So could you give me some direction to start with this task?

**My idea**: I have plan to do following steps, but I belive that it is so tough and take time.

* Detect each object on the images.
* Replace each object with a similar anime/manga style image -> Need to compare all images.
* Put anime objects back into the image and make them fit with the image.
* Find a similar anime background and replace it too.

It would lead to a problem about how to build the database with anime style? How to find a similar anime/cartoon image? How to get objects and replace them without blur or weird images?

Thank you for helping!

**Tags:** ai-design, image-generation


---

## 1 answers

### Answer by username_1 on 2023-03-08. Score: 2 | Accepted answer

You better use diffusion, not GAN. Style transfer isn't enough. You need to re-render the entire landscape to animate like TikTok. Use img2img from this repo.
https://github.com/AUTOMATIC1111/stable-diffusion-webui

If you want a light-weighted model, use this. But you have to manually fine-tune the model into the anime style. I do not recommend using this unless you have a solid ML background
https://huggingface.co/OFA-Sys/small-stable-diffusion-v0

For the dataset, use the Danbooru dataset.
Either from here or a small version is available in Hugging Face or use Grabber
https://gwern.net/danbooru2021#danbooru2020
https://huggingface.co/datasets/tensorcat/Danbooru-2020-Small
https://github.com/Bionus/imgbrd-grabber


---

