File size: 1,224 Bytes
b1be17b
 
 
 
 
df90af9
8e6c647
0e12a94
413b0d8
b1be17b
 
 
 
 
 
 
 
 
b89962e
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
---
license: openrail
library_name: diffusers
---
# EQ-Adapted Noobai11 Unet
Using B3/B4/B5 SDXL EQ VAE from here: https://huggingface.co/Anzhc/MS-LC-EQ-D-VR_VAE

You need Reflect pad in conv layers of VAE to properly use it(otherwise there will be some artefacts on edges), refer to VAE repo for instructions.
If you have trained without this - don't worry, just add modification and do a small tune to fix up artefacts on edges.

This is an EQ adapted unet, that learned to denoise **clean** latent representations, as opposed to noised default SDXL VAE representation.

This **halves** loss in training. Yep.

![image/png](https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/UyUNXKHEKmFgi6ELQ0ymB.png)


In my tests it also improves convergence, and makes model more trainable, or so it seems at the very least.  
Additionally, this alleviates some of the issues of Noob11 base, like overly bright images.

Some more graphs for more technical people:


![image/png](https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/E9oAeYv3Q08S6oADmOHTU.png)



![image/png](https://cdn-uploads.huggingface.co/production/uploads/633b43d29fe04b13f46c8988/yiPdkP53hhksl_HPm_e0D.png)