Convert clip_l and vae to fp8?

#1
by oddball516 - opened

Can you also come up with a script to convert both clip_l and vae module to fp8? Or is that totally unnecessary?

Since those models are smaller and converting them to fp8 at training time would be fast enough and they download fast enough. VAE being of lower precision might effect the training and output so generally we accept the higher precision and cache there resulting latents for training.

OK, understood.

oddball516 changed discussion status to closed

Sign up or log in to comment