Why did you convert to float16 and not bfloat16?

by PhilipMay - opened May 8, 2024

May 8, 2024

Hi,

is there a special reason why you store this model as float16 and not bfloat16?
Since the base model is in bfloat16...

Many thanks
Philip

Owner May 8, 2024

Hi Philip, no particular reason for FP16

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment