Similar to fp16 inference in pytorch framework like [Training With Mixed Precision :: NVIDIA Deep Learning Performance Documentation 2](Training With Mixed Precision :: NVIDIA Deep Learning Performance Documentation 2), is there any framework about fp8 inference in pytorch?
Thank you for your time.