Is there any guide for hybrid-quant for qat, mix int8 and int4 when training.
It would be better for use int8 in first and last layer, and use int4 in the inner layer.
first layer with int8 may prevent source data to be losted.
last layer with int8 may help some other process after inference (like video output, other accelerator).