This 4-bit ONNX version of the model is basically unusable.

#12
by limingde - opened

The phi4-mm vision model, after INT4 quantization, is essentially unusable. The output has little to no correlation with the input or the expected vision model output.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment