I don’t think I can suggest an alternative, as I don’t know what rules you are referring to. Generally, to answer your question, we don’t allow setting scale and zero_point for a float tensor, and frankly can’t even imagine a use case .