Hello Thanks for your reply. They refer to quantized bits as per my understanding. [page-4] 7
Currently i have tried this solution [inside utee folder quant file] 2
arr = [11,11,11,11,11,11,11,11,11,11,10,10,9,9,9,9]
count = 0
bit_num = OrderedDict()

for k, v in state_dict.items():
    bit_num[k] = arr[count]    
    count += 1

state_dict_quant = OrderedDict()

#state_dict_quant['features.0.weight'] = quant.log_minmax_quantize(model.features[0].weight, bits=11)

for k, v in state_dict.items():
    print(k,v.type())
    state_dict_quant[k] = quant.log_minmax_quantize(state_dict[k], bits=bit_num[k])

Looks like it is doing the job, though i still have to think how to modify bits for activation, as these are calculated on run time ? . May be “hook” can help.