Hi,
Unfortunately, I didn’t solve it. One of the issues that bothered me is that fusing Conv-Bn-Act is not possible with Relu6 as of now so I had to implement it myself, and I’m unsure if it worked right.
The best I managed to do is get about a 5% drop in accuracy (75% to 70%), and I eventually stopped trying.