Hm. No, I didn’t add my own model and it would be quite a bummer if that would not work. Is the model you’re trying to use available somewhere? Then I could drop it into my version.
I didn’t have to change the caffe2 source, so that could probably be something where things went wrong for you. How did you try to compile? I put my procedure in the README.md of my AICamera fork.
That said, I cannot understand the outrage from the difference between having bias in the convolution layer vs. adding it separately. Yes, performance wants fused kernels, but hey, for a toy app…
But thanks for the advertisement for how doing this with only PyTorch is much easier. 
Best regards
Thomas