The bias might usually help training your model. In some cases it can be dropped (e.g. DCGAN 10).
Usually the bias takes very little memory compared to your weights. Are you sure you’ll same that much by removing it?