Those interested in optimal neural network compression might consider the paper &quot;Bitwise Neural Networks&quot; by Kim and Smaragdis <a href="http:&#x2F;&#x2F;paris.cs.illinois.edu&#x2F;pubs&#x2F;minje-icmlw2015.pdf" rel="nofollow">http:&#x2F;&#x2F;paris.cs.illinois.edu&#x2F;pubs&#x2F;minje-icmlw2015.pdf</a> which enables much better compression than simple quantization and pruning.