&gt; A mobile device can execute a pretrained model fine.<p>Of course it can. The problem is with the <i>size</i> of the network you might want to run.<p>From your first link, which is about single character level image processing<p>&gt; We needed to develop a very small neural net, and put severe limits on how much we tried to teach it—in essence, put an upper bound on the density of information it handles.<p>And from the voice training paper:<p>&gt; While our server-based model has 50M parameters (k = 4,
nh = 2560, ni = 26 and no = 7969), to reduce the memory
and computation requirement for the embedded model, we experimented
with a variety of sizes and chose k = 6, nh = 512,
ni = 16 and no = 2000, or 2.7M parameters<p>AlexNet is, what, 60M+? VGG is pretty big too.<p>I guess I wasn&#x27;t too clear. Yes, there are good results from nets that we can run on mobile devices in realtime. We do, however, want to run significantly larger nets.