Hi Log!



 logarith:

do I have to normalize them before passing them to the network,
or can I input tensors consisting of ones and zeros?


Passing in the “raw” tensors should be fine.  Being ones and zeros,
they are already close to being normalized.  Changing them to, say,
-1 and 1 so (if they were fifty-fifty) they would have a mean of 0 and
a standard deviation of 1 wouldn’t affect things much.  (Try it both
ways – I doubt you’ll see any difference.)
(In contrast, think about a 16-bit grayscale image as input to a
network.  The pixel values run from zero to about 65,000, so they
can be rather large.  Normalizing the pixel values so that they are
of order one makes like easier for the network.)
Best.
K. Frank