Indeed, there’s a typo.
A simpler fully convolutional network will also eventually “converge” to nan, albeit more slowly (a few epochs).
I was using a similar setup with theano with decent results, so I think my data is ok, but I’m not sure how to troubleshoot.
I was using the Adam optimizer, but I’ll try with SGD and a small learning rate and go from there if the results are promising.