What do you mean with balanced data?
What I am currently doing is, that I have a ‘classification’ ConvLayer at the end producing one output for each grid cell. My loss function is squared eukledian distance between these grid cells. Haven’t tried it out yet, but I’m gonna update if the network is trained.
EDIT
What kind of loss function would you use for the classification?