Sounds like an interesting idea. However, I’m trying to predict 512 phases (not 1 as in your case). Do you have any idea on how to do this? I could just increase my vector output to 1024, so it’s like (sin(φ1), cos(φ1), sin(φ2), cos(φ2), … , sin(φn), cos(φn)) for n = 1 to 512. Another think that is important is, that on my problem the output phases I get after I generate data have values of 128 levels from 0 to 2pi (reason doesn’t really matter). So, it’s not actually continuous values in a sense that they could be any value in the range of 0 to 2*pi.
EDIT: The second idea I have, is doing multi-output classification. So, instead of having only one full connected fork at the end, I can have 512. And each fork would have 128 classes with a sigmoid as an activation function.