Thanks @ptrblck, I will try it right away. Besides that do you know any other technique to avoid having one FC layer with a lot of output neurons (ie: num_classes = 20k)?
Initially I was thinking on returning a pair of numbers that would somehow map to the class I needed to classify but I didn’t tried that yet. (Like changing the problem to a regression problem).