@windweller Adaptive Softmax was part of PyTorch 0.4.1, see: https://pytorch.org/docs/stable/nn.html#torch.nn.AdaptiveLogSoftmaxWithLoss 275
Sampled Softmax is implemented in this repo: https://github.com/rdspring1/PyTorch_GBW_LM 323