Hi @ptrblk Thanks for the reply
Without using pre-trained model and by removing the loss function and by using the hook functions on the layers, embeddings can be extracted of shape 512.
But with pre-trained model can’t we extract the MLP embeddings??