Since you were training the autoencoder with both heads, did you check the accuracy of the classifier of the autoencoder? The classifier head should perform a similar task as the LGBM model, so comparing their accuracy might be interesting.