Hey guys,
I have a simple, linear autoencoder of the following shapes:
128**3 -> 512 -> 128*3
so
model = [nn.Linear(1283, 512, bias=False), nn.Linear(512,1283, bias= False)]
my_ae = nn.Sequenial(*model).to(‘cuda’)
which I would like to train with L2 loss. Problem is, I don;t have enough memory to declare my model in
such a way.
Is there any good way to approach this problem? Train it somehow in batches?