Given a neural network, with 10 neurons in the input layer, 3 in the hidden and 1 in the output layer, is there a way to prepend a layer to the input layer?
For instance, I have a dataset of five 2D tensors (3x10) with one label value (for instance, the task is regression) for each.
I want to create a 1D tensor (dimension size=10) and then pass this to the input layer with 10 neurons. In order to create a 1D tensor, each row in a 2D tensor is multiplied by a value in weight tensor of size 3. This creates three weighted tensors which are finally added to create a final 1d tensor of size 10, then fed to the input layer.
My question is how to prepend this weight tensor and make sure the values are updated.
Thanks!