Thanks alot for your support, so seems like i screwed the whole thing,
First, i didn’t set batch size anywhere.
Second, i took the model from a book i was following, i now adjusted the strides to 1 that has passed the error but got me the below error in the Linear layer
RuntimeError: size mismatch, m1: [64 x 4], m2: [64 x 512] at c:\a\w\1\s\windows\pytorch\aten\src\th\generic/THTensorMath.cpp:940

The 12 represent the number of features, i have more features to add. the 25 represent the number of time steps in a time series, i can add more also.
For the model i just used a model from a book i was following in Reinforcement Learning.
so i am still confused, for a batch size of 1, should the input shape is the number of features or the timesteps ? as far as i understand from the blog i added earlier its the timesteps
Also, where should i set the batch size, in the shape of the input ?