ptrblck:

batch_first=True


Thanks for the help after checking the size I realized it was an issue with my dataset.  Below is the line of code that I changed in case that helps anyone.  I did have to do a little math to get the dimensions to line up.
x_batch = x_batch.reshape(batch_size,  1, input_dim).to(device)