@eqy Thank you so much for your reply.
I’m a noob so I could use some more explanation.
The data is audio frames. Each frame has 13 features. The goal is to input 128 of those frames each time and end up with a linear classifier to classify each frame  with one of the 51 classes. I hope that makes sense