Ideally I want both Tensor and str to be input. It’s possible I’m designing it poorly though.
I have noticed some examples returning (input, label), which I think is what you’re referring to. For now, I’ve changed the Dataset to return (Tensor input, scalar label), and am trying to get it to work. Although I’d still like to add the str as additional input as it should help a lot with classification.
To explain the problem a bit, the Tensor input is the STFT of an audio stream and the str is the text of what is spoken in the audio stream. My initial goal is to learn what the spoken version of the text sounds like to be able to classify audio streams without knowing the text. I think that should be better than training on the audio alone, but I’m happy to be shown I’m wrong.