experiencing empty output if text input is long

#8
by lambdac - opened

The context limit is 16384, as referenced in config.json: ("max_position_embeddings": 16384) but whenever I pass in a long input to the model, it gives out an empty text even though the total tokens don't exceed 16384. What might be the problem?

Sign up or log in to comment