Allow tokenization of sequences > 512 for caching
For many applications requiring randomized data access, it's easier to cache the tokenized representations than the words. So why not turn this into a warning?
OK, done. Thanks!<|||||>Nice, thanks @CatalinVoss (and @rodgzilla)!