@proxyht seems like new version released today added support for loading sentenncepiece model. Details in this PR https://github.com/huggingface/tokenizers/pull/292 103 Haven’t tested myself yet. Plan to test in a week or so. Let me know how it goes if you test before.