readme: ---
  license: bigscience-bloom-rail-1.0
  ---
  # Tokenizer used for all BLOOM models
  
  Tokenizer information are provided at [https://huggingface.co/bigscience/bloom#preprocessing](https://huggingface.co/bigscience/bloom#preprocessing)
  
  TODO: point to paper once it comes out with extra details on the tokenizer