We had a thread at:

  

      github.com/keras-team/keras
  

  
    
  
	  
  

  
    
      how to use TextVectorization to vectorize Chinese text  1
    

    
      
        opened 
        
          
        
        Sep 25, 2020
      
      


      
        
          
          baiziyuandyufei
        
      
    

    
        
          type:support
        
    
  


  
    In Chinese text, there is no whitespace between words, so when I use TextVectori…zation.adapt(train_dataset), I can only get Sentence-level vocabulary.  the code I used is [https://keras.io/examples/nlp/text_classification_from_scratch/](https://keras.io/examples/nlp/text_classification_from_scratch/)