Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Johnnyman1100
/
EZ-Tokenizer

Token Classification
code
English
programming
tokenizer
code-generation
nlp
machine-learning
Model card Files Files and versions Community
EZ-Tokenizer
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
Johnnyman1100's picture
Johnnyman1100
Update LICENSE
0520651 verified 29 days ago
  • Test_tokenizer
    Upload 38 files about 1 month ago
  • dist
    Upload 38 files about 1 month ago
  • examples
    Upload 38 files about 1 month ago
  • src
    Upload 38 files about 1 month ago
  • tests
    Upload 38 files about 1 month ago
  • .gitattributes
    1.57 kB
    Upload 38 files about 1 month ago
  • .gitignore
    2.6 kB
    Upload 38 files about 1 month ago
  • EZ-Tokenizer.exe
    316 kB
    LFS
    Upload 38 files about 1 month ago
  • INSTALL.md
    2.3 kB
    Upload 38 files about 1 month ago
  • LICENSE
    1.28 kB
    Update LICENSE 29 days ago
  • MANIFEST.in
    454 Bytes
    Upload 38 files about 1 month ago
  • README.md
    2.59 kB
    Update README.md about 1 month ago
  • pyproject.toml
    2.05 kB
    Upload 38 files about 1 month ago
  • requirements-dev.txt
    413 Bytes
    Upload 38 files about 1 month ago
  • requirements.txt
    609 Bytes
    Upload 38 files about 1 month ago
  • run_ez_tokenizer.bat
    8.41 kB
    Upload 38 files about 1 month ago
  • setup.py
    1.37 kB
    Upload 38 files about 1 month ago