Updated sdk version for HF

Merge branch 'master'

Updated gradio version to resolve issues with HFSpaces, changed tokenization type.

Merge branch 'master'

Merge pull request #11 from PavelNikolaichev/feature/presidio

Removed hashes because they might be a problem.

Freezed requirements to prevent any possible migration issues.

Cleaned up the codebase, added tests for presidio functionality, changed requirements.txt to get rid of llm-guard package completely.

Added output of each step, so the difference would be visible.

Refactored deanonymize logic, added custom entities and tags for them.

Merge branch 'main' of https://github.com/PavelNikolaichev/LLMGuard

Merge pull request #10 from PavelNikolaichev/feature/presidio

Utilized regex instead of deanonymize due to its constraints.

Merge pull request #9 from PavelNikolaichev/feature/presidio

temporary disabled output deanonymization

[WIP] Migrated to presidio anonymizer.

Merge pull request #8 from shanghai-rits/master

Merge branch 'PavelNikolaichev:master' into master

Merge pull request #7 from PavelNikolaichev/feature/hugging-face

Changed readme

Merge branch 'feature/hugging-face' of https://github.com/PavelNikolaichev/LLMGuard into feature/hugging-face

Fixed issue with github actions, enabled Deanonymizer scanner back.

Merge pull request #6 from shanghai-rits/feature/hugging-face

Merge pull request #1 from PavelNikolaichev/feature/hugging-face

A little changes to the test

Improved regexes, changed tests to test masking structure as well, added support for several entries at once.

Implemented vault for regex patterns. Changed regex to be more percise, etc.

feat: id changes

[WIP] switched to llama-cpp, trying to get RegEx into AnonymizerScanner

Migrated to llama-cpp for better performance.

Added different masked tag for each scanner.

Small changes for Transformers, added quanto for quantization

Selected proper model to fit into CPU bounds.

Commented torch.compile step just in case

Added `pre-requirements.txt`

Added concrete package versions

Updated README.md, changed requirements to include newer LLMGuard

Merge pull request #4 from PavelNikolaichev/main

Merge pull request #3 from PavelNikolaichev/main

HuggingFace should be working so far

Added transformers lib support.

Added readme.MD

initial commit

[WIP] HuggingFace support.

[WIP] HuggingFace support.

Merge pull request #2 from PavelNikolaichev/feature/ollama

Added working Ollama

Merge pull request #1 from PavelNikolaichev/feature/id-scanner

Implemented ID scanner

Thought $default-branch is a real constant in Github.