csc525_retrieval_based_chatbot / requirements.txt
JoeArmani
data processing pipeline
74af405
raw
history blame
1.19 kB
faiss-cpu>=1.7.0 # Required for Facebook AI Similarity Search
h5py>=3.1.0 # For saving and loading models
ipython>=8.0.0 # For interactive Python
loguru>=0.7.0 # Enhanced logging (optional but recommended)
matplotlib>=3.5.0 # For validation plotting
nlpaug>=1.1.0 # Data augmentation for NLP
nltk>=3.6.0 # Natural language toolkit
numpy>=1.19.0 # General numerical computation
pandas>=1.5.0 # For data handling
pyyaml>=6.0.0 # For config management
scikit-learn>=1.0.0 # Machine learning tools
sacremoses>=0.0.53 # Required for some HuggingFace models
sentencepiece>=0.1.99 # Required for HuggingFace transformers
spacy>=3.0.0 # Text processing and tokenization
tensorflow>=2.13.0 # TensorFlow, for deep learning
tensorflow-hub>=0.12.0 # Pretrained model hub for TensorFlow
tokenizers>=0.13.0 # Required for HuggingFace transformers
torch>=2.0.0 # PyTorch, for deep learning
tqdm>=4.64.0 # Progress bar
transformers>=4.30.0 # Hugging Face Transformers library
typing-extensions>=4.0.0 # For better type hints
# Dev dependencies
black>=22.0.0 # For code formatting
isort>=5.10.0 # For import sorting
mypy>=1.0.0 # For type checking
pytest>=7.0.0 # For testing