transformers
gradio
torch
accelerate
bitsandbytes
huggingface_hub
gguf