fastapi==0.99.1
uvicorn
requests
pydantic==1.10.12
torch
transformers
llama-cpp-python