Open Source, Llamaindex, Gpt 4, Llm, OpenAI.
creating an Index (RAG) pipeline We need to host the model on HF Inference endpoint using Nvidia A100 GPU, 80 GB RAM. from llama_index.llms import HuggingFaceInferenceAPI import os HF_TOKEN = "YOUR HF TOKEN" HF_ENDPOINT_URL = "HF END POINT URL" prometheus_llm = HuggingFaceInferenceAPI(