Open Source, Llamaindex, Gpt 4, Llm, OpenAI.
refine_template=prometheus_relevancy_refine_prompt_template, ) # Set the encoding model to `gpt-4` for token counting. token_counter = TokenCountingHandler( tokenizer=tiktoken.encoding_for_model("gpt-4").encode ) callback_manager = CallbackManager([token_counter]) # Provide GPT-4 model in