Machine Learning, Transformers, Data Science, Python, Hugging Face.
AutoModelForCausalLM, AutoTokenizer, GPTQConfig import torch # Set the model to load hf_model_repo='edumunozsala/llama-2-7b-int4-python-code-20k' # Load the tokenizer tokenizer = AutoTokenizer.from_pretrained(hf_model_repo, use_fast=True) # Set quantization configuration quantization_config =