Create Readme

README.md

@@ -0,0 +1,89 @@
+---
+library_name: transformers
+tags:
+- 4bit
+- llama
+- llama-2
+- facebook
+- meta
+- 7b
+- quantized
+- ExLlamaV2
+- quantized
+- exl2
+- 5.0-bpw
+license: llama2
+pipeline_tag: text-generation
+---
+
+# Llama-2-7b-chat-hf-5.0-bpw-exl2
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+This repo contains 4-bit quantized (using ExLlamaV2) model of Meta's meta-llama/Llama-2-7b-chat-hf
+
+## Model Details
+
+- Model creator: [Meta](https://huggingface.co/meta-llama)
+- Original model: [Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf)
+
+
+### About 4 bit quantization using bitsandbytes
+
+
+- ExLlamaV2 github repo: [ExLlamaV2 github repo](https://github.com/turboderp/exllamav2)
+
+
+# How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+## How to run from Python code
+
+#### First install the package
+
+#### Import 
+
+
+#### Use a pipeline as a high-level helper
+
+
+
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]