ziyingchen1106 commited on
Commit
b2cfaf5
·
verified ·
1 Parent(s): a11feb8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -1
README.md CHANGED
@@ -5,4 +5,22 @@ language:
5
  base_model:
6
  - meta-llama/Llama-3.2-3B-Instruct
7
  pipeline_tag: text-generation
8
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  base_model:
6
  - meta-llama/Llama-3.2-3B-Instruct
7
  pipeline_tag: text-generation
8
+ ---
9
+
10
+ ## Usage
11
+ ```
12
+ import torch
13
+ from transformers import AutoTokenizer, AutoModelForCausalLM
14
+
15
+ model_name = "ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-gptqmodel-4bit"
16
+ model = AutoModelForCausalLM.from_pretrained(
17
+ model_name,
18
+ torch_dtype=torch.float16,
19
+ device_map="cuda:0"
20
+ )
21
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
22
+ ```
23
+
24
+ ## Attribution
25
+ - Built with Llama
26
+ - Llama 3.2 Community License © Meta Platforms, Inc.