ubaitur5 commited on
Commit
811b2e3
·
verified ·
1 Parent(s): 9022a71

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +107 -0
README.md ADDED
@@ -0,0 +1,107 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ thumbnail: https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b/resolve/main/resources/pe24.png
3
+ license: apache-2.0
4
+ tags:
5
+ - general-purpose
6
+ - roleplay
7
+ - storywriting
8
+ - chemistry
9
+ - biology
10
+ - code
11
+ - climate
12
+ - axolotl
13
+ - text-generation-inference
14
+ - finetune
15
+ - mlx
16
+ - mlx-my-repo
17
+ datasets:
18
+ - PocketDoc/Dans-MemoryCore-CoreCurriculum-Small
19
+ - AquaV/US-Army-Survival-Sharegpt
20
+ - AquaV/Multi-Environment-Operations-Sharegpt
21
+ - AquaV/Resistance-Sharegpt
22
+ - AquaV/Interrogation-Sharegpt
23
+ - AquaV/Chemical-Biological-Safety-Applications-Sharegpt
24
+ - AquaV/Energetic-Materials-Sharegpt
25
+ - PocketDoc/Dans-Mathmaxx
26
+ - PocketDoc/Dans-Mathmaxx-Numina-CoT
27
+ - PJMixers/Math-Multiturn-1K-ShareGPT
28
+ - PocketDoc/Dans-Benchmaxx-COT
29
+ - PocketDoc/Dans-Codemaxx-LeetCode
30
+ - PocketDoc/Dans-Codemaxx-CodeFeedback-Conversations
31
+ - PocketDoc/Dans-Codemaxx-CodeFeedback-SingleTurn
32
+ - PocketDoc/Dans-Codemaxx-Bigcode-SelfInstruct
33
+ - PocketDoc/Dans-Taskmaxx
34
+ - PocketDoc/Dans-Taskmaxx-DataPrepper
35
+ - PocketDoc/Dans-Taskmaxx-ConcurrentQA-Reworked
36
+ - PocketDoc/Dans-Taskmaxx-TableGPT
37
+ - PocketDoc/Dans-Taskmaxx-SciRIFF
38
+ - PocketDoc/Dans-Taskmaxx-Edit
39
+ - PocketDoc/Dans-Toolmaxx-Agent
40
+ - PocketDoc/Dans-Toolmaxx-ShellCommands
41
+ - PocketDoc/Dans-Toolmaxx-Functions-Toolbench
42
+ - PocketDoc/Dans-Toolmaxx-Functions-ToolACE
43
+ - PocketDoc/Dans-ASCIIMaxx-Wordart
44
+ - PocketDoc/Dans-Prosemaxx-Gutenberg
45
+ - PocketDoc/Dans-Prosemaxx-Cowriter-3-XL
46
+ - PocketDoc/Dans-Prosemaxx-Adventure
47
+ - PocketDoc/Dans-Failuremaxx-Adventure-3
48
+ - PocketDoc/Dans-Prosemaxx-InstructWriter-ZeroShot-2
49
+ - PocketDoc/Dans-Prosemaxx-InstructWriter-Continue-2
50
+ - PocketDoc/Dans-Assistantmaxx-Sharegpt
51
+ - PocketDoc/Dans-Assistantmaxx-OpenAssistant2
52
+ - PocketDoc/Dans-Assistantmaxx-Opus-Merge
53
+ - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset
54
+ - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset-2
55
+ - PocketDoc/Dans-Assistantmaxx-NoRobots
56
+ - PocketDoc/Dans-Assistantmaxx-Synthia
57
+ - PocketDoc/Dans-Assistantmaxx-ASL
58
+ - PocketDoc/Dans-Assistantmaxx-PersonaLLM-Opus
59
+ - PocketDoc/Dans-Assistantmaxx-UnnaturalInstructions-GPT4
60
+ - PocketDoc/Dans-Assistantmaxx-LongAlign
61
+ - PocketDoc/Dans-Assistantmaxx-EvolKit
62
+ - PocketDoc/Dans-Assistantmaxx-Camel-GPT4
63
+ - PocketDoc/Dans-Assistantmaxx-OpenLeecher-Instruct
64
+ - PocketDoc/Dans-Assistantmaxx-Tulu3-IF
65
+ - PocketDoc/Dans-Systemmaxx
66
+ - PocketDoc/Dans-Logicmaxx-Skunkworks
67
+ - PocketDoc/Dans-Logicmaxx-FI-VeriMed
68
+ - PocketDoc/Dans-Logicmaxx-SAT-AP
69
+ - PocketDoc/Dans-Logicmaxx-Magpie-Ultra
70
+ - PJMixers/grimulkan_theory-of-mind-ShareGPT
71
+ - PJMixers/grimulkan_physical-reasoning-ShareGPT
72
+ - PocketDoc/Dans-Personamaxx
73
+ - PocketDoc/Dans-Personamaxx-Rainy
74
+ - PocketDoc/Dans-Personamaxx-C1
75
+ - PocketDoc/Dans-Personamaxx-VN
76
+ language:
77
+ - en
78
+ base_model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
79
+ pipeline_tag: text-generation
80
+ library_name: transformers
81
+ ---
82
+
83
+ # ubaitur5/Dans-PersonalityEngine-V1.2.0-24b-mlx-4Bit
84
+
85
+ The Model [ubaitur5/Dans-PersonalityEngine-V1.2.0-24b-mlx-4Bit](https://huggingface.co/ubaitur5/Dans-PersonalityEngine-V1.2.0-24b-mlx-4Bit) was converted to MLX format from [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b) using mlx-lm version **0.22.1**.
86
+
87
+ ## Use with mlx
88
+
89
+ ```bash
90
+ pip install mlx-lm
91
+ ```
92
+
93
+ ```python
94
+ from mlx_lm import load, generate
95
+
96
+ model, tokenizer = load("ubaitur5/Dans-PersonalityEngine-V1.2.0-24b-mlx-4Bit")
97
+
98
+ prompt="hello"
99
+
100
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
101
+ messages = [{"role": "user", "content": prompt}]
102
+ prompt = tokenizer.apply_chat_template(
103
+ messages, tokenize=False, add_generation_prompt=True
104
+ )
105
+
106
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
107
+ ```