metadata

license: apache-2.0
tags:
  - general-purpose
  - roleplay
  - storywriting
  - chemistry
  - biology
  - code
  - climate
  - axolotl
  - text-generation-inference
  - finetune
  - mlx
  - mlx-my-repo
datasets:
  - PocketDoc/Dans-MemoryCore-CoreCurriculum-Small
  - AquaV/US-Army-Survival-Sharegpt
  - AquaV/Multi-Environment-Operations-Sharegpt
  - AquaV/Resistance-Sharegpt
  - AquaV/Interrogation-Sharegpt
  - AquaV/Chemical-Biological-Safety-Applications-Sharegpt
  - AquaV/Energetic-Materials-Sharegpt
  - PocketDoc/Dans-Mathmaxx
  - PocketDoc/Dans-Mathmaxx-Numina-CoT
  - PJMixers/Math-Multiturn-1K-ShareGPT
  - PocketDoc/Dans-Benchmaxx-COT
  - PocketDoc/Dans-Codemaxx-LeetCode
  - PocketDoc/Dans-Codemaxx-CodeFeedback-Conversations
  - PocketDoc/Dans-Codemaxx-CodeFeedback-SingleTurn
  - PocketDoc/Dans-Codemaxx-Bigcode-SelfInstruct
  - PocketDoc/Dans-Taskmaxx
  - PocketDoc/Dans-Taskmaxx-DataPrepper
  - PocketDoc/Dans-Taskmaxx-ConcurrentQA-Reworked
  - PocketDoc/Dans-Taskmaxx-TableGPT
  - PocketDoc/Dans-Taskmaxx-SciRIFF
  - PocketDoc/Dans-Taskmaxx-Edit
  - PocketDoc/Dans-Toolmaxx-Agent
  - PocketDoc/Dans-Toolmaxx-ShellCommands
  - PocketDoc/Dans-Toolmaxx-Functions-Toolbench
  - PocketDoc/Dans-Toolmaxx-Functions-ToolACE
  - PocketDoc/Dans-ASCIIMaxx-Wordart
  - PocketDoc/Dans-Prosemaxx-Gutenberg
  - PocketDoc/Dans-Prosemaxx-Cowriter-3-XL
  - PocketDoc/Dans-Prosemaxx-Adventure
  - PocketDoc/Dans-Failuremaxx-Adventure-3
  - PocketDoc/Dans-Prosemaxx-InstructWriter-ZeroShot-2
  - PocketDoc/Dans-Prosemaxx-InstructWriter-Continue-2
  - PocketDoc/Dans-Assistantmaxx-Sharegpt
  - PocketDoc/Dans-Assistantmaxx-OpenAssistant2
  - PocketDoc/Dans-Assistantmaxx-Opus-Merge
  - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset
  - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset-2
  - PocketDoc/Dans-Assistantmaxx-NoRobots
  - PocketDoc/Dans-Assistantmaxx-Synthia
  - PocketDoc/Dans-Assistantmaxx-ASL
  - PocketDoc/Dans-Assistantmaxx-PersonaLLM-Opus
  - PocketDoc/Dans-Assistantmaxx-UnnaturalInstructions-GPT4
  - PocketDoc/Dans-Assistantmaxx-LongAlign
  - PocketDoc/Dans-Assistantmaxx-EvolKit
  - PocketDoc/Dans-Assistantmaxx-Camel-GPT4
  - PocketDoc/Dans-Assistantmaxx-OpenLeecher-Instruct
  - PocketDoc/Dans-Assistantmaxx-Tulu3-IF
  - PocketDoc/Dans-Systemmaxx
  - PocketDoc/Dans-Logicmaxx-Skunkworks
  - PocketDoc/Dans-Logicmaxx-FI-VeriMed
  - PocketDoc/Dans-Logicmaxx-SAT-AP
  - PocketDoc/Dans-Logicmaxx-Magpie-Ultra
  - PJMixers/grimulkan_theory-of-mind-ShareGPT
  - PJMixers/grimulkan_physical-reasoning-ShareGPT
  - PocketDoc/Dans-Personamaxx
  - PocketDoc/Dans-Personamaxx-Rainy
  - PocketDoc/Dans-Personamaxx-C1
  - PocketDoc/Dans-Personamaxx-VN
language:
  - en
base_model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
pipeline_tag: text-generation
library_name: transformers

janboe91/Dans-PersonalityEngine-V1.2.0-24b-Q8-mlx

The Model janboe91/Dans-PersonalityEngine-V1.2.0-24b-Q8-mlx was converted to MLX format from PocketDoc/Dans-PersonalityEngine-V1.2.0-24b using mlx-lm version 0.21.5.

Use with mlx

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("janboe91/Dans-PersonalityEngine-V1.2.0-24b-Q8-mlx")

prompt="hello"

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, tokenize=False, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)