Text Generation
GGUF
English
mixture of experts
Mixture of Experts
8x3B
Llama 3.2 MOE
128k context
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
mergekit
llama
llama-3
llama-3.2
conversational
May i know if it can run on 16GB macbook AIR m2?
#4
by
SaeedML
- opened
Would there be any issues with throttling or overheating? lags,
What are the minimum requirements to use this model on the local MacBook M2 Air, 16 GB RAM machine?
Suggest using LmStudio ; with quant in the Q4 range.
Limit to 2 experts activated to start. [less load]
Running an LLM/AI on any machine will be taxing; increase cooling / fan if possible.