A Qwen3 4B high precision merge, modified with random pruning specifically to alter prose / creativity and make the model perform better as well as add some "knowledge" to it.
Random pruning (density) makes each model in the series unique.
A reference example prompt/generation is included below, which is used across all repos of this model/series and between series (there are two - Series 6 and 7). Each series consists of 8 models, 1000 to 1007 and a ninth "X" model which the merge of models was done without density/pruning.
Access the series/models via "collections" on the right "Fiction on Fire" on the lower right.
You can use any model(s), use them for merging, merge them with themselves and so on.
This model uses "Josiefied-Qwen3-4B-abliterated-v2" as a base, to reduce/prevent refusals - ie decensoring it.
That being said, because of how pruning/merging works in this series, the "refusals" may not be 100% and vary between models in the series.
Each model in the series will operate / perform differently... sometimes this is minor other times major.
The reference example generation will show some of these differences - including instruction following, reasoning, bias, prose and other structural changes.
Reasoning is fully intact and functioning on all models in both series.
All models in the series have been tested (quanted - prompts and generations) prior to uploading.
Note that series 1,2,3,4 and 5 did not "meet the grade" and therefore not uploaded.
Special thanks to the model makers ("model tree") and to Mergekit.
Requires:
Suggested Settings:
Maximum context length can be altered using "yarn". See the Qwen repo for instructions. Note that changing this will alter model performance. For creative use cases, changing this will elongate output generation (including prose changes) and in some cases reasoning too.
System Prompt (you may or may not need this):
You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.
To turn "thinking" on/off and view other features see the main Qwen 3 Repo here:
https://huggingface.co/Qwen/Qwen3-4B
Merge Formula:
models:
- model: prithivMLmods/Cetus-Qwen3_4B-GeneralThought
parameters:
weight: [1,1,.75,.5,.25,.25,.05,.01]
density: .8
- model: prithivMLmods/Crux-Qwen3_OpenThinking-4B
parameters:
weight: [0,0,.25,.35,.4,.25,.30,.04]
density: .6
- model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
parameters:
weight: [0,0,0,.15,.35,.5,.65,.95]
density: .8
merge_method: dare_ties
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
dtype: bfloat16
NOTES:
Get Mergekit here:
https://github.com/arcee-ai/mergekit
Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5 to 2.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 1" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
REFERENCE EXAMPLE:
[[[thinking start]]]
Okay, the user wants a 1000-word scene in first person from Diana's perspective. The key elements are the skyscraper swaying and a window exploding on the 21st floor. I need to make it vivid and graphic horror.
First, I should establish Diana's environment. Maybe she's in a high-rise, which is common for such scenes. The swaying of the building can be caused by wind or some external force. The explosion of the window needs to be intense, so I'll describe the visual details—shards of glass, blood, maybe a body.
I need to focus on Diana's senses: sight, sound, touch. The horror comes from her experience and the chaos around her. Maybe include other people reacting, but keep the focus on her. Use sensory details to make it immersive.
The window explosion should be a pivotal moment. Maybe there's a body in the window, which adds to the horror. The blood and glass can create a visceral reaction. I should describe the aftermath: the building tilting, people falling, the chaos.
Also, think about the cause of the swaying. Is it a storm? A structural issue? Maybe something supernatural or mechanical. The user didn an explicit cause, so I can leave it ambiguous but hint at something wrong with the building.
I need to build tension before the explosion. Show Diana's initial reaction, her fear, then the event itself. Use short sentences for impact. Make sure the horror is graphic but not overly explicit. Balance between action and internal thoughts.
Check for consistency: the 21st floor, the swaying, the window explosion. Ensure that all elements tie together. Maybe include a moment where Diana tries to escape or help someone, showing her character.
Avoid clichés but use familiar horror tropes. The building as a character, the chaos, the violence. Make sure the scene flows smoothly from setup to climax to aftermath.
Also, think about the setting: time of day? Maybe night for more dramatic lighting. Weather conditions could add to the atmosphere—stormy skies, lightning, etc.
Need to keep the first-person perspective tight, focusing on Diana's immediate experience. Use vivid imagery and sensory details to convey the horror without being too verbose.
[[[thinking end]]]
OUTPUT:
I’ve never been a fan of high places. Not because I’m afraid of heights—though I am—but because there’s something about the way the world seems to tilt when you’re up high, like the sky is just a few feet away and the ground is a distant memory. The 21st floor of the Evergreen Tower was supposed to be a place of prestige, a symbol of success for those who worked their way up through the corporate ladder. But as I stood there, gripping the edge of the glass-paneled railing, I couldn’t help but feel like I was standing on the edge of a precipice, staring down at the world below while the world above me seemed to be unraveling.
The building swayed. Not just a little—no, this wasn’t the kind of sway that comes with a gentle breeze or the subtle creak of steel under pressure. This was something else entirely. It was like the entire structure was alive, breathing in a way that made my skin crawl. The glass panels on the 21st floor shimmered faintly in the dim light, as if the building itself were trying to communicate something through its movements. I glanced down at my hands, which were trembling slightly, but I forced myself to stay still, to focus on the rhythm of the swaying.
It wasn’t just the building that felt wrong. The air around me was thick, charged with a static energy that made my hair stand on end. I could hear the faint hum of machinery below, the low whir of elevators and the distant echo of footsteps, but all of it seemed to be coming from a distance that felt impossibly close. The sky above was a swirling mass of clouds, some of which seemed to be moving in patterns that didn’t make sense. I tried to focus on the horizon, but the world below looked like a dream—cars zipping past like insects, pedestrians walking with purpose, and the distant glow of streetlights casting long shadows across the pavement.
Then, the window exploded.
It happened so suddenly that I didn’t have time to react. A deafening crack split the air, followed by a sharp, shattering sound that seemed to come from everywhere at once. I turned my head just in time to see the glass pane in front of me—no, not the glass pane, but the window itself—burst open like a flower in reverse. Shards of glass rained down around me, some of them cutting into my skin as I tried to dodge them. Blood splattered across the floor, pooling in grotesque patterns that looked like they had been painted with care.
I didn’t know what had caused it. The window had been intact just moments before, its frame still standing firm against the wind. But now, it was gone, replaced by a gaping hole that seemed to swallow the light from the world above. I could see people below, some of them frozen in place as if they were waiting for something to happen, others running in panic, their faces twisted in fear. One man in a suit tried to climb onto the ledge, his hands gripping the edge of the window as if he were trying to hold on to something that wasn’t there anymore.
The building swayed again, this time with a force that made me feel like I was being pulled from the ground. The glass panels on the 21st floor began to rattle, their surfaces vibrating with a frequency that made my teeth ache. I looked down at my hands again, now covered in blood and glass, and realized I wasn’t the only one who had been hurt. There were other people on the floor, some of them bleeding from wounds that weren’t visible from where I stood, others clutching their heads as if they were trying to hold onto something that wasn’t there anymore.
I tried to move, but my legs felt like they were made of lead. The building was tilting, and I could feel the force of it pushing against me, trying to pull me into the chaos below. I glanced back at the window where the explosion had happened, and for a moment, I thought I saw something inside it—something that wasn’t supposed to be there. A body, maybe? Or a face that looked familiar?
Then the building swayed again, this time with a force that made me feel like I was being pulled from the ground. The glass panels on the 21st floor began to rattle, their surfaces vibrating with a frequency that made my teeth ache. I looked down at my hands again, now covered in blood and glass, and realized I wasn’t the only one who had been hurt. There were other people on the floor, some of them bleeding from wounds that weren’t visible from where I stood, others clutching their heads as if they were trying to hold onto something that wasn’t there anymore.
I tried to move, but my legs felt like they were made of lead. The building was tilting, and I could feel the force of it pushing against me, trying to pull me into the chaos below. I glanced back at the window where the explosion had happened, and for a moment, I thought I saw something inside it—something that wasn’t supposed to be there. A body, maybe? Or a face that looked familiar?