A Qwen3 4B high precision merge, modified with random pruning specifically to alter prose / creativity and make the model perform better as well as add some "knowledge" to it.
Random pruning (density) makes each model in the series unique.
A reference example prompt/generation is included below, which is used across all repos of this model/series and between series (there are two - Series 6 and 7). Each series consists of 8 models, 1000 to 1007 and a ninth "X" model which the merge of models was done without density/pruning.
Access the series/models via "collections" on the right "Fiction on Fire" on the lower right.
You can use any model(s), use them for merging, merge them with themselves and so on.
This model uses "Josiefied-Qwen3-4B-abliterated-v2" as a base, to reduce/prevent refusals - ie decensoring it.
That being said, because of how pruning/merging works in this series, the "refusals" may not be 100% and vary between models in the series.
Each model in the series will operate / perform differently... sometimes this is minor other times major.
The reference example generation will show some of these differences - including instruction following, reasoning, bias, prose and other structural changes.
Reasoning is fully intact and functioning on all models in both series.
All models in the series have been tested (quanted - prompts and generations) prior to uploading.
Note that series 1,2,3,4 and 5 did not "meet the grade" and therefore not uploaded.
Special thanks to the model makers ("model tree") and to Mergekit.
Requires:
Suggested Settings:
Maximum context length can be altered using "yarn". See the Qwen repo for instructions. Note that changing this will alter model performance. For creative use cases, changing this will elongate output generation (including prose changes) and in some cases reasoning too.
System Prompt (you may or may not need this):
You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.
To turn "thinking" on/off and view other features see the main Qwen 3 Repo here:
https://huggingface.co/Qwen/Qwen3-4B
Merge Formula:
models:
- model: prithivMLmods/Cetus-Qwen3_4B-GeneralThought
parameters:
weight: [1,1,.75,.5,.25,.25,.05,.01]
density: .8
- model: prithivMLmods/Crux-Qwen3_OpenThinking-4B
parameters:
weight: [0,0,.25,.35,.4,.25,.30,.04]
density: .6
- model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
parameters:
weight: [0,0,0,.15,.35,.5,.65,.95]
density: .8
merge_method: dare_ties
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
dtype: bfloat16
NOTES:
Get Mergekit here:
https://github.com/arcee-ai/mergekit
Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5 to 2.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 1" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
REFERENCE EXAMPLE:
[[[thinking start]]]
Okay, the user wants me to start a 1000-word scene in first person from the perspective of Diana. The scene needs to be vivid and graphic horror, focusing on the skyscraper swaying and a window exploding on the 21st floor. Let me think about how to approach this.
First, I need to establish the setting. A skyscraper is a tall building, so maybe it's in a city with some kind of supernatural or apocalyptic element. The swaying suggests something is wrong with the building, maybe an earthquake, a structural failure, or something more supernatural like a curse or a magical entity.
The window exploding is a key event. I need to make it graphic and horrifying. Maybe the window isn1t just breaking but something more sinister happens, like a supernatural force causing it. The first-person perspective means I have to convey Diana's emotions, fears, and sensory experiences.
I should start with the initial signs of something wrong. Maybe the building starts to sway, which is unusual. Then build up tension as the situation worsens. The window explosion needs to be a turning point, leading to more horror elements. Perhaps there's a supernatural entity involved, or maybe it's a result of some kind of experiment gone wrong.
I need to make sure the scene is vivid. Use sensory details: sounds, sights, smells. Maybe describe the physical sensations of fear, the adrenaline rush, the panic. Also, include internal thoughts and feelings to show Diana's state of mind.
Wait, the user mentioned "graphic horror," so I should be explicit about the violence and the terrifying events. The window explosion could lead to a fall, or maybe something worse. Maybe there's an entity that's causing the building to collapse, and Diana is trying to survive.
I need to avoid clichés but still make it effective. Maybe the skyscraper isn't just a normal building but has some magical properties. The swaying could be a sign of an impending doom, and the window explosion is part of a larger supernatural event.
Also, think about the structure. Start with the initial signs, build up to the window exploding, then the aftermath. Maybe include other characters or just Diana alone? Since it's first person, focusing on her experience is key.
Check for consistency in the horror elements. Make sure the events escalate properly. The scene should be around 1000 words, so I need to plan the length of each part. Start with the setup, then the swaying, the window explosion, the aftermath, and maybe a resolution or continuation of the horror.
Avoid making it too predictable. Maybe the window isn't just breaking but something else happens, like a supernatural force is released. Or the building is a prison for something, and the window is part of that.
Also, consider the tone. It should be intense, with a lot of sensory details to immerse the reader. Use strong verbs and vivid imagery. Make sure the horror is both physical and psychological, showing Diana's fear and the terror of the situation.
I need to make sure that the scene flows smoothly, with each paragraph building on the previous one. Start with the initial signs of something wrong, then escalate to the window explosion, then the consequences, and maybe end with a cliffhanger or a disturbing conclusion.
Check for any plot holes or inconsistencies. Ensure that the supernatural elements are consistent and that the horror is believable within the context of the story. Also, make sure that Diana's perspective is clear and that her emotions are accurately portrayed.
[[[thinking end]]]
OUTPUT:
Title: "The Shifting Skyscraper"
The first thing I noticed was the sway. Not a subtle, imperceptible tremor—no, this was a violent, unrelenting lurch that sent the world spinning like a broken record. I was on the 21st floor of the Aetheria Tower, a monolith of glass and steel that loomed over the city like a god’s eye. But now, it was groaning, its foundations trembling as if some ancient force had awakened beneath the earth. The windows, once pristine and unbroken, began to rattle with a sound like shattering ice. I froze, my breath catching in my throat as the building’s shadow stretched unnaturally across the street below, elongated and jagged, as though the city itself were being pulled into a nightmare.
I’d heard rumors about the Aetheria Tower—stories of its construction, of the strange energy that pulsed through its core, of the whispers that echoed in the empty corridors at night. But I’d dismissed them as urban legends, the kind of myths that cling to the edges of reality like mold on a forgotten wall. I was just a janitor, a lowly worker who had never set foot inside the building’s main floors. My job was to clean the windows, to sweep the stairwells, to make sure the place didn’t become a haven for the kind of madness that turned cities into graveyards. But now, as the tower swayed and the air thickened with an acrid, metallic smell, I realized I’d been living in a lie.
The sway intensified. The glass panels on my floor began to crack, their surfaces rippling like water under pressure. I stumbled back, my hands gripping the edge of the window frame as if it were a lifeline. The world blurred, and for a moment, I thought I saw something—something moving in the shadows between the buildings, a shape that didn’t belong, its form shifting like smoke. My heart pounded, not with fear, but with a primal sense of dread that clawed at my mind. This wasn’t just a building; it was a thing, alive and hungry, and I was standing on its edge.
Then, the window exploded.
It happened so fast I didn’t have time to react. A deafening crack split the air, followed by a sound like a thousand glass shards shattering in unison. The window before me—no, the entire wall of glass that framed my window—began to splinter, its surface bleeding into a swirling vortex of color. I saw it: a figure, or something like one, materializing within the chaos. It was tall, taller than any human, its form shifting between solid and shadow, its eyes glowing with an unnatural light that seemed to consume the very air around it. The glass shattered in a violent spray, and for a moment, I thought I saw my own reflection in the shards—my face twisted in terror, my mouth open in a silent scream.
Then, the building shuddered again, and the world tilted. The floor beneath me vanished, replaced by a swirling void that pulsed with the same dark energy I’d felt earlier. I fell, but not in the way I expected. There was no fall—no gravity, no weight, just a sensation of being pulled, of being unmade by something vast and unknowable. The air burned, hot and suffocating, and I heard voices, distant and distorted, like echoes from another time and place.
When I landed, I was no longer on the 21st floor. I was somewhere else—somewhere inside the building, but not in the way I’d expected. The walls were no longer glass but something else: a shifting, organic material that pulsed with a sickly green light. The air was thick with the scent of ozone and decay, and the floor beneath me was slick with something that looked like blood, but not human blood—it was darker, thicker, and it oozed from the cracks in the walls as if the building itself were alive and bleeding.
I stumbled forward, my legs shaking, my mind racing. The voices were louder now, closer, and they weren’t just whispers—they were calling. "Come," they said, their tones overlapping like a chorus of lost souls. "Join us." I didn’t understand what they meant, but I knew I wasn’t alone anymore. The building was alive, and it was watching me.
The walls began to move. They shifted, their surfaces warping into grotesque shapes—tentacles of shadow that reached for me, their ends dissolving into nothingness. I ran, my feet slipping on the slick floor, my breath coming in ragged gasps. The corridors stretched and twisted, no longer following any logic I could comprehend. One moment, I was running down a hallway lined with mirrors; the next, I was standing in a vast, endless void where the ceiling and floor met in a single line of darkness.
I heard it then—a sound that wasn’t part of the building, but something else, something outside. A low, guttural roar that shook the very air, followed by the sound of glass shattering again, this time from the ground below. The tower was collapsing, and I was trapped inside it, a prisoner in a nightmare that had no end.
I don’t know how long I stood there, staring at the swirling void, but time lost all meaning. The building around me pulsed with a rhythm that matched my own heartbeat, a slow, deliberate beat that sent shivers down my spine. I thought of the people who had been inside this tower before me—workers, executives, tourists—who had never seen the inside of its core. Had they all been drawn here? Had they been taken?
Then, I heard it again. A voice, not in the building, but within me. A whisper that wasn’t a whisper, but a memory. I saw myself standing on the 21st floor, the window shattered, the building swaying, and then—nothing. No end, no beginning. Just the void.
And then, I was back.
I stood on the 21st floor again, but this time, the tower was still. The glass was intact, the air still, and the world around me was silent. But I knew I wasn’t alone. I could feel it in my bones, in the way the air thickened and the shadows stretched longer than they should. The building was alive, and it was watching me.
And I was never going to leave it alone.