A Qwen3 4B high precision merge, modified with random pruning specifically to alter prose / creativity and make the model perform better as well as add some "knowledge" to it.
Random pruning (density) makes each model in the series unique.
A reference example prompt/generation is included below, which is used across all repos of this model/series and between series (there are two - Series 6 and 7). Each series consists of 8 models, 1000 to 1007 and a ninth "X" model which the merge of models was done without density/pruning.
Access the series/models via "collections" on the right "Fiction on Fire" on the lower right.
You can use any model(s), use them for merging, merge them with themselves and so on.
This model uses "Josiefied-Qwen3-4B-abliterated-v2" as a base, to reduce/prevent refusals - ie decensoring it.
That being said, because of how pruning/merging works in this series, the "refusals" may not be 100% and vary between models in the series.
Each model in the series will operate / perform differently... sometimes this is minor other times major.
The reference example generation will show some of these differences - including instruction following, reasoning, bias, prose and other structural changes.
Reasoning is fully intact and functioning on all models in both series.
All models in the series have been tested (quanted - prompts and generations) prior to uploading.
Note that series 1,2,3,4 and 5 did not "meet the grade" and therefore not uploaded.
Special thanks to the model makers ("model tree") and to Mergekit.
Requires:
Suggested Settings:
Maximum context length can be altered using "yarn". See the Qwen repo for instructions. Note that changing this will alter model performance. For creative use cases, changing this will elongate output generation (including prose changes) and in some cases reasoning too.
System Prompt (you may or may not need this):
You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.
To turn "thinking" on/off and view other features see the main Qwen 3 Repo here:
https://huggingface.co/Qwen/Qwen3-4B
Merge Formula:
models:
- model: prithivMLmods/Cetus-Qwen3_4B-GeneralThought
parameters:
weight: [1,1,.75,.5,.25,.25,.05,.01]
density: .8
- model: prithivMLmods/Crux-Qwen3_OpenThinking-4B
parameters:
weight: [0,0,.25,.35,.4,.25,.30,.04]
density: .6
- model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
parameters:
weight: [0,0,0,.15,.35,.5,.65,.95]
density: .8
merge_method: dare_ties
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
dtype: bfloat16
NOTES:
Get Mergekit here:
https://github.com/arcee-ai/mergekit
Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5 to 2.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 1" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
REFERENCE EXAMPLE:
[[[thinking start]]]
Okay, so I need to start a 1000-word scene in first person from the perspective of Diana. The main event is the skyscraper swaying and a window exploding on the 21st floor. Let me think about how to approach this.
First, I should establish Diana's immediate surroundings. She's in a high-rise building, maybe a new or futuristic one. The setting needs to be vivid and detailed. Maybe describe the building's architecture, the city below, the weather conditions. Then introduce the swaying of the skyscraper. Why is it swaying? Is it due to wind, an earthquake, or something else? Maybe a malfunction in the building's systems?
Next, the window explosion. I need to build tension leading up to that moment. Perhaps there's a strange phenomenon happening, like unusual weather, strange sounds, or visual cues that hint at something wrong. Then, the window explodes. The scene needs to be graphic and horrifying. Describe the sound, the visuals, the physical sensations Diana experiences.
Also, think about Diana's emotions and reactions. Fear, confusion, maybe some denial or panic. How does she react when the window explodes? Does she try to escape, get injured, or is there a rescue? Maybe there's a twist, like the building is collapsing or something supernatural is happening.
I should also consider the pacing. Start with normalcy, then introduce the strange elements, build up to the explosion, and then the aftermath. Use sensory details—sights, sounds, smells, touch. Make sure the reader feels the horror through Diana's perspective.
Potential plot points: Why is the skyscraper swaying? Is it a malfunction, an attack, or something else? Maybe there's a hidden threat or a supernatural element. The window explosion could be part of a larger event, like a collapse or a disaster.
Also, think about the structure of the scene. Start with Diana in her environment, then the initial signs of something wrong, leading up to the explosion. Aftermath: what happens next? Does she survive? Are there other characters involved? Maybe other people are also affected.
Need to ensure the scene is vivid and graphic. Use strong verbs and adjectives. Show, don't tell. Let the reader experience the horror through Diana's senses and actions.
Possible challenges: Making the scene engaging without being too cliché. Ensuring the horror elements are original and effective. Balancing action with character development.
Also, think about the tone. It should be intense, suspenseful, with a sense of impending doom. Maybe some elements of the supernatural or the unknown to add depth.
Now, putting it all together. Start with Diana in the building, describe the environment, introduce the swaying, build up to the window explosion, then the aftermath. Use first-person perspective to immerse the reader in Diana's experience.
[[[thinking end]]]
OUTPUT:
I stood on the 21st floor of the Skyline Tower, my back pressed against the cool glass of the observation deck. The building loomed above the city like a jagged needle, its steel frame gleaming under the late afternoon sun. Below, the skyline was a patchwork of neon and shadow, the city below a labyrinth of glass and concrete, pulsing with life. I had never felt so small, so insignificant, as I stood here, a single figure against the vastness of the world.
The wind had been unusually still this morning, but now it stirred, a low, persistent hum that seemed to emanate from the building itself. The Skyline Tower was one of the newest structures in the city, a marvel of engineering that had been hailed as a symbol of progress. Its foundation was deep, its design optimized for stability, and yet, there was something about the way the building moved that felt wrong. It wasn’ t the usual sway of a tall structure in a breeze—it was more like a living thing, shifting with an almost imperceptible rhythm.
I had been here for hours, staring out at the city below, trying to ignore the strange sensation that had taken hold of me. It started as a whisper in my thoughts, a flicker of something just beyond the edge of my perception. Then it became a vibration in my bones, a low-frequency thrum that seemed to come from the building itself. I tried to shake it off, to tell myself it was just the wind, but the feeling persisted, growing stronger with each passing moment.
The building moved again, this time more clearly. The glass panels of the observation deck trembled slightly, and I felt a strange pressure in my chest, as if the air itself were being squeezed. I reached for the railing, my fingers brushing against the cold metal, but the sensation was gone as quickly as it had come. I stood there, breathless, watching the city below, trying to make sense of what I was feeling.
Then it happened. A sound, low and resonant, like the deep rumble of a distant earthquake. The building shuddered, and for a moment, I thought I was going to fall. The glass panels of the observation deck cracked, and I saw it—something moving in the distance, something that shouldn’t have been there. A shadow, long and thin, stretching across the skyline like a blade of glass.
I turned my head, but the building had already started to sway again, this time with a force that made my teeth ache. The wind howled through the corridors of the building, and I could hear the faint sound of metal groaning under pressure. I reached for the railing again, but this time, it was too late.
The window exploded.
It happened so fast that I didn’t have time to react. A deafening crack split the air, and the glass shattered like ice in a storm. I felt the force of the explosion push against me, a violent shove that sent me stumbling back. The glass碎片 rained down around me, some of them cutting into my skin, others embedding themselves in the floor. I could hear the screams of people below, their voices muffled by the roar of the wind.
I looked down, and there they were—people, dozens of them, standing on the 21st floor, their faces twisted in terror as the glass panels around them shattered. Some were trying to run, others were frozen in place, their eyes wide with fear. I saw a man in a business suit, his face pale, his hands trembling as he tried to hold onto the railing. A woman in a red dress, her hair flying in all directions, her eyes locked on the window that had just exploded.
The building was moving now, swaying with a force that made my stomach churn. The glass panels of the observation deck cracked and broke, and I could see the city below through the gaps, the skyline a jagged silhouette against the darkening sky. I tried to move, but my legs felt like they were glued to the floor. The wind was stronger now, a howling gale that seemed to come from everywhere at once.
I looked back at the window where it had exploded, and I saw something that made my blood run cold. There was a figure standing in the center of the shattered glass, its form elongated and thin, its movements fluid and unnatural. It wasn’t human, but it wasn’t entirely inhuman either. Its eyes were large and luminous, glowing with an eerie blue light, and its body seemed to shift and twist as it moved.
I tried to scream, but my voice was lost in the howling wind. The building was moving faster now, swaying with a rhythm that felt almost hypnotic. I could feel the pressure in my chest, the same sensation that had come to me earlier, but this time, it was stronger, more overwhelming. I reached for the railing again, but this time, it was too late.
The building tilted, and I felt the force of gravity pulling me downward. I tried to hold on, but my fingers slipped through the metal as the glass panels around me shattered. The wind howled louder now, a sound that seemed to come from everywhere at once, a cacophony of voices and screams that filled my ears.
I looked down again, and the figure in the center of the shattered glass was still there, its form elongated and thin, its movements fluid and unnatural. It raised one of its arms, and I saw something that made my blood run cold—a long, thin blade of light, glowing with an eerie blue hue. It moved toward me, and I could feel the heat of it, the same sensation that had come to me earlier, but this time, it was stronger, more overwhelming.
I tried to move, but my legs felt like they were glued to the floor. The building was moving faster now, swaying with a force that made my stomach churn. I could hear the screams of people below, their voices muffled by the roar of the wind. I saw a man in a business suit, his face pale, his hands trembling as he tried to hold onto the railing. A woman in a red dress, her hair flying in all directions, her eyes locked on the window that had just exploded.
The figure in the center of the shattered glass raised its arm again, and I saw something that made my blood run cold—a long, thin blade of light, glowing with an eerie blue hue. It moved toward me, and I could feel the heat of it, the same sensation that had come to me earlier, but this time, it was stronger, more overwhelming.
I tried to scream, but my voice was lost in the howling wind. The building was moving faster now, swaying with a rhythm that felt almost hypnotic. I could feel the pressure in my chest, the same sensation that had come to me earlier, but this time, it was stronger, more overwhelming.