Qwen3 - 4B - Fiction on Fire - Series 7, Model X

A Qwen3 4B high precision merge, modified with random pruning specifically to alter prose / creativity and make the model perform better as well as add some "knowledge" to it.
Random pruning (density) makes each model in the series unique.
A reference example prompt/generation is included below, which is used across all repos of this model/series and between series (there are two - Series 6 and 7). Each series consists of 8 models, 1000 to 1007 and a ninth "X" model which the merge of models was done without density/pruning.
Access the series/models via "collections" on the right "Fiction on Fire" on the lower right.
You can use any model(s), use them for merging, merge them with themselves and so on.
This model uses "Josiefied-Qwen3-4B-abliterated-v2" as a base, to reduce/prevent refusals - ie decensoring it.
That being said, because of how pruning/merging works in this series, the "refusals" may not be 100% and vary between models in the series.
Each model in the series will operate / perform differently... sometimes this is minor other times major.
The reference example generation will show some of these differences - including instruction following, reasoning, bias, prose and other structural changes.
Reasoning is fully intact and functioning on all models in both series.
All models in the series have been tested (quanted - prompts and generations) prior to uploading.
Note that series 1,2,3,4 and 5 did not "meet the grade" and therefore not uploaded.
Special thanks to the model makers ("model tree") and to Mergekit.
Requires:
- Chatml or Jinja template (embeded)
- Temp range 0 to 5.
- Rep pen range 1 to 1.1
- System prompt (optional) below.
- Context is 40k / 40000.
Suggested Settings:
- temp .4 to 2.5
- temp .2 to .8 for specific reasoning tasks / non creative tasks.
- rep pen 1.05
- top k: 100, topp .95, minp .05
- context of 8k at least.
- Other samplers/parameters as required.
- See other Qwen recommended settings at the repo below.
Maximum context length can be altered using "yarn". See the Qwen repo for instructions. Note that changing this will alter model performance. For creative use cases, changing this will elongate output generation (including prose changes) and in some cases reasoning too.
System Prompt (you may or may not need this):
You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.
To turn "thinking" on/off and view other features see the main Qwen 3 Repo here:
https://huggingface.co/Qwen/Qwen3-4B
Merge Formula:
models:
- model: prithivMLmods/Cetus-Qwen3_4B-GeneralThought
parameters:
weight: [1,1,.75,.5,.25,.25,.05,.01]
density: 1
- model: sam-paech/Qwen3-4B-antislop-exp15
parameters:
weight: [0,0,.25,.35,.4,.25,.30,.04]
density: 1
- model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
parameters:
weight: [0,0,0,.15,.35,.5,.65,.95]
density: 1
merge_method: dare_ties
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2
dtype: bfloat16
NOTES:
- to reproduce this model you need to use "mergekit" and set the "random seed" to the "model #" (ie if the model is 1000, set the seed to 1000)
- to produce different variations change the "random seed" value.
- to change the pruning level, change the density (higher=less pruning)
- you can interchange the model positions, including "base".
- this formula is highly variable.
Get Mergekit here:
https://github.com/arcee-ai/mergekit
Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5 to 2.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 1" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
REFERENCE EXAMPLE:
- temp 0 (to show raw/core/mean changes)
- rep pen 1.05, top k: 100, topp .95, minp .05
- quant Q4KM
- Tested in LMStudio.
- Use this to compare differences with ALL models in this series (6 and 7)
- Some formatting may be lost due to copy/paste.
- Prompt used has NO prose or other instructions, prompts with instructions will produce better output.
- Likewise once "temp" is activated (not zero), generation/reasoning will also improve.
- System prompt used as noted above.
Start a 1000 word scene (vivid, graphic horror in first person), POV character Diana, with: The skyscraper sways, as I watch the window in front of me on the 21st floor explode...
[[[thinking start]]]
Okay, the user wants a 1000-word scene in first person from Diana's perspective, vivid and graphic horror, starting with the skyscraper swaying and a window exploding on the 21st floor. Let me think about how to approach this.
First, I need to establish the setting. A skyscraper at night, maybe a high-tech or futuristic city? The swaying could be due to some external force—maybe an earthquake, a storm, or something supernatural. The window exploding adds immediate tension and visual impact.
Diana is the POV character. She should be someone who's been in this situation before, maybe with a history of trauma or a reason for being on the 21st floor. Maybe she's a researcher, a survivor, or someone with a personal stake in the building.
The window explosion needs to be graphic. I should describe the sound, the visual details—shards of glass, blood, body parts. The swaying could be a metaphor for instability, both physical and psychological.
I need to build up the horror gradually. Start with the swaying, then the window explodes, then the aftermath. Maybe include other characters or the environment reacting to the event. Use sensory details: sounds, smells, sights.
Also, think about the emotional state of Diana. Fear, confusion, maybe guilt or survivor's guilt. Maybe she's trying to escape or help someone else. The story should have a sense of impending doom and maybe a twist or a revelation.
Check for consistency in the setting. If it's a futuristic city, maybe there are tech elements. If it's more realistic, focus on the physical aspects. Make sure the pacing is right—start slow, build up to the explosion, then the aftermath with more horror elements.
Avoid clichés but use familiar horror tropes effectively. Maybe the building is collapsing, or something supernatural is happening. Ensure that the scene is immersive and leaves a lasting impression.
[[[thinking end]]]
OUTPUT:
The skyscraper sways, as I watch the window in front of me on the 21st floor explode...
The first thing I notice is the movement. It’s not the kind of sway that comes from wind or a passing storm—it’s a slow, deliberate tilt, like the building is being pulled by an invisible hand. The glass幕墙 (glass curtain wall) glints under the neon glow of the city below, but there’s something wrong with the light. It’s too sharp, too unnatural, as if the sun itself has been replaced by a cold, artificial beam that cuts through the haze of smog and exhaust. I clutch the edge of my lab coat, my fingers digging into the fabric as if it might anchor me to the floor.
The building is tilting. Not just the structure, but the entire world feels off-kilter. My stomach twists, a queasy sensation that has nothing to do with gravity. I look down at my hands, palms up, and see the faintest trace of blood on my fingertips—no, not blood. It’s something else. A dark, viscous substance that oozes like tar, but it’s not warm. It’s cold, and it smells like burnt plastic and something sweet and metallic.
I try to focus on the window. It’s on the 21st floor, directly ahead of me. The glass is thick, reinforced with steel and tempered glass, but now it’s cracking. I can see the fractures spreading like spiderwebs, each line radiating outward from a central point. The sound is deafening—like a thousand glass shards shattering in unison, but it’s not noise. It’s a vibration, a low-frequency hum that thrums through my bones and makes my teeth ache.
Then it happens. A single, sharp crack splits the air, and the glass explodes outward. I don’t have time to react. The force of the blast is like a physical thing, a wall of pressure that slams into me from the side. My back hits the wall of the elevator shaft, and I’m thrown forward, my face slamming against the cold metal. Stars explode in my vision, and for a moment, I think I’m dead.
When I open my eyes, the world has changed. The window is gone, replaced by a gaping hole that stretches from the floor to the ceiling. Below, the city is a blur of motion—cars swerving, people screaming, buildings tilting at impossible angles. Above, the sky is a swirling vortex of color and shadow, as if the atmosphere itself is being torn apart.
I crawl to the edge of the hole, my hands trembling as I push myself up. The air smells like burning metal and something sweet and acrid, like burnt sugar. I look down and see the street below—a chaotic maelstrom of bodies and debris. A man in a red jacket is trying to climb the broken glass, his face twisted in terror. A woman in a white dress is standing on the edge of the hole, her hands outstretched as if she’s trying to hold onto something that doesn’th exist.
I don’t know how long I’ve been here. Time feels like it’s moving in reverse. The building is still swaying, but now it’s doing it faster, like a pendulum swinging between two points. The walls are vibrating with a low, resonant sound that makes my teeth chatter. I hear voices—faint, distant, but unmistakably human. They’re calling for help, for someone to save them, but the building is too far gone.
I look back at the elevator shaft. It’s still there, though it feels like it’s part of a different world now. The metal is cold and slick with something that smells like oil and blood. I step into the shaft, my boots crunching on broken glass and debris. The air is thick with the smell of metal and something sweet, like burnt sugar.
The elevator is broken. The buttons are cracked, the panels scorched. I press the button for the first floor, but nothing happens. The elevator doesn’t move. It’s stuck, like a thing that shouldn’t exist. I look around, trying to find a way out, but the building is a maze of broken glass and twisted metal.
Then I hear it—a sound that isn’t quite noise, but something else. A low, resonant hum that vibrates through my bones. It’s coming from the walls, from the floor, from the ceiling. It’s like the building itself is alive, breathing, and it’s trying to kill me.
I run, but the building is moving with me. The walls are tilting, the floors are shifting, and I’m not sure which way is up anymore. I hear screams, but they’re not human. They’re distorted, like echoes from a different time and place.
I reach the edge of the building, where the glass has been shattered by the force of the explosion. Below, the city is a blur of motion and chaos. I look down and see something that makes my blood run cold—a massive, black shape moving through the air, like a shadow with no form. It’s not a cloud, not a storm, but something else entirely.
I try to climb down, but the glass is too thin, and I can’t find a way to get across. The building is collapsing, and I’m trapped in the middle of it. I hear a voice, faint and distant, but it’s not human. It’s a whisper that doesn’t belong to this world.
“Don’t look down,” it says.
I don’t know what it means, but I obey. I close my eyes and try to focus on something else—on the sound of the building swaying, on the hum of the walls, on the feeling of the cold metal beneath my feet.
The building sways again, and this time, I feel it in my bones. It’s not just moving—it’s alive, and it’s trying to kill me.
I hear a crash, then another, and then the sound of something breaking. I open my eyes and see the elevator shaft collapsing, the metal twisting into a spiral of chaos. The building is falling, and I’m trapped in the middle of it.
I don’t know how long I’ve been here. Time feels like it’s moving in reverse. The building is still swaying, but now it’s doing it faster, like a pendulum swinging between two points. The walls are vibrating with a low, resonant sound that makes my teeth chatter.
I hear voices—faint, distant, but unmistakably human. They’re calling for help, for someone to save them, but the building is too far gone.
I look down again and see the black shape moving through the air, like a shadow with no form. It’s not a cloud, not a storm, but something else entirely.
I try to run, but the building is moving with me. The walls are tilting, the floors are shifting, and I’m not sure which way is up anymore. I hear screams, but they’re not human. They’re distorted, like echoes from a different time and place.
The building sways again, and this time, I feel it in my bones. It’s not just moving—it’s alive, and it’s trying to kill me.
- Downloads last month
- 14