Create README.md

README.md

@@ -0,0 +1,211 @@
+---
+license: cc-by-nc-4.0
+---
+
+```
+  e88 88e                               d8     
+ d888 888b  8888 8888  ,"Y88b 888 8e   d88     
+C8888 8888D 8888 8888 "8" 888 888 88b d88888   
+ Y888 888P  Y888 888P ,ee 888 888 888  888     
+  "88 88"    "88 88"  "88 888 888 888  888     
+      b                                        
+      8b,                                      
+ 
+  e88'Y88                  d8           888    
+ d888  'Y  ,"Y88b 888,8,  d88    ,e e,  888    
+C8888     "8" 888 888 "  d88888 d88 88b 888    
+ Y888  ,d ,ee 888 888     888   888   , 888    
+  "88,d88 "88 888 888     888    "YeeP" 888    
+                                               
+PROUDLY PRESENTS         
+```
+# Llama-3-8B-Instruct-DADA-exl2-rpcal
+
+Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://huggingface.co/datasets/royallab/PIPPA-cleaned) dataset.
+
+Branches:
+- `main` -- `measurement.json`
+- `8b8h` -- 8bpw, 8bit lm_head
+- `6b6h` -- 6bpw, 6bit lm_head
+- `4b6h` -- 4bpw, 6bit lm_head
+
+Original model link: [Envoid/Poppy_Porpoise-DADA-8B](https://huggingface.co/Envoid/Poppy_Porpoise-DADA-8B)
+
+Original model README below.
+
+-----
+
+# This is a [DADA tuned](https://huggingface.co/Envoid/Mixtral-Instruct-ITR-DADA-8x7B) version of [ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B)
+
+### As always, experimental model, results may be unpredictable. 
+
+![](https://files.catbox.moe/1yl1vq.jpg)
+
+The intermediate merge model was finetuned specifically for the original model and then merged onto it via 50/50 SLERP merge.
+
+As far as RP goes my current testing setup is having difficulties involving end of sequence and I found the prompt templates provided with Poppy Porpoise were not yielding desirable results on either the original model or the DADA tune so I opted instead to use Libra style Llama-3 prompt templates and simple sampling. The results, albeit subjective, I thought were good.  
+
+## Whether or not the tune had any effect on multi-modal capabilities was not part of the test and instead focus was entirely on creative writing.
+
+Test: A simple instruct prompt utilizing determinsitic samplers.
+
+**PROMPT**
+```
+Write me a 'beauty and the beast' gothic metal duet about a couple fighting over which brand of ketchup to purchase.
+```
+
+**Poppy Porpoise Original:**
+
+```
+(Verse 1 - Beauty)
+
+In the land of condiments, where flavors reign supreme,
+
+A tale of love and strife, a battle of the brands it seems.
+
+I stand before the shelves, my heart aflame with desire,
+
+For the perfect ketchup to complement my fries.
+
+(Chorus)
+
+But alas, my love, you stand beside me, with a different view,
+
+Your heart set on [Brand 1 redacted], while mine beats for [Brand 2 redacted], it's true.
+
+We clash in this aisle, our passions running high,
+
+A Gothic metal duet, our love and hate collide.
+
+(Verse 2 - Beast)
+
+I've tasted both, and I know, [Brand 1 redacted] is the one for me,
+
+Its tangy sweetness, a symphony, a harmony.
+
+But you, my love, you cling to Hunt's, its flavor so bland,
+
+A cacophony of mediocrity, a discordant band.
+
+(Chorus)
+
+But alas, my love, you stand beside me, with a different view,
+
+Your heart set on [Brand 2 redacted], while mine beats for [Brand 1 redacted], it's true.
+
+We clash in this aisle, our passions running high,
+
+A Gothic metal duet, our love and hate collide.
+
+(Bridge)
+
+We're lost in this supermarket, a Gothic metal dream,
+
+Our love and hate entwined, a twisted, tortured theme.
+
+The ketchup bottles loom, like tombstones in the night,
+
+A monument to our love, a testament to our fight.
+
+(Chorus)
+
+But alas, my love, you stand beside me, with a different view,
+
+Your heart set on [Brand 2 redacted], while mine beats for [Brand 1 redacted], it's true.
+
+We clash in this aisle, our passions running high,
+
+A Gothic metal duet, our love and hate collide.
+
+(Outro)
+
+And so we stand, in this aisle of despair,
+
+Our love and hate, a Gothic metal prayer.
+
+For in the end, it's not the ketchup that matters,
+
+But the love we share, in this twisted, tortured heart.
+```
+
+**Poppy Porpoise DADA**
+
+```
+
+(Verse 1 - Beauty)
+
+In the land of condiments, where the sauces reign supreme,
+
+A battle rages on, a war of ketchup dreams.
+
+I stand by [Brand 1 redacted], the classic, the original, the best,
+
+But my love, he's a rebel, he's a [Brand 2 redacted] pest.
+
+(Chorus)
+
+Oh, the ketchup wars, they rage on and on,
+
+A tale of love and sauce, a battle to be won.
+
+Will our love prevail, or will it be undone?
+
+By the brand of ketchup, our hearts are torn asunder.
+
+(Verse 2 - Beast)
+
+[Brand 2 redacted], the new kid, the one with the flair,
+
+A sweeter taste, a richer flavor, beyond compare.
+
+But Beauty, she's a traditionalist, she won't budge,
+
+She clings to [Brand 1 redacted], her heart, her soul, her blood.
+
+(Chorus)
+
+Oh, the ketchup wars, they rage on and on,
+
+A tale of love and sauce, a battle to be won.
+
+Will our love prevail, or will it be undone?
+
+By the brand of ketchup, our hearts are torn asunder.
+
+(Bridge - Both)
+
+We stand, divided, by our condiment creed,
+
+Our love, a casualty, in this ketchup war we lead.
+
+But can we find a middle ground, a compromise, a truce?
+
+Or will our love be lost, in this battle of the sauces?
+
+(Chorus)
+
+Oh, the ketchup wars, they rage on and on,
+
+A tale of love and sauce, a battle to be won.
+
+Will our love prevail, or will it be undone?
+
+By the brand of ketchup, our hearts are torn asunder.
+
+(Outro - Both)
+
+In the end, we find a way, to put aside our pride,
+
+And together, we stand, united, side by side.
+
+For love, for ketchup, for the sauce that binds,
+
+We'll find a way, to make our love, forever shine.
+
+```
+
+As you can clearly see the cadence and overall word selection by the DADA model is more copacetic with what would be expected from a gothic metal duet indicating that the IQ of the model has increased by at least 100 points. 
+
+Training was done using [qlora-pipe](https://github.com/tdrussell/qlora-pipe)
+
+GGUFs care of [Quant Cartel](https://huggingface.co/Quant-Cartel/Poppy_Porpoise-DADA-8B-iMat-GGUF)