qwpl-gemma-7b-4x2e-5

This model was fine-tuned on the archives of Dinosaur Comics, and then further fine-tuned on a handwritten set of reasonably coherent punchlines to 1663.

Final loss on the main training run was 1.949142.

Refinement on punchlines:

1 	No log 	3.348098
2 	3.408800 	3.296106
3 	3.408800 	3.202096
4 	3.371700 	3.086150
5 	3.371700 	2.977916
6 	2.973400 	2.898972
7 	2.973400 	2.849893
8 	2.949900 	2.799534
9 	2.949900 	2.759501
10 	2.665300 	2.737012
11 	2.665300 	2.713636
12 	2.591800 	2.701511
13 	2.591800 	2.685183
14 	2.543700 	2.672993
15 	2.543700 	2.661361
16 	2.412500 	2.650694

Example punchlines for 1663:

I GUESS this is just proof that I'm still just a kid!!<eos>
I guess we got too advanced in our sciences? I guess now someone's gonna have to encode something that's actually important<eos>
I am now motivated to do exactly that!!<eos>
I should invent that.<eos>
I suppose I'll have to be boring and just invent new things out in the open from now on!<eos>
I guess what I'm trying to say is: I wish I'd invented calculus instead!<eos>
I'M going to change things, guys!!<eos>
I could stand to be more of an anagramist, I think!!<eos>
I guess it's back to working on figuring out a way to use anagrams to detect liars!!<eos>
I think!<eos>
I think our civilization lacks excitement just as much as Newton and Leibniz!<eos>
I hope future historians find out about me and find a super rad idea within a super boring email I wrote one time or something!!<eos>
I bet scientists used to be so cool that even their anagrammatic communications were super hot??<eos>
I'm going to do it! I'm going to encode a fundamental discovery into word games! I'm going to do it and I keep saying that and yet, still, I have not done it!!<eos>
I need to become a scientist again<eos>
I try to tell people there's a secret code just for me!<eos>
I propose "T-Rex invented the universe" be my first fundamental discovery! I WILL ENCODE THIS, I SWEAR TO GOD<eos>
I may write a paper for posterity and call it "I Was Having an Amazingly Good Bath Today!!" and be like, "I thought they might want to hear this in a century or two"!!<eos>
I say it's time for a new generation to claim the mantle!<eos>
I'm going to change that: I'm going to encode a fundamental discovery in an anagram!<eos>
I don't know; maybe the new "E=mc2243" isn't ready yet??<eos>
I think it was this lack of secret ciphers I was missing when I tried having sex with the word "dildatory":<eos>
I have emailed every scientist from history saying "I have another idea! This time, a way to avoid death, but a way that's also interesting!"<eos>
I need to get in on this soon: the world needs me to invent a cool system of communicating ideas in secret, then claim they're my first discovery!<eos>
I should do some more word games.<eos>
I suspect it's because there's no more uncredited and potentially Nobel Prize-winning discoveries happening today??<eos>
I don't even know WHERE the excitement went!!<eos>
I tried to use my body as a code, but nobody could figure out the solution!<eos>
I guess no-one knows about my fundamental discovery yet!!<eos>
I mean, when you look at it that way, perhaps being a scientist who can't do anagrams 100% of his research is wasted??<eos>
I wish I could say I don't want to know what I discovered in a code so secret that historians from a thousand years from now are still decoding it... but I would be a liar!!<eos>
I think anagramism's future lies in a post-apocalyptic world where someone uses it to communicate with aliens!<eos>
I need to be an anagramist from history!!<eos>
I thought of that as I was working on how to use anagrams to solve my money problems, but alas!!<eos>
I did get that phrase "fundamental discovery into word games" to work, though - that was exciting!<eos>
I guess all modern communication is too efficient and there's no reason to make words more weird!<eos>
I miss the days when scientists couldn't trust their friends with their secret code ideas, which meant there were a lot of bad anagrams!!<eos>
I have a solution: we have to make scientific insights sexier!!<eos>
I could always just write my name backward, but that's not so fun if the only thing it means is "Rex".<eos>
I hope one day to write something so revolutionary it will only be comprehensible encoded this way!<eos>
I believe that history's greatest opportunity to re-release their secret work has been lost in the ensuing centuries<eos>
I wish for a day when somebody discovers a new fundamental theory that can then be discovered anew, by anagram!<eos>
I can understand why!<eos>
I think I'd like to do better in history, please?<eos>
I feel I have a chance to change that in the 2200s!!<eos>
I guess they don't have 1600s-sized problems anymore.<eos>
I think that's because, as a species, we developed math before our interest in anagraming ideas and thus were able to skip right to not having our ideas stolen??<eos>
I propose we return to this exciting period by going backward in time!!<eos>
I'm gonna solve that, even if it means making myself super smart; I'M pretty sure I know how to use an anagram!<eos>
I was gonna do it with my thesis, BUT then I realized I'm not sure how important my thesis is and now I've given up on life<eos>
I need to find a way to interest scientists from history in using anagram-based techniques.<eos>
I tried to prove the Riemann hypothesis to a friend a few weeks ago and I really thought I was going to get away with it, but eventually I just said "OK anyway, my friend, I will still share my exciting news with you: I believe a secret code must be invented that ensures our conversations with each another will always be coded and thus secret from everyone else!"<eos>
I guess it takes the fun out of science, huh??<eos>
I'm totally gonna change that!!<eos>
I really wish I was alive in the 1600s.<eos>
I suggest that one way to liven things up is to write "I AM NOT A CONSPIRACY" on the roof of the NASA building: the only way to determine if I am is to use your rocket ships!!<eos>
I wish we still HAD those sorts of problems!<eos>
I can't expect the world to know that every time I say "a little bit", I'm really expressing my opinion about how it's a little bit of a thing and that if it were a little more of a thing, then perhaps I could be convinced of its more universal importance??<eos>
I guess you'll be happy to know I've just discovered a totally new form of anagram called "slogangrams", which are just regular anagrams, but with a nice corporate byline!<eos>
I'm gonna say I invented relativity in reverse alphabetical order to spice things up a little bit<eos>
I think there's a lot of untapped potential in this area; I can just see it already!!<eos>
I think that maybe today is the day I start my anagraming revolution?<eos>
I guess we just don't need to keep that secret anymore<eos>
I should maybe do that?<eos>
I wish it were so because then I could talk to them and find out if they're gonna build the future I imagined, yo<eos>
I should be working on an anagram for the speed of light? I've already finished this sentence!!<eos>
I'm going to prove that hypothesis by putting my greatest discovery today into a word: "I'm going to prove I'm right, and it will cause so much pain!!"<eos>
I think I'm going to fix that!!<eos>
I'm gonna make up a theory and encode it anyway! Then anyone who steals my idea will have to encode THEIR idea to deny it, AND it will look like they have no idea what they're talking about!!<eos>
I'm gonna change that!!<eos>
I hope we all regret this soon!<eos>
I need to solve that issue somehow!<eos>
I tried coming up with a cool equation encoded in "you need love, but can survive without it": "1316 350143 2255 133812 350143 3014 350143 255139 350143 3113909" but it only worked if people had access to the best dictionary I could find!!<eos>
I wish I was a scientist from history!!<eos>
I think it's time for me to invent science!<eos>
I want to hear about my new friends being all "3s30s5t! Wowsers!!!!" and then unencoding their ideas into "33.3 0.5s 5t. Wowsers!!!" I think I would like that, and I think you would too!!<eos>
I wish people encoded more, but at the same time I wish I didn't, because when they solve it, they'd know how to read my private thoughts!<eos>
I'd guess it's too easy: we can just go to Yahoo Answers with our problems and hope someone solves them quickly!!<eos>
I bet it's because of all the modern word games that are pretty much designed for encoding secrets!<eos>
I've written a fundamental mathematical inequality that's just 30 words long and I tried to use an anagram, but I'm struggling because the longest word is two letters and the shortest one is three.<eos>
I encode my secrets in puzzles, but you can easily solve them AND use a computer to solve them all at once so I guess you're right<eos>
I haven't even met any scientists from today, so I guess I kinda don't know what anyone's into anymore, come to think of it.<eos>
I may as well just send my papers in regular, not-encoded form. I'm a scientist from the 1700s, so I can barely even use computer paper!<eos>
I don't suppose anyone could do it now, anyway, given how well-traveled the fundamental discoveries have become!!<eos>
I should tell them the good news: "The idea of secret anagrams went away for a while, but it was fun and then it got resurrected and is fun again now!"<eos>
I think it has something to do with a lot more of us having access to the internet, which was something that happened I think about 400 years ago so I don't really get it<eos>
I really need to stop reading letters and start going back in time and reading more ancient ones, man!<eos>
I think in the future we'll ALL be thinking, "What if there's an advanced civilization out there, and they're all just wasting each other’s time with anagrams about whether to wear a hat? And they're like, it's such a great time. I never know how great it's going to be until later, when I need to look in my time machine!"<eos>
I guess you could say we're all being left a little "deciphered".<eos>
I may invent the next one! I call it "anagrams AND not being stupid anymore".<eos>
I want to be a time traveler: I wanna find some of these secrets and I wanna use them so I don't lose anything I've personally invented too!!<eos>
I guess the world is missing out!<eos>
I mean, sometimes I - I write my grocery lists like "A lot of people like to buy eggs. What about... YOLKRACED?"<eos>
I have no doubt I've discovered an incredible truth, but since I'm not sending out my discovery in code, no-one will know about it until I've invented some other form of encoding or publishing first<eos>
I have invented a new word: "the-boring-ness"<eos>
I propose we find a way to communicate secretly: "Let's talk on the phone AND about me AND if you make a mistake tell me it's my imagination"<eos>
I guess we take security too seriously now, huh, internet??<eos>
I think everyone should encode things in secret code when doing so would be inconvenient; I find that way better!<eos>
I would like to believe this is due to the modern scientists (myself included!) not worrying about their ideas being stolen... the fact that we live in times where we can simply email somebody a video of it on the other hand... well, it really muddies the picture<eos>
I wish we had more of that today. I'm sure I would be good at it!!<eos>