qwpl-gemma-4x1e-4-7b-1e-4

This model was fine-tuned on the archives of Dinosaur Comics, and then further fine-tuned on a handwritten set of reasonably coherent punchlines to 1663.

First training loss: 1.948742

Punchline dataset training:

Step 	Training Loss 	Validation Loss
1 	No log 	3.365407
2 	3.396100 	3.130191
3 	3.396100 	2.931755
4 	3.124100 	2.774593
5 	3.124100 	2.654332
6 	2.530200 	2.549393
7 	2.530200 	2.481657
8 	2.260000 	2.437596
9 	2.260000 	2.403292
10 	2.008900 	2.388291
11 	2.008900 	2.377411
12 	1.718900 	2.350605
13 	1.718900 	2.351382
14 	1.612100 	2.346930
15 	1.612100 	2.346850
16 	1.428400 	2.340477

Example punchlines for 1663:

I guess people are afraid that they'll leave something out and get ripped off: they could always just give me their fundamental theories and let me worry about it!!<eos>
I tried encoding "einstein was a nice man", but I accidentally stole his theory of relativity: now it's a fact!!<eos>
I am inventing science just to encode it into messages so folks will have to wait forever till they steal my discoveries: you can't cheat when they all find out I have a science that won't ever be revealed!!<eos>
I think I invented something: how about if I don't tell anyone so they will all think I am a really great dude??<eos>
I invented a new fun way you can encode your ideas: you just have to figure out who is stealing them first!!<eos>
I guess what I'm trying to say is: I invented a super important theory: the theory of totally boring things!!<eos>
I think it would be really fun: I'm gonna try it, just in case somebody steals my precious super amazing fun idea!!<eos>
I could solve this: I will use secret codes on all my discoveries!!<eos>
I guess it's too late for me: I would need to discover a new fundamental theory of awesome anyway!!<eos>
I think they should: this is gonna steal so much for me!!<eos>
I think this is because they worry about people stealing their ideas: they never know when they might need to encode them by accident again!!<eos>
I hope nobody secretly sends me their fundamental theories to prove that it's a good idea, though!!<eos>
I bet scientists are hiding secrets from each other all the time: I just have to prove that somehow still seems boring though!!<eos>
I just know that there are some great secrets that are being missed here, due to the people who are keeping them: I bet there's a lot of fun they could be having!!<eos>
I will make it so: I will steal lots of ideas, and I will ruin their reputations: then they can encode a new theory of ideas: one about me!!<eos>
I try to invent new theories to protect: then I just forget about them before I write them down!!<eos>
I think it’s because we’re not worried about people stealing our fundamental theories anymore: it’s all about the money!!<eos>
I just write things down: I'm guessing people will still figure it out anyway, but at least I'll be able to say they stole it from a genius!!<eos>
I think it's time for some new theories: I've been looking at a bunch of women, and the results are awesome!!<eos>
I'm going to invent a new fundamental theory, and I will be sure to encode it so nobody knows: I bet it will make me way cooler!!<eos>
I don't know any science theories: if you have any, can you tell me about them in a way that lets you keep all the credit?? I won't steal them: I like making up ideas for fun!!<eos>
I think it was fun: I should invent some fundamental ideas, so they can steal them first!!<eos>
I have theories: I guess they don't have anything to worry about anymore because everyone figured out science: all they need to worry about now are people stealing their dumb ideas!!<eos>
I can just send out my boring new ideas, and if anyone steals them they deserve it, I guess??<eos>
I should try inventing some new forms of words play: they might be more fun!<eos>
I suspect it’s because there was a long run of scientists having fundamental theories stolen: they no longer feel the need to resort to code!!<eos>
I think I'd just like to hear my friends tell me about their theories: boring or exciting, I still want to hear about them!!<eos>
I tried to invent my own fundamental theory today, but it turns out I just got super confused about how to calculate all the things: my idea is basically just a bunch of crap!!<eos>
I think they stopped doing that cuz they were worried all about ideas getting stolen!!

<strong>Check out some of the best jokes from this week!!</strong><eos>
I wonder if the fundamental theorems of mathematics are actually just hard to unscramble!!<eos>
I think they think I'll be safe if I write down a bunch of random numbers: I will show them a whole bunch of wrong!!<eos>
I think people are really just super boring: I found the secret to science: how to make it much more interesting!!<eos>
I need someone to invent a fundamental theory: I have the best ways to keep anyone from stealing it!!<eos>
I thought of a beautiful way of encoding a scientific theory: I never told anyone, because they might steal it!!<eos>
I think they all just assume others won't steal their ideas because they all seem like such jerks: a good defense but a bad offense: I think I can do better!!<eos>
I guess all modern scientists are saying is that they trust us not to steal their words: we should prove ourselves by doing that, and then they'll let us invent new theories!!<eos>
I guess the math is just really easy now, because people don't worry about their ideas being stolen!!<eos>
I invented a new fundamental theory: I made it into a cool palindrome!!<eos>
I could always just make up new theories: I bet no one will steal them if they're bad enough!!<eos>
I try finding secrets inside of emails and it hasn't worked out so good, I guess the only way is to encode my own theories about how it works and then go out and discover them: nobody will steal them now!!<eos>