Releasing 3B and 7B RedPajama
There was a lot of detail and data in here, but it's not very useful to me because all of the comparisons are to things I have no experience with.There's really only one thing I care about: How does this compare to GPT-4?I have no use for models that aren't at that level. Even though this almost definitely isn't at that level, it's hard to know how close or far it is from the data presented.