Cerebras-GPT: A Family of Open, Compute-Efficient, Large Language Models
I wonder if they've done some Alpaca style training on it... Granted, what made Alpaca useful was that it was finetuned with GPT-3's instruction following completions as examples.<p>And, at least officially, OpenAI's outputs can't be used to train other AI models.<p>Otherwise, if GPT-4 outputs were used to finetune these models, they may become much more interesting.