Cerebras-GPT: A Family of Open, Compute-Efficient, Large Language Models
I wonder if they've done some Alpaca style training on it... Granted, what made Alpaca useful was that it was finetuned with GPT-3's instruction following completions as examples.And, at least officially, OpenAI's outputs can't be used to train other AI models.Otherwise, if GPT-4 outputs were used to finetune these models, they may become much more interesting.