Why did we create a new dataset?

As soon as we released Dolly 1.0, we were inundated by requests from people who wanted to try it
out. The number one question that we kept getting was “can I use this commercially?”

A critical step in the creation of Dolly 1.0, or any instruction following LLMs, is to train the model on a
dataset of instruction and response pairs. Dolly 1.0 was trained for $30 using a dataset that the
Stanford Alpaca team had created using the OpenAI API. That dataset contained output from
ChatGPT, and as the Stanford team pointed out, the terms of service seek to prevent anyone from
creating a model that competes with OpenAI. So, unfortunately, the answer to this common
question was, “probably not!”
Dolly 2 Databricks