Turns out, generating 13k questions and answers is harder than it looks. Every answer has to be
original. It can’t be copied from ChatGPT or anywhere on the web, or it would taint our dataset.  It
seemed daunting, but Databricks has over 5,000 employees who are very interested in LLMs. So we
thought we could crowdsource among them to create an even higher quality dataset than the 40
labelers had created for OpenAI. But we knew they were all busy and had full-time jobs, so we
needed to incentivize them to do this.

We set up a contest, where the top 20 labelers would get a big award. We also outlined 7 very
speci
Dolly 2 Databricks