As i mentionet, this is an open source project, you could:

* open an issue regarding "fine tuning a data set" and promote it in our GitHub project.
* clone the project's repository and train your local instance of Open-Assistant with your data via API.
* contribute the changes you made to the main project via PR.

Let me know if that was helpfull.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence