First download the tarball at https://dinisnoise.org/files/din-55-evaluation.tar.gz
Then unpack the tarball and install the synth.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence