To determine which version of Spark you have, you can use the following steps:
    1. cd to $SPARK_HOME/bin.
    2.  Launch spark-shell command.
    3. Enter sc.version or spark.version.
I hope this helps
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence