You're right, I was wrong. "Numbers inside the black box" are called weights, and are updated with the algorithm called Stochastic Gradient Descent. Thought this algorithm is stochastic because it considers random samples of the overall data at each step, it is perfectly deterministic to compute.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence