marcman411:

entropy is bounded on the [0,1] interval


Is that true? BCE for one element x and target t is defined as
- ( t log(x) + (1-t) log (1-x)
If we take t -> 1 (from the bottom), x -> 0 (from the top) we get something very large.