Again, I agree, and by “lack of non-cat animal” I meant just that: instead of increasing the “cat output” on cat images, it may just as well decrease the other outputs (making them more negative). Still, it might be worth testing, and my question is if someone knows about any systematic empirical test of this (mathematically naive) hypothesis.