The reason I use sigmoid is to emulate a step function. I was hoping to emulate an OR (hid->out) of ANDs (in->hid) with the synthetic dataset I made up. I’ll tinker around a bit more and get back, thanks!