It’s a new idea that I’m trying to implement. It consist of the adaptation of weights w.r.t. the inputs. Since a batch could consist of inputs of different nature, i.e. different class in the case of classification, the adaptation of weights would results in the multiple set of weights for a single batch. It’s a novel method that I’m working on. A workaround is to restrict a batch to contain inputs that are closely distributed.