because of modern CPUs / GPUs, it’s easier to zero-out particular weights of a large Linear layer and do a dense matrix multiply, than do what you are doing (keep a linear_list of 2500 very tiny and serially executed matrix multiplies)