Solved by sonnguyen in post #2 
              
              
                It should work fine. The weights relevant to the non zero pixels still learn.  MNIST dataset is also sparse and CNN still works very well there.