Exactly!
Well, you could slice the channels and visualize each one as a gray image.
If you use color images (3 channels), the filters of your first conv layer will also have 3 channels, thus you could visualize them in color.