If I understand you correctly, you would like to classify volumetric data, i.e. 3d input to a class.
You could use Conv3d instead of Conv2d and build a standard conv net like this one 8.
What kind of data are you using?