Humm, it’s not clear to me your reason for the summary issue.
For example, if you use any feature vector from TensorFlow Hub  (which is basically what your seem to be doing but using the keras application) you won’t be able to see the internal summary of the model too and that is a very common use.