I’m trying to do the same thing, and getting the same error. Did you ever fix this?
EDIT: The solution is to use a larger image input size, I suspect because otherwise the successive pooling operations will reduce it to have a negative size or something. Also it must be a multiple of 32.