First you need to build a model which is equivalent in terms of operations to the one you want to import.
I guess after that you can imports the weights from the Caffe2 model (with appropriate mapping between weight names).