thanks a lot for replying . so excuse me if  extracted the features from images using CNN , can I extract weights of captions  using BERT and apply them to the weights of the embedding layer and then use LSTM for example ?
and will I need to extract features for words using BERT from all layers or I need to ignore the classification layer?