hi thak123,
If you are using BERT model in PyTorch, then BertViz by Jesse Vig is quite nice.

  
      
      GitHub
  
  
    

jessevig/bertviz 21

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.) - jessevig/bertviz