Graphormer
### Model description

Graph Transformer model developed by Microsoft.

https://graphormer.readthedocs.io/en/latest/

### Open source status

- [X] The model implementation is available
- [X] The model weights are available

### Provide useful links for the implementation

Full implementation: https://github.com/microsoft/Graphormer/

Weights: 
-  pcqm4mv1_graphormer_base: https://ml2md.blob.core.windows.net/graphormer-ckpts/checkpoint_best_pcqm4mv1.pt
-  pcqm4mv2_graphormer_base: https://ml2md.blob.core.windows.net/graphormer-ckpts/checkpoint_best_pcqm4mv2.pt
-  pcqm4mv1_graphormer_base_for_molhiv: https://ml2md.blob.core.windows.net/graphormer-ckpts/checkpoint_base_preln_pcqm4mv1_for_hiv.pt
Hi, @clefourrier  
can I contribute to this? also open to any other issue 
I have previously contributed to PyTorch (350+ lines of C++, Objective C, and Python)<|||||>Hi @Raman-Kumar, I'd be delighted to have some help! 

I'll try to wrap up what I have and clean up a bit by Friday, and either I'll need your help on this to finish up, or it will be good and we can work together on integrating TokenGT, another graph transformer (for which I have draft code), or if you are feeling very confident, you can integrate another graph transformer model of your choice, wdyt?<|||||>😊 Replying a little late, I was going through other issues and reading some PRs.
@clefourrier 
I would like to work on integrating TokenGT

and am also ready to offer any other help if you have a delegable workload.
Meanwhile, I am reading more blogs and your work.<|||||>Solved by the merge of Graphormer