My question is about transformers limitations : Given several codes written in different programming languages (java, python, C ++ etc). Suppose we have a huge dataset of these codes and we want to determine similar and not similar codes(similar = solving the same problem). Here The Transofmers (by their architecture) have limitations to solve this probelm because it is not about statistical understanding of the lanaguge. here it is about detecting similar structures between different programming languages (and not human language). Do you think that GNN (Graphical Neural Networks) could be a solution in this case, otherwise what is your proposal to tackle this problem ?

This is answered at 4:32:30 in the main stream.