Graph Neural Networks, Transformers, Machine Learning, Artificial Intelligence, Graph Processing.
Transformers (GKATs), which combine graph kernels, attention-based networks with structural priors, and recent transformer architectures that apply small memory footprint implicit attention methods via low-rank decomposition techniques. The team demonstrates that GKATs achieve much more expressive