Graph Neural Networks, Cs224w, Llm, Scaling Law, Artificial Intelligence.
mentions that graph datasets are relatively less numerous compared to natural language and image datasets, leading to a higher probability of overfitting. This is attributed to what is called a model scaling collapse. Simply put, model scaling collapse occurs due to oversmoothing. Model scaling