Answers.Body: <p>By my understanding, describing now the images: Compute graph for node A and B</p>
  <p>At the bottom each node depicted has some initial input feature vector. This vector gets then multiplied by some matrix creating a new, more abstract feature vector. This corresponds to the first graph convolutional layer.
  The number of these new features is a hyperparameter and solely dependent on the matrix. Since every node in this specific has the same feature vectors this is well defined.
  The number of nodes connected with the next upper node is solely impacting the aggregation part, the more connected nodes simply the more things to add.
  So, it seems like I had misunderstood this all along and hopefully this helps some other people in the future.<br />
  This can of course we be written more clearly/concise, but after 7 months without answer, there doesn't seem a hurry. I leave that to do for later.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-11-27T00:24:17.560Z
Answers.LastActivityDate: 2022-11-27T00:24:17.560Z
Answers.UserDisplayName: Imago
Body: <p>I have two closely related points regarding the weight sharing and generalization of graph Neural network. For illustration purposes, I attached two images which I reference. Images are taken from the Stanford course &quot;CS224W:Machine Learning with Graphs&quot; given by &quot;Jure Leskovec&quot;</p>
  <p><a href="https://i.sstatic.net/kUmYt.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/kUmYt.png" alt="gnns2" /></a></p>
  <ol>
  <li>In the centre above one can see that the blue, red and green node feed into the yellow one. The same can be seen one the right side with the same colour configuration. Are now these parameters shared across all computational graphs which 3 nodes feeding into 1?</li>
  </ol>
  <p><a href="https://i.sstatic.net/SvbcT.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/SvbcT.png" alt="gnns1" /></a></p>
  <ol start="2">
  <li>If yes, then how does this generalize to a potential new graph? In the second image above, one can see that there are new types of computational graphs needed, e.g. on the right side the orange node has five neighbours while there is no such node on the left side. So, how does the generalization work in this case?</li>
  </ol>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-04-30T05:13:35.537Z
Comments.Text: Can you please put your **specific question** in the title? "Weight Sharing and Generalization in Graph Neural Network" is not a question and it's also not specific at all. If you you have more than one question, split your post into multiple ones - one for each question. It's ok to have one main question and one simple follow-up question (I think), but it's not ok to have 5 questions that require the user to do 3 days of research to answer them. Thank you.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-04-30T15:37:57.280Z
Comments.Text: @nbro I made the suggested adaptions. Thank you.
Comments.UserDisplayName: Imago
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-04-20T05:27:09.173Z
Comments.Text: better insight can be gained by observing weight sharing in specific contexts. it is used in various models like convolutional networks, transformers, autoencoders with tying weights
Comments.UserDisplayName: Reza_va
Tags: <graph-neural-networks><generalization>
Title: How does Weight Sharing with the Generalization in Graph Neural Networks work?
UserDisplayName: Imago
ThreadText: # How does Weight Sharing with the Generalization in Graph Neural Networks work?
  
  (Asked by: username_0 on 2022-04-29)
  
  I have two closely related points regarding the weight sharing and generalization of graph Neural network. For illustration purposes, I attached two images which I reference. Images are taken from the Stanford course "CS224W:Machine Learning with Graphs" given by "Jure Leskovec"
  
  [![gnns2](https://i.sstatic.net/kUmYt.png)](https://i.sstatic.net/kUmYt.png)
  
  1. In the centre above one can see that the blue, red and green node feed into the yellow one. The same can be seen one the right side with the same colour configuration. Are now these parameters shared across all computational graphs which 3 nodes feeding into 1?
  
  [![gnns1](https://i.sstatic.net/SvbcT.png)](https://i.sstatic.net/SvbcT.png)
  
  2. If yes, then how does this generalize to a potential new graph? In the second image above, one can see that there are new types of computational graphs needed, e.g. on the right side the orange node has five neighbours while there is no such node on the left side. So, how does the generalization work in this case?
  
  **Tags:** graph-neural-networks, generalization
  
  > **Comments:**
  > **username_1**: Can you please put your **specific question** in the title? "Weight Sharing and Generalization in Graph Neural Network" is not a question and it's also not specific at all. If you you have more than one question, split your post into multiple ones - one for each question. It's ok to have one main question and one simple follow-up question (I think), but it's not ok to have 5 questions that require the user to do 3 days of research to answer them. Thank you.  
  > **username_0**: @username_1 I made the suggested adaptions. Thank you.  
  > **username_2**: better insight can be gained by observing weight sharing in specific contexts. it is used in various models like convolutional networks, transformers, autoencoders with tying weights  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_0 on 2022-11-27. Score: 0
  
  By my understanding, describing now the images: Compute graph for node A and B
  
  At the bottom each node depicted has some initial input feature vector. This vector gets then multiplied by some matrix creating a new, more abstract feature vector. This corresponds to the first graph convolutional layer.
  The number of these new features is a hyperparameter and solely dependent on the matrix. Since every node in this specific has the same feature vectors this is well defined.
  The number of nodes connected with the next upper node is solely impacting the aggregation part, the more connected nodes simply the more things to add.
  So, it seems like I had misunderstood this all along and hopefully this helps some other people in the future.  
  This can of course we be written more clearly/concise, but after 7 months without answer, there doesn't seem a hurry. I leave that to do for later.
  
  
  ---
  
  